@ParametersAreNonnullByDefault

Package org.sonar.duplications.token

Provides a basic framework to sequentially read any kind of character stream and create list of tokens.

See: Description

Class Summary

Class	Description
Token
TokenChunker
TokenChunker.Builder	Note that order is important, e.g.
TokenQueue

Package org.sonar.duplications.token Description

Provides a basic framework to sequentially read any kind of character stream and create list of tokens. The entry point of this framework is the TokenChunker class.