Package | Description |
---|---|
org.sonar.duplications.token |
Provides a basic framework to sequentially read any kind of character stream and create list of tokens.
|
Modifier and Type | Method and Description |
---|---|
static TokenChunker.Builder |
TokenChunker.builder() |
TokenChunker.Builder |
TokenChunker.Builder.ignore(String regularExpression)
Defines that sequence of characters must be ignored, if it matches specified regular expression.
|
TokenChunker.Builder |
TokenChunker.Builder.token(String regularExpression)
Defines that sequence of characters, which is matched specified regular expression, is a token.
|
TokenChunker.Builder |
TokenChunker.Builder.token(String regularExpression,
String normalizationValue)
Defines that sequence of characters, which is matched specified regular expression, is a token with specified value.
|
Copyright © 2009-2012 SonarSource. All Rights Reserved.