Class Token


  • public class Token
    extends Object
    Tokens are string of character like an identifier, a literal, an integer, ... which are produced by the lexer to feed the parser. By definition, comments and preprocessing directives should not be seen by the parser that's why such Trivia, when they exist, are attached to the next token.
    • Method Detail

      • getValue

        public String getValue()
      • getOriginalValue

        public String getOriginalValue()
        Returns:
        the original value of the token. This method is useful when a language is case-insensitive as in that case all token values are capitalized.
      • getLine

        public int getLine()
        Returns:
        the line of the token in the source code
      • getColumn

        public int getColumn()
        Returns:
        the column of the token in the source code
      • getStartOffset

        public int getStartOffset()
      • getEndOffset

        public int getEndOffset()
      • getStartLineOffset

        public int getStartLineOffset()
      • getURI

        public URI getURI()
        Returns:
        the URI this token belongs to
      • isCopyBook

        public boolean isCopyBook()
      • isGeneratedCode

        public boolean isGeneratedCode()
      • isReplacement

        public boolean isReplacement()
      • hasTrivia

        public boolean hasTrivia()
        Returns:
        true if there is some trivia like some comments or preprocessing directive between this token and the previous one.
      • getTrivia

        public List<Trivia> getTrivia()
        Returns:
        the list of trivia located between this token and the previous one
      • getCopyBookOriginalLine

        public int getCopyBookOriginalLine()
      • getCopyBookOriginalFileName

        public String getCopyBookOriginalFileName()
      • isOnSameLineThan

        public boolean isOnSameLineThan​(Token other)
      • setGeneratedCode

        public void setGeneratedCode​(boolean b)
        FIXME no such method in SSLR 1.9
      • getFile

        public File getFile()
        FIXME no such method in SSLR 1.9
      • setCopyBook

        public void setCopyBook​(boolean copyBook)
        FIXME no such method in SSLR 1.9
      • setCopyBookOriginalFileName

        public void setCopyBookOriginalFileName​(String copyBookOriginalFileName)
        FIXME no such method in SSLR 1.9
      • setCopyBookOriginalLine

        public void setCopyBookOriginalLine​(int copyBookOriginalLine)
        FIXME no such method in SSLR 1.9
      • addAllTrivia

        public void addAllTrivia​(List<Trivia> currentTrivia)
        FIXME no such method in SSLR 1.9