org.graalvm.shadowed.org.antlr.v4.runtime

Interface TokenFactory<Symbol extends Token>

All Known Implementing Classes:

CommonTokenFactory

public interface TokenFactory<Symbol extends Token>

The default mechanism for creating tokens. It's used by default in Lexer and the error handling strategy (to create missing tokens). Notifying the parser of a new factory means that it notifies its token source and error strategy.

Method Summary

Modifier and Type	Method and Description
Symbol	create(int type, String text) Generically useful
Symbol	create(Pair<TokenSource,CharStream> source, int type, String text, int channel, int start, int stop, int line, int charPositionInLine) This is the method used to create tokens in the lexer and in the error handling strategy.

Method Detail

create

Symbol create(Pair<TokenSource,CharStream> source,
              int type,
              String text,
              int channel,
              int start,
              int stop,
              int line,
              int charPositionInLine)

This is the method used to create tokens in the lexer and in the error handling strategy. If text!=null, than the start and stop positions are wiped to -1 in the text override is set in the CommonToken.

create

Symbol create(int type,
              String text)

Generically useful