TokenFactory

The default mechanism for creating tokens. It's used by default in Lexer and the error handling strategy (to create missing tokens). Notifying the parser of a new factory means that it notifies it's token source and error strategy.

Members

Functions

create
Symbol create(TokenFactorySourcePair source, int type, Variant text, int channel, int start, int stop, int line, int charPositionInLine)

This is the method used to create tokens in the lexer and in the error handling strategy. If text!=null, than the start and stop positions are wiped to -1 in the text override is set in the CommonToken.

create
Symbol create(int type, Variant text)

Generically useful

Meta