TokenFactory

The default mechanism for creating tokens. It's used by default in Lexer and the error handling strategy (to create missing tokens). Notifying the parser of a new factory means that it notifies it's token source and error strategy.

Members

Functions

create
Symbol create(TokenFactorySourcePair source, int type, Variant text, int channel, size_t start, size_t stop, int line, int charPositionInLine)

This is the method used to create tokens in the lexer and in the error handling strategy. If text!=null, than the start and stop positions are wiped to -1 in the text override is set in the CommonToken.

create
Symbol create(int type, Variant text)

Generically useful

Meta