Struct TokenStructure

The token that is returned by the lexer.

struct TokenStructure(IdType, string extraFields = "") ;

Constructors

NameDescription
this Constructs a token from a token type.
this Constructs a token.

Fields

NameTypeDescription
column size_tThe column number at which this token occurs. This is measured in bytes and may not be correct when tab characters are involved.
index size_tThe byte offset from the beginning of the input at which this token occurs.
line size_tThe line number at which this token occurs.
text stringThe text of the token.
type IdTypeThe token type.

Methods

NameDescription
opEquals
opEquals

Parameters

NameDescription
IdType The D type of the "type" token type field.
extraFields A string containing D code for any extra fields that should be included in the token structure body. This string is passed directly to a mixin statement.

Examples

// No extra struct fields are desired in this example, so leave it blank.
alias Token = TokenStructure!(IdType, "");
Token minusToken = Token(tok!"-");