Struct TokenStructure

The token that is returned by the lexer.


						
				struct TokenStructure(IdType, string extraFields = "")
				;

Constructors

Name	Description
`this` (type)	Constructs a token from a token type.
`this` (type, text, line, column, index)	Constructs a token.

Fields

Name	Type	Description
`column`	`size_t`	The column number at which this token occurs. This is measured in bytes and may not be correct when tab characters are involved.
`index`	`size_t`	The byte offset from the beginning of the input at which this token occurs.
`line`	`size_t`	The line number at which this token occurs.
`text`	`string`	The text of the token.
`type`	`IdType`	The token type.

Methods

Name	Description
`opEquals` (other)
`opEquals` (type)

Parameters

Name	Description
IdType	The D type of the "type" token type field.
extraFields	A string containing D code for any extra fields that should be included in the token structure body. This string is passed directly to a mixin statement.

Examples

// No extra struct fields are desired in this example, so leave it blank.
alias Token = TokenStructure!(IdType, "");
Token minusToken = Token(tok!"-");