Struct TokenStructure

The token that is returned by the lexer.

struct TokenStructure(IdType, string extraFields = "") ;

Constructors

NameDescription
this (type) Constructs a token from a token type.
this (type, text, line, column, index) Constructs a token.

Fields

NameTypeDescription
column size_tThe column number at which this token occurs. This is measured in bytes and may not be correct when tab characters are involved.
index size_tThe byte offset from the beginning of the input at which this token occurs.
line size_tThe line number at which this token occurs.
text stringThe text of the token.
type IdTypeThe token type.

Methods

NameDescription
opEquals (other)
opEquals (type)

Parameters

NameDescription
IdType The D type of the "type" token type field.
extraFields A string containing D code for any extra fields that should be included in the token structure body. This string is passed directly to a mixin statement.

Examples

// No extra struct fields are desired in this example, so leave it blank.
alias Token = TokenStructure!(IdType, "");
Token minusToken = Token(tok!"-");