Function getTokensForParser

const(Token)[] getTokensForParser(R) (
  R sourceCode,
  LexerConfig config,
  StringCache* cache
)
if (is(Unqual!(ElementEncodingType!R) : ubyte) && isDynamicArray!R);

Returns

an array of tokens lexed from the given source code to the output range. All whitespace tokens are skipped and comments are attached to the token nearest to them.