Lexer

Lexes code and returns the individual tokens

struct Lexer {

this(string code);

Token[] tokenize();

static immutable

static immutable

char[char] ESCAPE_CHARS;

}

Constructors

this this(string code): Constructor takes code as text to tokenize

Members

Functions

tokenize Token[] tokenize(): Returns tokens from lexing a string of code

Static variables

ESCAPE_CHARS char[char] ESCAPE_CHARS;: AA of look up for escape chars based on character after \
KEYWORDS auto KEYWORDS;: Hash table of keywords

Meta

Source

See Implementation

mildew lexer structs