Constructor
new Lexer()
Tokenizes (= Lexer) all the tokens
- Source:
Methods
(static) getDelimiters() → {string}
Returns all delimiters as a string
- Source:
Returns:
- Type
- string
(static) getRegisters()
Returns all registers as an array
- Source:
newToken(token)
Creates a new token and adds it to the token array list
If the token is either empty or in the deadSplitter array it is not added to the array
Parameters:
| Name | Type | Description |
|---|---|---|
token |
Which token should be added |
- Source:
pass(assembler, input) → {Array}
Does the tokenize step
Parameters:
| Name | Type | Description |
|---|---|---|
assembler |
The assembler in which it is executed, this parameter is completely ignored | |
input |
What should be tokenized? |
- Source:
Returns:
- Type
- Array