Package technology.sola.script.tokenizer


package technology.sola.script.tokenizer
This package provides tokenization functionality for sola-script.
  • Class
    Description
    Token holds information about a recognized token that sola script understands.
    Tokenizer provides functionality for tokenizing a source string into Tokens to be parsed and interpreted.
    The result from Tokenizer.tokenize() containing the parsed Tokens as well as any ScriptErrors.
    TokenType contains all recognized token types for sola script.