summaryrefslogtreecommitdiffstats
path: root/dimension/tokenize.h
Commit message (Expand)AuthorAgeFilesLines
* Store source filename in tokens, give better diagnostics.Tavian Barnes2009-10-281-2/+3
* Tokenize strings and language directives.Tavian Barnes2009-10-281-0/+7
* Tokenize keywords.Tavian Barnes2009-10-281-0/+6
* Tokenize identifiers.Tavian Barnes2009-10-281-0/+3
* Add line and column numbers to tokens.Tavian Barnes2009-10-271-0/+3
* Tokenize numeric values.Tavian Barnes2009-10-271-0/+5
* Support more symbols in tokenizer.Tavian Barnes2009-10-271-2/+13
* Begin tokenizer.Tavian Barnes2009-10-261-0/+36