summaryrefslogtreecommitdiffstats
path: root/dimension/tokenize.h
Commit message (Collapse)AuthorAgeFilesLines
* Refactor tokenizer a bit.tavianator2009-10-291-1/+9
|
* Even more tokenizer work.Tavian Barnes2009-10-291-14/+22
| | | | | | The tokenizer is now able to tokenize all of POV-Ray 3.6's include files. It turns out that some #includes may be dynamic (ex. with #writes beforehand), so the tokenizer can't directly perform includes - the executor must do this.
* Prefix tokens with DMNSN_T_.Tavian Barnes2009-10-291-47/+47
|
* Tokenize all language directives.Tavian Barnes2009-10-291-1/+25
|
* Store source filename in tokens, give better diagnostics.Tavian Barnes2009-10-281-2/+3
|
* Tokenize strings and language directives.Tavian Barnes2009-10-281-0/+7
|
* Tokenize keywords.Tavian Barnes2009-10-281-0/+6
|
* Tokenize identifiers.Tavian Barnes2009-10-281-0/+3
|
* Add line and column numbers to tokens.Tavian Barnes2009-10-271-0/+3
|
* Tokenize numeric values.Tavian Barnes2009-10-271-0/+5
|
* Support more symbols in tokenizer.Tavian Barnes2009-10-271-2/+13
|
* Begin tokenizer.Tavian Barnes2009-10-261-0/+36