Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Rename DMNSN_T_EXCLAMATION to DMNSN_T_BANG. | tavianator | 2009-10-29 | 1 | -22/+22 |
| | |||||
* | Refactor tokenizer a bit. | tavianator | 2009-10-29 | 1 | -26/+23 |
| | |||||
* | Don't modify lines, cols, or next in tokenizer helper functions. | Tavian Barnes | 2009-10-29 | 1 | -175/+207 |
| | |||||
* | Even more tokenizer work. | Tavian Barnes | 2009-10-29 | 1 | -102/+73 |
| | | | | | | The tokenizer is now able to tokenize all of POV-Ray 3.6's include files. It turns out that some #includes may be dynamic (ex. with #writes beforehand), so the tokenizer can't directly perform includes - the executor must do this. | ||||
* | Prefix tokens with DMNSN_T_. | Tavian Barnes | 2009-10-29 | 1 | -96/+96 |
| | |||||
* | Tokenize all language directives. | Tavian Barnes | 2009-10-29 | 1 | -4/+52 |
| | |||||
* | Complete string parsing. | Tavian Barnes | 2009-10-29 | 1 | -6/+69 |
| | |||||
* | Set the locale to `C' during tokenization. | Tavian Barnes | 2009-10-28 | 1 | -5/+27 |
| | |||||
* | Search in the same path as the current file for #includes. | Tavian Barnes | 2009-10-28 | 1 | -8/+27 |
| | |||||
* | Split tokenizer.sh into multiple tests. | Tavian Barnes | 2009-10-28 | 1 | -1/+1 |
| | |||||
* | Store source filename in tokens, give better diagnostics. | Tavian Barnes | 2009-10-28 | 1 | -46/+72 |
| | |||||
* | Make '#include' work. | Tavian Barnes | 2009-10-28 | 1 | -0/+33 |
| | |||||
* | Tokenize strings and language directives. | Tavian Barnes | 2009-10-28 | 1 | -3/+140 |
| | |||||
* | Tokenize keywords. | Tavian Barnes | 2009-10-28 | 1 | -11/+38 |
| | |||||
* | Tokenize identifiers. | Tavian Barnes | 2009-10-28 | 1 | -6/+41 |
| | |||||
* | Fix line calculation in comment tokenizer. | Tavian Barnes | 2009-10-28 | 1 | -0/+1 |
| | |||||
* | Split some tokenizing work out into helper functions. | Tavian Barnes | 2009-10-28 | 1 | -56/+82 |
| | |||||
* | Ignore comments in tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -4/+35 |
| | |||||
* | Add line and column numbers to tokens. | Tavian Barnes | 2009-10-27 | 1 | -1/+7 |
| | |||||
* | Tokenize numeric values. | Tavian Barnes | 2009-10-27 | 1 | -2/+59 |
| | |||||
* | Support more symbols in tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -18/+46 |
| | |||||
* | Make tokenizer a bit more robust. | Tavian Barnes | 2009-10-27 | 1 | -3/+19 |
| | |||||
* | New tokenizer test. | Tavian Barnes | 2009-10-27 | 1 | -4/+4 |
| | |||||
* | New mmap-based tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -13/+33 |
| | |||||
* | Begin tokenizer. | Tavian Barnes | 2009-10-26 | 1 | -0/+114 |