Commit message (Expand) | Author | Age | Files | Lines | ||
---|---|---|---|---|---|---|
... | ||||||
* | Tokenize strings and language directives. | Tavian Barnes | 2009-10-28 | 1 | -3/+140 | |
* | Tokenize keywords. | Tavian Barnes | 2009-10-28 | 1 | -11/+38 | |
* | Tokenize identifiers. | Tavian Barnes | 2009-10-28 | 1 | -6/+41 | |
* | Fix line calculation in comment tokenizer. | Tavian Barnes | 2009-10-28 | 1 | -0/+1 | |
* | Split some tokenizing work out into helper functions. | Tavian Barnes | 2009-10-28 | 1 | -56/+82 | |
* | Ignore comments in tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -4/+35 | |
* | Add line and column numbers to tokens. | Tavian Barnes | 2009-10-27 | 1 | -1/+7 | |
* | Tokenize numeric values. | Tavian Barnes | 2009-10-27 | 1 | -2/+59 | |
* | Support more symbols in tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -18/+46 | |
* | Make tokenizer a bit more robust. | Tavian Barnes | 2009-10-27 | 1 | -3/+19 | |
* | New tokenizer test. | Tavian Barnes | 2009-10-27 | 1 | -4/+4 | |
* | New mmap-based tokenizer. | Tavian Barnes | 2009-10-27 | 1 | -13/+33 | |
* | Begin tokenizer. | Tavian Barnes | 2009-10-26 | 1 | -0/+114 |