Mercurial > projects > dil

comparison trunk/src/dil/TokensEnum.d @ 552:3bc7801c207e

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Refactored the way how tokens are flagged as whitespace.
author Aziz K?ksal <aziz.koeksal@gmail.com>
date Thu, 20 Dec 2007 23:26:43 +0100
parents d7050f2a4814
children
comparison
equal deleted inserted replaced
551:312da78ab301 552:3bc7801c207e
7 7
8 enum TOK : ushort 8 enum TOK : ushort
9 { 9 {
10 Invalid, 10 Invalid,
11 11
12 /// Flag for whitespace tokens that must be ignored in the parsing phase. 12 Illegal,
13 Whitespace = 0x8000, 13 Comment,
14 Illegal = 1 | Whitespace, 14 Shebang,
15 Comment = 2 | Whitespace, 15 HashLine,
16 Shebang = 3 | Whitespace, 16 Filespec,
17 HashLine = 4 | Whitespace, 17 Newline,
18 Filespec = 5 | Whitespace, 18 Empty,
19 Newline = 6 | Whitespace, 19
20 Empty = 7, 20 Identifier,
21
22 Identifier = 8,
23 String, 21 String,
24 CharLiteral, 22 CharLiteral,
25 23
26 // Special tokens 24 // Special tokens
27 FILE, 25 FILE,