projects/dil: trunk/src/Token.d annotate

annotate trunk/src/Token.d @ 239:7911f6a92e6e

- Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. - Tokens are stored in a doubly linked list by the Lexer now. - Added method scanNext() which can be used by peek() and nextToken(). - Saving 'token' in Parser.try_().

author	aziz
date	Mon, 30 Jul 2007 12:36:04 +0000
parents	b7bde6583d3e
children	32d354584b28

rev	line source
0 8ba2570de175 Initial import. aziz parents: diff changeset	1 /++
8ba2570de175 Initial import. aziz parents: diff changeset	2 Author: Aziz Köksal
8ba2570de175 Initial import. aziz parents: diff changeset	3 License: GPL2
8ba2570de175 Initial import. aziz parents: diff changeset	4 +/
8ba2570de175 Initial import. aziz parents: diff changeset	5 module Token;
239 7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	6 import std.c.stdlib : malloc, free;
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	7 import std.outofmemory;
0 8ba2570de175 Initial import. aziz parents: diff changeset	8
8ba2570de175 Initial import. aziz parents: diff changeset	9 struct Position
8ba2570de175 Initial import. aziz parents: diff changeset	10 {
8ba2570de175 Initial import. aziz parents: diff changeset	11 size_t loc;
8ba2570de175 Initial import. aziz parents: diff changeset	12 size_t col;
8ba2570de175 Initial import. aziz parents: diff changeset	13 }
8ba2570de175 Initial import. aziz parents: diff changeset	14
3 4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	15 enum TOK
4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	16 {
95 0eb4c8a5b32b - Added TOK.Invalid. aziz parents: 84 diff changeset	17 Invalid,
0eb4c8a5b32b - Added TOK.Invalid. aziz parents: 84 diff changeset	18
3 4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	19 Identifier,
4 92df59b1ec4a - Started implementation of scan(). aziz parents: 3 diff changeset	20 Comment,
9 5d6968cc751e - Parsing string and character literals now (rudimentary implementation.) aziz parents: 4 diff changeset	21 String,
82 fc645fb2fe72 - scanEscapeSequences() doesn't return 0xFFFF as an error value anymore, because it is a valid codepoint usable by the user. aziz parents: 71 diff changeset	22 CharLiteral, WCharLiteral, DCharLiteral,
58 50bb7fc9db44 - The types of integers are recognized now. aziz parents: 56 diff changeset	23
50bb7fc9db44 - The types of integers are recognized now. aziz parents: 56 diff changeset	24 // Numbers
50bb7fc9db44 - The types of integers are recognized now. aziz parents: 56 diff changeset	25 Int32, Int64, Uint32, Uint64,
97 1a83e5070a84 - Added code for parsing IntNumber- and RealNumberExpressions. aziz parents: 95 diff changeset	26 // Floating point number scanner relies on this order. (FloatXY + 3 == ImaginaryXY)
62 96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	27 Float32, Float64, Float80,
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	28 Imaginary32, Imaginary64, Imaginary80,
58 50bb7fc9db44 - The types of integers are recognized now. aziz parents: 56 diff changeset	29
36 3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	30
3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	31 // Brackets
20 d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	32 LParen,
d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	33 RParen,
d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	34 LBracket,
d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	35 RBracket,
d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	36 LBrace,
d6adfbd7c513 - Added code for parsing braces. aziz parents: 18 diff changeset	37 RBrace,
21 c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	38
22 b05fff8e2ce4 - Added code for parsing Dot, Slice and Ellipses tokens. aziz parents: 21 diff changeset	39 Dot, Slice, Ellipses,
b05fff8e2ce4 - Added code for parsing Dot, Slice and Ellipses tokens. aziz parents: 21 diff changeset	40
131 ce636f3981cc - Removed TOK.Number. aziz parents: 107 diff changeset	41 // Floating point number operators
35 c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	42 Unordered,
c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	43 UorE,
c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	44 UorG,
c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	45 UorGorE,
c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	46 UorL,
c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	47 UorLorE,
36 3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	48 LorEorG,
3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	49 LorG,
35 c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	50
36 3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	51 // Normal operators
35 c470b9356e35 - Added code for parsing Unordered, UorE, UorG, UorGorE, UorL, UorLorE, NotEqual and Not tokens. aziz parents: 32 diff changeset	52 Assign, Equal, NotEqual, Not,
38 640c45aaaaee - Added code for parsing GreaterEqual, Greater, RShiftAssign, RShift, URShiftAssign and URShift tokens. aziz parents: 36 diff changeset	53 LessEqual, Less,
640c45aaaaee - Added code for parsing GreaterEqual, Greater, RShiftAssign, RShift, URShiftAssign and URShift tokens. aziz parents: 36 diff changeset	54 GreaterEqual, Greater,
36 3c7210a722f7 - Added code for parsing LorEorG, LorG, LessEqual, LessThan, LShiftAssign and LShift tokens. aziz parents: 35 diff changeset	55 LShiftAssign, LShift,
38 640c45aaaaee - Added code for parsing GreaterEqual, Greater, RShiftAssign, RShift, URShiftAssign and URShift tokens. aziz parents: 36 diff changeset	56 RShiftAssign,RShift,
640c45aaaaee - Added code for parsing GreaterEqual, Greater, RShiftAssign, RShift, URShiftAssign and URShift tokens. aziz parents: 36 diff changeset	57 URShiftAssign, URShift,
23 1a7903701a3d - Added code for parsing OrAssign, OrLogical and OrBinary tokens. aziz parents: 22 diff changeset	58 OrAssign, OrLogical, OrBinary,
24 903f91163f23 - Added code for parsing AndAssign, AndLogical and AndBinary tokens. aziz parents: 23 diff changeset	59 AndAssign, AndLogical, AndBinary,
25 9c866208b3f6 - Added code for parsing PlusAssign, PlusPlus, Plus, MinusAssign, MinusMinus, Minus tokens. aziz parents: 24 diff changeset	60 PlusAssign, PlusPlus, Plus,
9c866208b3f6 - Added code for parsing PlusAssign, PlusPlus, Plus, MinusAssign, MinusMinus, Minus tokens. aziz parents: 24 diff changeset	61 MinusAssign, MinusMinus, Minus,
32 d7011daa4740 - Added missing commas after the items in the messages table. aziz parents: 31 diff changeset	62 DivAssign, Div,
29 ef83eea26bbd - Added code for parsing MulAssign, Mul, ModAssign, Mod, XorAssign and Xor tokens. aziz parents: 28 diff changeset	63 MulAssign, Mul,
ef83eea26bbd - Added code for parsing MulAssign, Mul, ModAssign, Mod, XorAssign and Xor tokens. aziz parents: 28 diff changeset	64 ModAssign, Mod,
ef83eea26bbd - Added code for parsing MulAssign, Mul, ModAssign, Mod, XorAssign and Xor tokens. aziz parents: 28 diff changeset	65 XorAssign, Xor,
27 43b6bf56f0e9 - Added code for parsing CatAssign and Tilde tokens. aziz parents: 26 diff changeset	66 CatAssign, Catenate,
39 69b940398d7b - Added unittest to test correct parsing of operator tokens. aziz parents: 38 diff changeset	67 Tilde,
71 b3777cca323c - Added Identity and NotIdentity tokens. aziz parents: 65 diff changeset	68 Identity, NotIdentity,
23 1a7903701a3d - Added code for parsing OrAssign, OrLogical and OrBinary tokens. aziz parents: 22 diff changeset	69
21 c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	70 Colon,
c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	71 Semicolon,
c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	72 Question,
c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	73 Comma,
c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	74 Dollar,
c785c122e4e6 - Added code for parsing Colon, Semicolon, Question, Comma and Dollar. aziz parents: 20 diff changeset	75
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	76 /* Keywords:
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	77 NB.: Token.isKeyword() depends on this list being contiguous.
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	78 */
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	79 Abstract,Alias,Align,Asm,Assert,Auto,Body,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	80 Bool,Break,Byte,Case,Cast,Catch,Cdouble,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	81 Cent,Cfloat,Char,Class,Const,Continue,Creal,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	82 Dchar,Debug,Default,Delegate,Delete,Deprecated,Do,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	83 Double,Else,Enum,Export,Extern,False,Final,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	84 Finally,Float,For,Foreach,Foreach_reverse,Function,Goto,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	85 Idouble,If,Ifloat,Import,In,Inout,Int,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	86 Interface,Invariant,Ireal,Is,Lazy,Long,Macro,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	87 Mixin,Module,New,Null,Out,Override,Package,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	88 Pragma,Private,Protected,Public,Real,Ref,Return,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	89 Scope,Short,Static,Struct,Super,Switch,Synchronized,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	90 Template,This,Throw,True,Try,Typedef,Typeid,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	91 Typeof,Ubyte,Ucent,Uint,Ulong,Union,Unittest,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	92 Ushort,Version,Void,Volatile,Wchar,While,With,
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	93
239 7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	94 HEAD, // start of linked list
4 92df59b1ec4a - Started implementation of scan(). aziz parents: 3 diff changeset	95 EOF
3 4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	96 }
4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	97
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	98 alias TOK.Abstract KeywordsBegin;
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	99 alias TOK.With KeywordsEnd;
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	100
0 8ba2570de175 Initial import. aziz parents: diff changeset	101 struct Token
8ba2570de175 Initial import. aziz parents: diff changeset	102 {
3 4bbce78bfb1e - Added TOK enum. aziz parents: 0 diff changeset	103 TOK type;
84 ac8d961d10d1 - Added code for parsing This-,Super-,Null-,Bool-,Dollar-,CharLiteral- and StringLiteralExpression. aziz parents: 82 diff changeset	104 // Position pos;
0 8ba2570de175 Initial import. aziz parents: diff changeset	105
239 7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	106 Token* next, prev;
131 ce636f3981cc - Removed TOK.Number. aziz parents: 107 diff changeset	107
4 92df59b1ec4a - Started implementation of scan(). aziz parents: 3 diff changeset	108 char* start;
92df59b1ec4a - Started implementation of scan(). aziz parents: 3 diff changeset	109 char* end;
92df59b1ec4a - Started implementation of scan(). aziz parents: 3 diff changeset	110
0 8ba2570de175 Initial import. aziz parents: diff changeset	111 union
8ba2570de175 Initial import. aziz parents: diff changeset	112 {
31 94f09f4e988e - Added struct for strings to Token with 'pf' = postfix. aziz parents: 30 diff changeset	113 struct
94f09f4e988e - Added struct for strings to Token with 'pf' = postfix. aziz parents: 30 diff changeset	114 {
94f09f4e988e - Added struct for strings to Token with 'pf' = postfix. aziz parents: 30 diff changeset	115 string str;
94f09f4e988e - Added struct for strings to Token with 'pf' = postfix. aziz parents: 30 diff changeset	116 char pf;
94f09f4e988e - Added struct for strings to Token with 'pf' = postfix. aziz parents: 30 diff changeset	117 }
62 96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	118 dchar dchar_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	119 long long_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	120 ulong ulong_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	121 int int_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	122 uint uint_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	123 float float_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	124 double double_;
96af5653acef - Fixed loop of hex number scanner. Moved checks under the switch block. aziz parents: 58 diff changeset	125 real real_;
0 8ba2570de175 Initial import. aziz parents: diff changeset	126 }
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	127
107 722c05bbd5eb - Implemented parseEnumDeclaration() and added class EnumDeclaration. aziz parents: 97 diff changeset	128 alias srcText identifier;
722c05bbd5eb - Implemented parseEnumDeclaration() and added class EnumDeclaration. aziz parents: 97 diff changeset	129
65 6c21ae79fbb3 - Renamed function Token.span to Token.srcText. aziz parents: 62 diff changeset	130 string srcText()
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	131 {
30 426767b94635 - Added code for parsing the '#line' special token. aziz parents: 29 diff changeset	132 assert(start && end);
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	133 return start[0 .. end - start];
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	134 }
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	135
210 b7bde6583d3e - Made toString() static. aziz parents: 208 diff changeset	136 static string toString(TOK tok)
208 0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	137 {
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	138 return tokToString[tok];
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	139 }
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	140
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	141 bool isKeyword()
3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	142 {
163 f27a98bb17c7 - Fix: when parsing Declarator fails, type and ident is set to null. aziz parents: 131 diff changeset	143 return KeywordsBegin <= type && type <= KeywordsEnd;
28 3a9daccf7d96 - Added table for identifiers to Lexer. aziz parents: 27 diff changeset	144 }
208 0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	145
163 f27a98bb17c7 - Fix: when parsing Declarator fails, type and ident is set to null. aziz parents: 131 diff changeset	146 int opEquals(TOK type2)
f27a98bb17c7 - Fix: when parsing Declarator fails, type and ident is set to null. aziz parents: 131 diff changeset	147 {
f27a98bb17c7 - Fix: when parsing Declarator fails, type and ident is set to null. aziz parents: 131 diff changeset	148 return type == type2;
f27a98bb17c7 - Fix: when parsing Declarator fails, type and ident is set to null. aziz parents: 131 diff changeset	149 }
239 7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	150
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	151 new(size_t size)
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	152 {
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	153 void* p = malloc(size);
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	154 if (p is null)
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	155 throw new OutOfMemoryException();
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	156 cast(Token)p = Token.init;
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	157 return p;
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	158 }
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	159
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	160 delete(void* p)
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	161 {
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	162 free(p);
7911f6a92e6e - Added 'new' and 'delete' declarations to Token and uncommented next and prev members. Added HEAD to TOK. aziz parents: 210 diff changeset	163 }
208 0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	164 }
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	165
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	166 string[] tokToString = [
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	167 "Invalid",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	168
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	169 "Identifier",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	170 "Comment",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	171 "String",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	172 "CharLiteral", "WCharLiteral", "DCharLiteral",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	173
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	174 "Int32", "Int64", "Uint32", "Uint64",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	175 "Float32", "Float64", "Float80",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	176 "Imaginary32", "Imaginary64", "Imaginary80",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	177
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	178 "(",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	179 ")",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	180 "[",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	181 "]",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	182 "{",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	183 "}",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	184
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	185 ".", "..", "...",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	186
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	187 "Unordered",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	188 "UorE",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	189 "UorG",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	190 "UorGorE",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	191 "UorL",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	192 "UorLorE",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	193 "LorEorG",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	194 "LorG",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	195
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	196 "=", "==", "!=", "!",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	197 "<=", "<",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	198 ">=", ">",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	199 "<<=", "<<",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	200 ">>=",">>",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	201 ">>>=", ">>>",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	202 "\|=", "\|\|", "\|",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	203 "&=", "&&", "&",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	204 "+=", "++", "+",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	205 "-=", "--", "-",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	206 "/=", "/",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	207 "=", "",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	208 "%=", "%",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	209 "^=", "^",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	210 "~=", "~",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	211 "~",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	212 "is", "!is",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	213
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	214 ":",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	215 ";",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	216 "?",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	217 ",",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	218 "$",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	219
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	220 "abstract","alias","align","asm","assert","auto","body",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	221 "bool","break","byte","case","cast","catch","cdouble",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	222 "cent","cfloat","char","class","const","continue","creal",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	223 "dchar","debug","default","delegate","delete","deprecated","do",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	224 "double","else","enum","export","extern","false","final",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	225 "finally","float","for","foreach","foreach_reverse","function","goto",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	226 "idouble","if","ifloat","import","in","inout","int",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	227 "interface","invariant","ireal","is","lazy","long","macro",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	228 "mixin","module","new","null","out","override","package",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	229 "pragma","private","protected","public","real","ref","return",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	230 "scope","short","static","struct","super","switch","synchronized",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	231 "template","this","throw","true","try","typedef","typeid",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	232 "typeof","ubyte","ucent","uint","ulong","union","unittest",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	233 "ushort","version","void","volatile","wchar","while","with",
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	234
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	235 "EOF"
0a9bccf74046 - Added string table and toString() method to Token. aziz parents: 163 diff changeset	236 ];

Mercurial > projects > dil

annotate trunk/src/Token.d @ 239:7911f6a92e6e