annotate lexer/Token.d @ 103:09b4d74cb3f5 new_gen

Parsing char, wchar and dchar as basic types.
author Anders Johnsen <skabet@gmail.com>
date Thu, 08 May 2008 10:54:29 +0200
parents 48bb2287c035
children 7ff4bc2accf2
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
1 module lexer.Token;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
2
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
3 public
88
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
4 import basic.SourceLocation;
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
5
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
6 import Integer = tango.text.convert.Integer;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
7
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
8 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
9 The Token struct will be used through the Lexer, Parser and other
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
10 modules as a location into source.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
11
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
12 The Token should always be optimized for size to limit unnecessary
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
13 memory usage.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
14 */
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
15 struct Token
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
16 {
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
17 Tok type;
88
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
18 SLoc location;
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
19 uint length;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
20
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
21 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
22 Create a new token with a Tok type, Location in source and a
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
23 length of how many chars the Token span in the source
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
24 */
88
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
25 static Token opCall (Tok type, SLoc location, uint length)
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
26 {
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
27 Token t;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
28 t.type = type;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
29 t.location = location;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
30 t.length = length;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
31 return t;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
32 }
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
33
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
34 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
35 Get the type of the Token as a string
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
36 */
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
37 char[] getType ()
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
38 {
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
39 return typeToString[this.type];
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
40 }
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
41
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
42 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
43 A human readable dump of a Token
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
44 */
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
45 char[] toString ()
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
46 {
88
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
47 return this.getType()~": Len: "~Integer.toString(this.length);
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
48 }
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
49
88
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
50 /// Get the range of this token
eb5b2c719a39 Major change to locations, tokens and expressions.
Anders Halager <halager@gmail.com>
parents: 74
diff changeset
51 SourceRange asRange() { return SourceRange(location, location + length); }
44
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
52
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
53 /**
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
54 Returns true if the type of this token is a basic type (int, float, ...).
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
55 Void is included, although a void in it self is not really a type.
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
56 */
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
57 bool isBasicType()
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
58 {
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
59 return type >= Tok.Byte && type <= Tok.Void;
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
60 }
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
61
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
62 /**
48
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
63 Returns true for all the various assignments (=, +=, *= ...)
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
64 */
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
65 bool isAssignment()
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
66 {
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
67 return type == Tok.Assign;
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
68 }
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
69
b6c1dc30ca4b Only tests that dont pass now are structs and switches
Anders Halager <halager@gmail.com>
parents: 44
diff changeset
70 /**
44
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
71 Just a shortcut to avoid `token.type == Tok.Identifier`.
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
72 */
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
73 bool isIdentifier()
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
74 {
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
75 return type == Tok.Identifier;
495188f9078e Big update - Moving towards a better, more seperated parser
Anders Halager <halager@gmail.com>
parents: 42
diff changeset
76 }
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
77 }
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
78
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
79 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
80 Tok is short for TokenType. This enum list is to supply the Token
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
81 with a type.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
82
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
83 This enum is used to switch over "many" places.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
84 */
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
85 enum Tok : ushort
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
86 {
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
87 /* Non-code related tokens */
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
88 EOF,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
89
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
90 /* Basic types */
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
91 Identifier,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
92 Integer,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
93
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
94 /* Basic operators */
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
95 Assign,
74
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
96 Plus, Minus,
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
97 Star, Slash, Percent,
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
98 Comma,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
99
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
100 /* Symbols */
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
101 OpenParentheses,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
102 CloseParentheses,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
103 OpenBrace,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
104 CloseBrace,
72
628cb46ab13b First update on the way to Arrays! :)
Anders Johnsen <skabet@gmail.com>
parents: 68
diff changeset
105 OpenBracket,
628cb46ab13b First update on the way to Arrays! :)
Anders Johnsen <skabet@gmail.com>
parents: 68
diff changeset
106 CloseBracket,
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
107 Seperator,
36
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
108 Colon,
28
69464d465284 Now supporting structs - both read and write. Still a few errors though, so watch out.
Anders Johnsen <skabet@gmail.com>
parents: 22
diff changeset
109 Dot,
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
110
8
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
111 /* Comparator operators */
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
112 Eq, Ne,
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
113 Lt, Gt,
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
114 Le, Ge,
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
115
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
116 Not,
6
606a57c90a0b Now lexing == as Equals
johnsen@johnsen-desktop
parents: 5
diff changeset
117
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
118 /* Keywords */
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
119 Byte, Ubyte,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
120 Short, Ushort,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
121 Int, Uint,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
122 Long, Ulong,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
123
103
09b4d74cb3f5 Parsing char, wchar and dchar as basic types.
Anders Johnsen <skabet@gmail.com>
parents: 94
diff changeset
124 Char, Wchar, Dchar,
09b4d74cb3f5 Parsing char, wchar and dchar as basic types.
Anders Johnsen <skabet@gmail.com>
parents: 94
diff changeset
125
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
126 Float, Double,
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
127
5
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
128 Bool,
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
129
37
858b9805843d Bug-fixes
Anders Halager <halager@gmail.com>
parents: 36
diff changeset
130 Void,
858b9805843d Bug-fixes
Anders Halager <halager@gmail.com>
parents: 36
diff changeset
131
22
e331e4e816e4 now handling structs to some extend
johnsen@johnsen-laptop
parents: 21
diff changeset
132 Struct,
e331e4e816e4 now handling structs to some extend
johnsen@johnsen-laptop
parents: 21
diff changeset
133
11
642c6a998fd9 Support for while statements and fixed scope for if
Anders Halager <halager@gmail.com>
parents: 8
diff changeset
134 If, Else,
642c6a998fd9 Support for while statements and fixed scope for if
Anders Halager <halager@gmail.com>
parents: 8
diff changeset
135 While,
36
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
136 Switch, Case, Default,
68
381975d76baf A LOT of bug fixing - also implemented implicit casts. If you do a --ast-dump-code on a target with some algebra of differant types, you should now see the type casts being made. Also, Tests are again back with only switches failing...
Anders Johnsen <skabet@gmail.com>
parents: 62
diff changeset
137 Return, Cast,
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
138
94
48bb2287c035 Added Modules. Right now it's very simple - will grow with time and need.
Anders Johnsen <skabet@gmail.com>
parents: 88
diff changeset
139 Module, Import,
48bb2287c035 Added Modules. Right now it's very simple - will grow with time and need.
Anders Johnsen <skabet@gmail.com>
parents: 88
diff changeset
140
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
141 }
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
142
42
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
143 /**
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
144 An associative array to supply a Tok to String function.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
145
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
146 Keep always this list updated when adding a new Tok.
4e879f82dd64 Added some docs for the lexer - now you can understand _some_ of the madness going on here :)
Anders Johnsen <skabet@gmail.com>
parents: 37
diff changeset
147 */
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
148 public char[][Tok] typeToString;
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
149
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
150 static this()
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
151 {
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
152 typeToString =
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
153 [
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
154 Tok.EOF:"EOF"[],
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
155 Tok.Identifier:"Identifier",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
156 Tok.Byte:"Byte",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
157 Tok.Short:"Short",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
158 Tok.Int:"Int",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
159 Tok.Long:"Long",
103
09b4d74cb3f5 Parsing char, wchar and dchar as basic types.
Anders Johnsen <skabet@gmail.com>
parents: 94
diff changeset
160 Tok.Char:"Char",
09b4d74cb3f5 Parsing char, wchar and dchar as basic types.
Anders Johnsen <skabet@gmail.com>
parents: 94
diff changeset
161 Tok.Wchar:"Wchar",
09b4d74cb3f5 Parsing char, wchar and dchar as basic types.
Anders Johnsen <skabet@gmail.com>
parents: 94
diff changeset
162 Tok.Dchar:"Dchar",
5
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
163 Tok.Bool:"Bool",
37
858b9805843d Bug-fixes
Anders Halager <halager@gmail.com>
parents: 36
diff changeset
164 Tok.Void:"Void",
8
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
165 Tok.Eq:"Eq",
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
166 Tok.Ne:"Ne",
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
167 Tok.Lt:"Lt",
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
168 Tok.Le:"Le",
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
169 Tok.Gt:"Gt",
2e1069ee21af Added Ne, Lt, Le, Gt, Ge and Not in lexer
johnsen@johnsen-desktop
parents: 6
diff changeset
170 Tok.Ge:"Ge",
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
171 Tok.OpenParentheses:"OpenParentheses",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
172 Tok.CloseParentheses:"CloseParentheses",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
173 Tok.OpenBrace:"OpenBrace",
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
174 Tok.CloseBrace:"CloseBrace",
72
628cb46ab13b First update on the way to Arrays! :)
Anders Johnsen <skabet@gmail.com>
parents: 68
diff changeset
175 Tok.OpenBracket:"OpenBracket",
628cb46ab13b First update on the way to Arrays! :)
Anders Johnsen <skabet@gmail.com>
parents: 68
diff changeset
176 Tok.CloseBracket:"CloseBracket",
28
69464d465284 Now supporting structs - both read and write. Still a few errors though, so watch out.
Anders Johnsen <skabet@gmail.com>
parents: 22
diff changeset
177 Tok.Dot:"Dot",
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
178 Tok.Assign:"Assign",
74
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
179 Tok.Plus:"Plus",
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
180 Tok.Minus:"Minus",
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
181 Tok.Star:"Star",
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
182 Tok.Slash:"Slash",
192da4976daa Renamed Add, Sub, Mul, Div and Mod in lexer to what they are (Plus, Minus....)
johnsen@johnsen-laptop
parents: 72
diff changeset
183 Tok.Percent:"Percent",
5
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
184 Tok.Integer:"Integer",
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
185 Tok.If:"If",
11
642c6a998fd9 Support for while statements and fixed scope for if
Anders Halager <halager@gmail.com>
parents: 8
diff changeset
186 Tok.While:"While",
36
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
187 Tok.Switch:"Switch",
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
188 Tok.Case:"Case",
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
189 Tok.Default:"Default",
21
0fb2d13dce37 Now working with gdc also (gdc use reverse paremeter validating on function calls)
johnsen@johnsen-laptop
parents: 11
diff changeset
190 Tok.Comma:"Comma",
5
2c5a8f4c254a Added very simple if support.
Anders Halager <halager@gmail.com>
parents: 1
diff changeset
191 Tok.Return:"Return",
22
e331e4e816e4 now handling structs to some extend
johnsen@johnsen-laptop
parents: 21
diff changeset
192 Tok.Struct:"Struct",
36
ce17bea8e9bd Switch statements support
Anders Halager <halager@gmail.com>
parents: 28
diff changeset
193 Tok.Colon:"Colon",
68
381975d76baf A LOT of bug fixing - also implemented implicit casts. If you do a --ast-dump-code on a target with some algebra of differant types, you should now see the type casts being made. Also, Tests are again back with only switches failing...
Anders Johnsen <skabet@gmail.com>
parents: 62
diff changeset
194 Tok.Seperator:"Seperator",
94
48bb2287c035 Added Modules. Right now it's very simple - will grow with time and need.
Anders Johnsen <skabet@gmail.com>
parents: 88
diff changeset
195 Tok.Cast:"Cast",
48bb2287c035 Added Modules. Right now it's very simple - will grow with time and need.
Anders Johnsen <skabet@gmail.com>
parents: 88
diff changeset
196 Tok.Module:"Module",
48bb2287c035 Added Modules. Right now it's very simple - will grow with time and need.
Anders Johnsen <skabet@gmail.com>
parents: 88
diff changeset
197 Tok.Import:"Import"
1
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
198 ];
2168f4cb73f1 First push
johnsen@johnsen-desktop
parents:
diff changeset
199 }