projects/dang: src/lexer/Token.d annotate

annotate src/lexer/Token.d @ 207:e0551773a005

Added the correct version.

author	Anders Johnsen <skabet@gmail.com>
date	Tue, 12 Aug 2008 18:19:34 +0200
parents	d3c148ca429b
children

rev	line source
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	1 module lexer.Token;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	2
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	3 public
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	4 import basic.SourceLocation,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	5 basic.SourceManager;
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	6
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	7 import Integer = tango.text.convert.Integer;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	8
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	9 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	10 The Token struct will be used through the Lexer, Parser and other
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	11 modules as a location into source.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	12
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	13 The Token should always be optimized for size to limit unnecessary
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	14 memory usage.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	15 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	16 struct Token
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	17 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	18 Tok type;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	19 SLoc location;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	20 uint length;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	21
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	22 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	23 Create a new token with a Tok type, Location in source and a
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	24 length of how many chars the Token span in the source
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	25 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	26 static Token opCall (Tok type, SLoc location, uint length)
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	27 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	28 Token t;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	29 t.type = type;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	30 t.location = location;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	31 t.length = length;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	32 return t;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	33 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	34
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	35 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	36 Get the type of the Token as a string
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	37 */
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	38 char[] get (SourceManager sm)
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	39 {
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	40 if (isIdentifier)
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	41 return sm.getText(asRange);
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	42 return typeToString[this.type];
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	43 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	44
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	45 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	46 A human readable dump of a Token
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	47 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	48 char[] toString ()
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	49 {
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	50 return typeToString[this.type];
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	51 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	52
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	53 /// Get the range of this token
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	54 SourceRange asRange() { return SourceRange(location, location + length); }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	55
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	56 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	57 Returns true if the type of this token is a basic type (int, float, ...).
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	58 Void is included, although a void in it self is not really a type.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	59 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	60 bool isBasicType()
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	61 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	62 return type >= Tok.Byte && type <= Tok.Void;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	63 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	64
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	65 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	66 Returns true for all the various assignments (=, +=, *= ...)
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	67 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	68 bool isAssignment()
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	69 {
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	70 return type >= Tok.Assign && type <= Tok.PercentAssign;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	71 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	72
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	73 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	74 Returns true for all attributes( public, static, private...)
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	75 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	76 bool isAttribute()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	77 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	78 return type >= Tok.Public && type <= Tok.Extern;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	79 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	80
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	81 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	82 Returns true for all attributes( public, static, private...)
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	83 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	84 bool isBaseClassProtection()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	85 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	86 return type >= Tok.Public && type <= Tok.Export;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	87 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	88
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	89 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	90 just a shortcut to avoid `token.type == tok.Switch`.
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	91 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	92 bool isSwitch()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	93 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	94 return type == Tok.Switch;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	95 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	96
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	97 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	98 just a shortcut to avoid `token.type == tok.While`.
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	99 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	100 bool isWhile()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	101 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	102 return type == Tok.While;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	103 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	104
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	105 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	106 just a shortcut to avoid `token.type == tok.For`.
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	107 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	108 bool isFor()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	109 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	110 return type == Tok.For;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	111 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	112
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	113 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	114 just a shortcut to avoid `token.type == tok.If`.
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	115 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	116 bool isIf()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	117 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	118 return type == Tok.If;
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	119 }
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	120
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	121 /**
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	122 just a shortcut to avoid `token.type == tok.Return`.
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	123 */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	124 bool isReturn()
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	125 {
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	126 return type == Tok.Return;
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	127 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	128
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	129 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	130 Just a shortcut to avoid `token.type == Tok.Identifier`.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	131 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	132 bool isIdentifier()
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	133 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	134 return type == Tok.Identifier;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	135 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	136 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	137
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	138 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	139 Tok is short for TokenType. This enum list is to supply the Token
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	140 with a type.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	141
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	142 This enum is used to switch over "many" places.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	143 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	144 enum Tok : ushort
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	145 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	146 /* Non-code related tokens */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	147 EOF,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	148
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	149 /* Basic types */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	150 Identifier,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	151 Integer,
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	152 String,
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	153
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	154 /* Basic operators */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	155 Assign,
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	156 PlusAssign,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	157 MinusAssign,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	158 StarAssign,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	159 SlashAssign,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	160 PercentAssign,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	161 Plus,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	162 Minus,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	163 Star,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	164 Slash,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	165 Percent,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	166 LeftShift, RightShift, UnsignedRightShift,
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	167 Comma,
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	168 And,
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	169
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	170 /* Symbols */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	171 OpenParentheses,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	172 CloseParentheses,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	173 OpenBrace,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	174 CloseBrace,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	175 OpenBracket,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	176 CloseBracket,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	177 Seperator,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	178 Colon,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	179 Dot,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	180
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	181 /* Comparator operators */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	182 Eq, Ne,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	183 Lt, Gt,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	184 Le, Ge,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	185
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	186 Not,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	187
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	188
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	189 /* Keywords */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	190 Byte, Ubyte,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	191 Short, Ushort,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	192 Int, Uint,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	193 Long, Ulong,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	194
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	195 Char, Wchar, Dchar,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	196
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	197 Float, Double,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	198
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	199 Bool,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	200
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	201 Void,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	202
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	203 Struct, Function, Delegate, Class, This,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	204 Interface, Union, Typedef, Typeid,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	205 Typeof, Sizeof, Alias,
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	206
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	207 If, Else,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	208 While,
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	209 For,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	210 Switch, Case, Default, Break,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	211 Return, Cast,
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	212
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	213 Module, Import,
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	214
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	215 New, Null,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	216
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	217 /* Attributes */
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	218 Public, Private, Package, Export, Protected,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	219 Static,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	220 Final,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	221 Const,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	222 Abstract,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	223 Override,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	224 Deprecated,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	225 Auto,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	226 Extern,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	227
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	228 Align,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	229
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	230 Asm,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	231
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	232 In, Out, Body,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	233
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	234 Assert, Throw, Try, Catch, Finally,
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	235
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	236
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	237
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	238
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	239 }
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	240
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	241 /**
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	242 An associative array to supply a Tok to String function.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	243
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	244 Keep always this list updated when adding a new Tok.
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	245 */
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	246 public char[][Tok] typeToString;
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	247
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	248 static this()
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	249 {
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	250 typeToString =
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	251 [
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	252 Tok.EOF:"EOF"[],
207 e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	253 Tok.Identifier:"identifier",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	254 Tok.Byte:"byte",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	255 Tok.Short:"short",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	256 Tok.Int:"int",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	257 Tok.Long:"long",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	258 Tok.Char:"char",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	259 Tok.Wchar:"wchar",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	260 Tok.Dchar:"dchar",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	261 Tok.Bool:"bool",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	262 Tok.Void:"void",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	263 Tok.Function:"function",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	264 Tok.Eq:"==",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	265 Tok.Ne:"!=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	266 Tok.Lt:"<",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	267 Tok.Le:"<=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	268 Tok.Gt:">",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	269 Tok.Ge:">=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	270 Tok.OpenParentheses:"(",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	271 Tok.CloseParentheses:")",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	272 Tok.OpenBrace:"{",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	273 Tok.CloseBrace:"}",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	274 Tok.OpenBracket:"[",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	275 Tok.CloseBracket:"]",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	276 Tok.Dot:"-",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	277 Tok.Assign:"=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	278 Tok.Plus:"+",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	279 Tok.PlusAssign:"+=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	280 Tok.Minus:"-",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	281 Tok.MinusAssign:"-=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	282 Tok.Star:"*",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	283 Tok.StarAssign:"*=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	284 Tok.Slash:"/",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	285 Tok.SlashAssign:"/=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	286 Tok.Percent:"%",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	287 Tok.PercentAssign:"%=",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	288 Tok.LeftShift:"<<",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	289 Tok.RightShift:">>",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	290 Tok.UnsignedRightShift:">>>",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	291 Tok.Integer:"int",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	292 Tok.If:"if",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	293 Tok.While:"while",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	294 Tok.For:"for",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	295 Tok.Switch:"switch",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	296 Tok.Case:"case",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	297 Tok.Default:"default",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	298 Tok.Comma:",",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	299 Tok.Return:"return",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	300 Tok.Struct:"struct",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	301 Tok.Class:"class",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	302 Tok.This:"this",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	303 Tok.Colon:":",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	304 Tok.Seperator:";",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	305 Tok.And:"&",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	306 Tok.Cast:"cast",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	307 Tok.Module:"module",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	308 Tok.Import:"import",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	309 Tok.String:"String",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	310 Tok.Public:"public",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	311 Tok.Private:"private",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	312 Tok.Protected:"protected",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	313 Tok.Package:"package",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	314 Tok.Export:"export",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	315 Tok.Static:"static",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	316 Tok.Final:"finale",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	317 Tok.Public:"public",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	318 Tok.Const:"const",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	319 Tok.Abstract:"abstract",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	320 Tok.Override:"override",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	321 Tok.Deprecated:"deprecated",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	322 Tok.Auto:"auto",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	323 Tok.Extern:"extern",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	324 Tok.New:"new",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	325 Tok.Null:"null",
e0551773a005 Added the correct version. Anders Johnsen <skabet@gmail.com> parents: 206 diff changeset	326 Tok.Alias:"alias"
206 d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	327 ];
d3c148ca429b Major moving of files. all src now goes into src, all docs in docs. Anders Johnsen <skabet@gmail.com> parents: diff changeset	328 }

Mercurial > projects > dang

annotate src/lexer/Token.d @ 207:e0551773a005