projects/ldc: dmd2/lexer.h annotate

annotate dmd2/lexer.h @ 1351:8d501abecd24

Initial (but disabled) fix for ticket #294 , the actual part that fixes the bug is in a #if 0 block as I'm afraid it will cause regressions. I'm most likely not going to be around tonight, and maybe not tomorrow as well, so I'm pushing it in case someone wants to run some serious testing/investigate the problem noted in llvmhelpers.cpp : realignOffset .

author	Tomas Lindquist Olsen <tomas.l.olsen gmail com>
date	Thu, 14 May 2009 17:20:17 +0200
parents	f04dde6e882c
children	638d16625da2

rev	line source
758 f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	1
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	2 // Compiler implementation of the D programming language
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	3 // Copyright (c) 1999-2008 by Digital Mars
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	4 // All Rights Reserved
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	5 // written by Walter Bright
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	6 // http://www.digitalmars.com
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	7 // License for redistribution is by either the Artistic License
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	8 // in artistic.txt, or the GNU General Public License in gnu.txt.
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	9 // See the included readme.txt for details.
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	10
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	11 #ifndef DMD_LEXER_H
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	12 #define DMD_LEXER_H
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	13
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	14 #ifdef __DMC__
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	15 #pragma once
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	16 #endif /* __DMC__ */
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	17
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	18 #include "root.h"
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	19 #include "mars.h"
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	20
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	21 struct StringTable;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	22 struct Identifier;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	23 struct Module;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	24
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	25 /* Tokens:
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	26 ( )
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	27 [ ]
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	28 { }
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	29 < > <= >= == != === !==
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	30 << >> <<= >>= >>> >>>=
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	31 + - += -=
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	32 * / % *= /= %=
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	33 & \| ^ &= \|= ^=
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	34 = ! ~
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	35 ++ --
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	36 . -> : ,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	37 ? && \|\|
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	38 */
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	39
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	40 enum TOK
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	41 {
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	42 TOKreserved,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	43
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	44 // Other
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	45 TOKlparen, TOKrparen,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	46 TOKlbracket, TOKrbracket,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	47 TOKlcurly, TOKrcurly,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	48 TOKcolon, TOKneg,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	49 TOKsemicolon, TOKdotdotdot,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	50 TOKeof, TOKcast,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	51 TOKnull, TOKassert,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	52 TOKtrue, TOKfalse,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	53 TOKarray, TOKcall,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	54 TOKaddress, TOKtypedot,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	55 TOKtype, TOKthrow,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	56 TOKnew, TOKdelete,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	57 TOKstar, TOKsymoff,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	58 TOKvar, TOKdotvar,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	59 TOKdotti, TOKdotexp,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	60 TOKdottype, TOKslice,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	61 TOKarraylength, TOKversion,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	62 TOKmodule, TOKdollar,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	63 TOKtemplate, TOKdottd,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	64 TOKdeclaration, TOKtypeof,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	65 TOKpragma, TOKdsymbol,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	66 TOKtypeid, TOKuadd,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	67 TOKremove,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	68 TOKnewanonclass, TOKcomment,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	69 TOKarrayliteral, TOKassocarrayliteral,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	70 TOKstructliteral,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	71
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	72 // Operators
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	73 TOKlt, TOKgt,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	74 TOKle, TOKge,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	75 TOKequal, TOKnotequal,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	76 TOKidentity, TOKnotidentity,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	77 TOKindex, TOKis,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	78 TOKtobool,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	79
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	80 // 60
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	81 // NCEG floating point compares
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	82 // !<>= <> <>= !> !>= !< !<= !<>
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	83 TOKunord,TOKlg,TOKleg,TOKule,TOKul,TOKuge,TOKug,TOKue,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	84
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	85 TOKshl, TOKshr,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	86 TOKshlass, TOKshrass,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	87 TOKushr, TOKushrass,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	88 TOKcat, TOKcatass, // ~ ~=
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	89 TOKadd, TOKmin, TOKaddass, TOKminass,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	90 TOKmul, TOKdiv, TOKmod,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	91 TOKmulass, TOKdivass, TOKmodass,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	92 TOKand, TOKor, TOKxor,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	93 TOKandass, TOKorass, TOKxorass,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	94 TOKassign, TOKnot, TOKtilde,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	95 TOKplusplus, TOKminusminus, TOKconstruct, TOKblit,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	96 TOKdot, TOKarrow, TOKcomma,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	97 TOKquestion, TOKandand, TOKoror,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	98
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	99 // 104
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	100 // Numeric literals
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	101 TOKint32v, TOKuns32v,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	102 TOKint64v, TOKuns64v,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	103 TOKfloat32v, TOKfloat64v, TOKfloat80v,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	104 TOKimaginary32v, TOKimaginary64v, TOKimaginary80v,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	105
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	106 // Char constants
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	107 TOKcharv, TOKwcharv, TOKdcharv,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	108
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	109 // Leaf operators
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	110 TOKidentifier, TOKstring,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	111 TOKthis, TOKsuper,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	112 TOKhalt, TOKtuple,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	113
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	114 // Basic types
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	115 TOKvoid,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	116 TOKint8, TOKuns8,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	117 TOKint16, TOKuns16,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	118 TOKint32, TOKuns32,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	119 TOKint64, TOKuns64,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	120 TOKfloat32, TOKfloat64, TOKfloat80,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	121 TOKimaginary32, TOKimaginary64, TOKimaginary80,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	122 TOKcomplex32, TOKcomplex64, TOKcomplex80,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	123 TOKchar, TOKwchar, TOKdchar, TOKbit, TOKbool,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	124 TOKcent, TOKucent,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	125
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	126 // Aggregates
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	127 TOKstruct, TOKclass, TOKinterface, TOKunion, TOKenum, TOKimport,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	128 TOKtypedef, TOKalias, TOKoverride, TOKdelegate, TOKfunction,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	129 TOKmixin,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	130
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	131 TOKalign, TOKextern, TOKprivate, TOKprotected, TOKpublic, TOKexport,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	132 TOKstatic, /TOKvirtual,/ TOKfinal, TOKconst, TOKabstract, TOKvolatile,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	133 TOKdebug, TOKdeprecated, TOKin, TOKout, TOKinout, TOKlazy,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	134 TOKauto, TOKpackage, TOKmanifest, TOKimmutable,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	135
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	136 // Statements
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	137 TOKif, TOKelse, TOKwhile, TOKfor, TOKdo, TOKswitch,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	138 TOKcase, TOKdefault, TOKbreak, TOKcontinue, TOKwith,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	139 TOKsynchronized, TOKreturn, TOKgoto, TOKtry, TOKcatch, TOKfinally,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	140 TOKasm, TOKforeach, TOKforeach_reverse,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	141 TOKscope,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	142 TOKon_scope_exit, TOKon_scope_failure, TOKon_scope_success,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	143
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	144 // Contracts
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	145 TOKbody, TOKinvariant,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	146
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	147 // Testing
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	148 TOKunittest,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	149
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	150 // Added after 1.0
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	151 TOKref,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	152 TOKmacro,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	153 #if DMDV2
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	154 TOKtraits,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	155 TOKoverloadset,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	156 TOKpure,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	157 TOKnothrow,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	158 TOKtls,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	159 TOKline,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	160 TOKfile,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	161 TOKshared,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	162 #endif
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	163
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	164 // LDC specific
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	165 #if IN_LLVM
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	166 TOKgep,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	167 #endif
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	168
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	169 TOKMAX
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	170 };
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	171
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	172 #define CASE_BASIC_TYPES \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	173 case TOKwchar: case TOKdchar: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	174 case TOKbit: case TOKbool: case TOKchar: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	175 case TOKint8: case TOKuns8: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	176 case TOKint16: case TOKuns16: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	177 case TOKint32: case TOKuns32: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	178 case TOKint64: case TOKuns64: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	179 case TOKfloat32: case TOKfloat64: case TOKfloat80: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	180 case TOKimaginary32: case TOKimaginary64: case TOKimaginary80: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	181 case TOKcomplex32: case TOKcomplex64: case TOKcomplex80: \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	182 case TOKvoid
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	183
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	184 #define CASE_BASIC_TYPES_X(t) \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	185 case TOKvoid: t = Type::tvoid; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	186 case TOKint8: t = Type::tint8; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	187 case TOKuns8: t = Type::tuns8; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	188 case TOKint16: t = Type::tint16; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	189 case TOKuns16: t = Type::tuns16; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	190 case TOKint32: t = Type::tint32; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	191 case TOKuns32: t = Type::tuns32; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	192 case TOKint64: t = Type::tint64; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	193 case TOKuns64: t = Type::tuns64; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	194 case TOKfloat32: t = Type::tfloat32; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	195 case TOKfloat64: t = Type::tfloat64; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	196 case TOKfloat80: t = Type::tfloat80; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	197 case TOKimaginary32: t = Type::timaginary32; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	198 case TOKimaginary64: t = Type::timaginary64; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	199 case TOKimaginary80: t = Type::timaginary80; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	200 case TOKcomplex32: t = Type::tcomplex32; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	201 case TOKcomplex64: t = Type::tcomplex64; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	202 case TOKcomplex80: t = Type::tcomplex80; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	203 case TOKbit: t = Type::tbit; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	204 case TOKbool: t = Type::tbool; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	205 case TOKchar: t = Type::tchar; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	206 case TOKwchar: t = Type::twchar; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	207 case TOKdchar: t = Type::tdchar; goto LabelX; \
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	208 LabelX
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	209
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	210 struct Token
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	211 {
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	212 Token *next;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	213 unsigned char *ptr; // pointer to first character of this token within buffer
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	214 enum TOK value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	215 unsigned char *blockComment; // doc comment string prior to this token
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	216 unsigned char *lineComment; // doc comment for previous token
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	217 union
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	218 {
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	219 // Integers
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	220 d_int32 int32value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	221 d_uns32 uns32value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	222 d_int64 int64value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	223 d_uns64 uns64value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	224
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	225 // Floats
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	226 #ifdef IN_GCC
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	227 // real_t float80value; // can't use this in a union!
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	228 #else
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	229 d_float80 float80value;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	230 #endif
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	231
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	232 struct
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	233 { unsigned char *ustring; // UTF8 string
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	234 unsigned len;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	235 unsigned char postfix; // 'c', 'w', 'd'
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	236 };
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	237
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	238 Identifier *ident;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	239 };
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	240 #ifdef IN_GCC
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	241 real_t float80value; // can't use this in a union!
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	242 #endif
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	243
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	244 static const char *tochars[TOKMAX];
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	245 static void *operator new(size_t sz);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	246
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	247 int isKeyword();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	248 void print();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	249 const char *toChars();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	250 static const char *toChars(enum TOK);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	251 };
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	252
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	253 struct Lexer
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	254 {
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	255 static StringTable stringtable;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	256 static OutBuffer stringbuffer;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	257 static Token *freelist;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	258
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	259 Loc loc; // for error messages
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	260
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	261 unsigned char *base; // pointer to start of buffer
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	262 unsigned char *end; // past end of buffer
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	263 unsigned char *p; // current character
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	264 Token token;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	265 Module *mod;
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	266 int doDocComment; // collect doc comment information
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	267 int anyToken; // !=0 means seen at least one token
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	268 int commentToken; // !=0 means comments are TOKcomment's
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	269
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	270 Lexer(Module *mod,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	271 unsigned char *base, unsigned begoffset, unsigned endoffset,
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	272 int doDocComment, int commentToken);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	273
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	274 static void initKeywords();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	275 static Identifier idPool(const char s);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	276 static Identifier uniqueId(const char s);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	277 static Identifier uniqueId(const char s, int num);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	278
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	279 TOK nextToken();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	280 TOK peekNext();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	281 void scan(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	282 Token peek(Token t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	283 Token peekPastParen(Token t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	284 unsigned escapeSequence();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	285 TOK wysiwygStringConstant(Token *t, int tc);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	286 TOK hexStringConstant(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	287 #if DMDV2
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	288 TOK delimitedStringConstant(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	289 TOK tokenStringConstant(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	290 #endif
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	291 TOK escapeStringConstant(Token *t, int wide);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	292 TOK charConstant(Token *t, int wide);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	293 void stringPostfix(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	294 unsigned wchar(unsigned u);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	295 TOK number(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	296 TOK inreal(Token *t);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	297 void error(const char *format, ...);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	298 void error(Loc loc, const char *format, ...);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	299 void pragma();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	300 unsigned decodeUTF();
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	301 void getDocComment(Token *t, unsigned lineComment);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	302
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	303 static int isValidIdentifier(char *p);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	304 static unsigned char combineComments(unsigned char c1, unsigned char *c2);
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	305 };
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	306
f04dde6e882c Added initial D2 support, D2 frontend and changes to codegen to make things compile. Tomas Lindquist Olsen <tomas.l.olsen@gmail.com> parents: diff changeset	307 #endif /* DMD_LEXER_H */

Mercurial > projects > ldc

annotate dmd2/lexer.h @ 1351:8d501abecd24