LWTools: lwcc/token.h annotate

annotate lwcc/token.h @ 574:a0c9433dc0d4 default tip

Updated submission guidelines including notes about evangelism. TLDR: Don't.

author	William Astle <lost@l-w.ca>
date	Mon, 04 Mar 2024 10:10:38 -0700
parents	b08787e5b9f3
children

rev	line source
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	1 /*
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	2 lwcc/token.h
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	3
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	4 Copyright © 2013 William Astle
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	5
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	6 This file is part of LWTOOLS.
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	7
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	8 LWTOOLS is free software: you can redistribute it and/or modify it under the
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	9 terms of the GNU General Public License as published by the Free Software
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	10 Foundation, either version 3 of the License, or (at your option) any later
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	11 version.
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	12
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	13 This program is distributed in the hope that it will be useful, but WITHOUT
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	14 ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	15 FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	16 more details.
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	17
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	18 You should have received a copy of the GNU General Public License along with
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	19 this program. If not, see <http://www.gnu.org/licenses/>.
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	20 */
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	21
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	22 #ifndef token_h_seen___
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	23 #define token_h_seen___
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	24
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	25 #include <stdio.h>
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	26
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	27 enum
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	28 {
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	29 CPP_NOUNG = -3,
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	30 CPP_EOL = -2,
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	31 CPP_EOF = -1,
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	32 };
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	33
306 b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	34 #define TOK_NONE 0
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	35 #define TOK_EOF 1
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	36 #define TOK_EOL 2
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	37 #define TOK_WSPACE 3
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	38 #define TOK_IDENT 4
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	39 #define TOK_NUMBER 5
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	40 #define TOK_CHAR 6
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	41 #define TOK_ADD 8
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	42 #define TOK_SUB 9
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	43 #define TOK_OPAREN 10
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	44 #define TOK_CPAREN 11
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	45 #define TOK_NE 12
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	46 #define TOK_EQ 13
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	47 #define TOK_LE 14
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	48 #define TOK_LT 15
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	49 #define TOK_GE 16
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	50 #define TOK_GT 17
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	51 #define TOK_BAND 18
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	52 #define TOK_BOR 19
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	53 #define TOK_BNOT 20
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	54 #define TOK_MOD 21
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	55 #define TOK_COMMA 22
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	56 #define TOK_ELLIPSIS 23
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	57 #define TOK_QMARK 24
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	58 #define TOK_COLON 25
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	59 #define TOK_OBRACE 26
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	60 #define TOK_CBRACE 27
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	61 #define TOK_OSQUARE 28
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	62 #define TOK_CSQUARE 29
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	63 #define TOK_COM 30
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	64 #define TOK_EOS 31
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	65 #define TOK_HASH 32
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	66 #define TOK_DBLHASH 33
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	67 #define TOK_XOR 34
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	68 #define TOK_XORASS 35
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	69 #define TOK_STAR 36
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	70 #define TOK_MULASS 37
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	71 #define TOK_DIV 38
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	72 #define TOK_DIVASS 39
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	73 #define TOK_ASS 40
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	74 #define TOK_MODASS 41
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	75 #define TOK_SUBASS 42
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	76 #define TOK_DBLSUB 43
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	77 #define TOK_ADDASS 44
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	78 #define TOK_DBLADD 45
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	79 #define TOK_BWAND 46
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	80 #define TOK_BWANDASS 47
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	81 #define TOK_BWOR 48
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	82 #define TOK_BWORASS 49
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	83 #define TOK_LSH 50
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	84 #define TOK_LSHASS 51
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	85 #define TOK_RSH 52
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	86 #define TOK_RSHASS 53
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	87 #define TOK_DOT 54
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	88 #define TOK_CHR_LIT 55
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	89 #define TOK_STR_LIT 56
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	90 #define TOK_ARROW 57
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	91 #define TOK_ENDEXPAND 58
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	92 #define TOK_ERROR 59
b08787e5b9f3 Add include search paths and command line macro definitions William Astle <lost@l-w.ca> parents: 305 diff changeset	93 #define TOK_MAX 60
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	94
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	95 struct token
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	96 {
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	97 int ttype; // token type
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	98 char *strval; // the token value if relevant
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	99 struct token *prev; // previous token in a list
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	100 struct token *next; // next token in a list
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	101 struct token_list *list;// pointer to head of list descriptor this token is on
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	102 int lineno; // line number token came from
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	103 int column; // character column token came from
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	104 const char *fn; // file name token came from
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	105 };
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	106
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	107 struct token_list
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	108 {
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	109 struct token *head; // the head of the list
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	110 struct token *tail; // the tail of the list
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	111 };
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	112
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	113 extern void token_free(struct token *);
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	114 extern struct token token_create(int, char strval, int, int, const char *);
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	115 extern struct token token_dup(struct token );
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	116 /* add a token to the end of a list */
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	117 extern void token_list_append(struct token_list , struct token );
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	118 /* add a token to the start of a list */
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	119 extern void token_list_prepend(struct token_list , struct token );
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	120 /* remove individual token from whatever list it is on */
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	121 extern void token_list_remove(struct token *);
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	122 /* replace token with list of tokens specified */
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	123 extern void token_list_insert(struct token_list , struct token , struct token *);
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	124 /* duplicate a list to a new list pointer */
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	125 extern struct token_list token_list_dup(struct token_list );
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	126 /* print a token out */
299 856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	127 extern struct token_list *token_list_create(void);
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	128 extern void token_list_destroy(struct token_list *);
856caf91ffaa Added token list structure and switched some stuff to use it William Astle <lost@l-w.ca> parents: 296 diff changeset	129
295 4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	130 extern void token_print(struct token , FILE );
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	131
4b17780f2777 Checkpoint lwcc development William Astle <lost@l-w.ca> parents: diff changeset	132 #endif // token_h_seen___

Mercurial > hg > index.cgi

annotate lwcc/token.h @ 574:a0c9433dc0d4 default tip