BiBTeXTokenizer (open)
Tokenizer for BibTeX
Syntax
LOADLIB "wh::filetypes/bibtex.whlib";
OBJECTTYPE BiBTeXTokenizer
Constructor
- MACRO NEW(STRING value, BOOLEAN verbose, BOOLEAN reportnonalpha, BOOLEAN reproduce)
Create a new BiBTeX tokenizer
Variables
- INTEGER blockdepth
Current block depth
- INTEGER line
Current line number
- INTEGER linestart
Position of the start of the current line within the parsed document
- MONEY numbervalue
Number value (currently always 0)
- INTEGER startpos
Position within the parsed document
- STRING token
Current token
- STRING type
Type of the token
- STRING value
Associated value (eg comment string for a comment)
Functions
- MACRO ConsumeToken()
Parse the next token
- RECORD FUNCTION GetToken()
Returns the current token