Lines Matching refs:tokens
219 characters form lexical tokens.
319 PGN character data is organized as tokens. A token is a contiguous sequence of
321 adjacent tokens by white space characters. (White space characters include
322 space, newline, and tab characters.) Some tokens are self delimiting and do
337 Integer tokens are used to help represent move number indications (see below).
349 The left and right bracket characters ("[" and "]") are tokens. They are used
352 The left and right parenthesis characters ("(" and ")") are tokens. They are
356 The left and right angle bracket characters ("<" and ">") are tokens. They are
393 A tag pair is composed of four consecutive tokens: a left bracket token, a
405 any adjacent pair of tokens in a tag pair.
636 In PGN import format, tokens in the movetext do not require any specific line
639 In PGN export format, tokens in the movetext are placed left justified on
641 many tokens as possible are placed on a line with the remainder appearing on
643 symbol tokens on the same line in the movetext. As with the tag pair section,