Re: [Grammatica-users] multiline in token definition

[Steffen Gaede]

> Understand that an LL parser like Grammatica is context-free, i.e. the
> tokenization is separated from the grammar rules. You can run Grammatica
> in tokenize-only mode to show just the stream of tokens read.
> 
> The order of the token definitions is important, and has always been such:
> 
> 1. The longest matching token
> 2. The first defined token (if both have same length)
> 
> Hence, do like this:
> 
> - Keep tokens short (without whitespace).

ok, that's the hint:
> - Place string tokens above regex tokens.

If I first place the regex, then I become the errors. After changing
order, it works now.

I've build like your Example from arithmetic language, so it was not
clearly visible about this rule.


Best regards,
Steffen.