Re: RFC: enum instead of #define for tokens

[Hans Aberg]

At 09:59 +0200 2002/04/08, Akim Demaille wrote:
>>>>>> "John" == John W Millaway <address@hidden> writes:
>
>>> I think that Akim would like to prohibit . { return yytext[0]; } at
>>> least for Unicode.
>
>John> Prohibiting that will break a lot of scanners out there,
>John> including the code in the O'Reilly book.
...
>I'm against on having Bison parsers eating Unicode.  People can do
>whatever they want to with their scanners.

If . { return yytext[0]; } should be usable under Unicode, one should at
least ensure that (sporadic) characters cannot have token numbers.

  Hans Aberg