Re: bison for nlp

[r0ller]

Hi Hans,

Sorry, I don't really get it:( What do you mean by replacing tokens by strings? 
How can that be done?

Best regards,
r0ller

-------- Eredeti levél --------
Feladó: Hans Åberg < address@hidden (Link -> mailto:address@hidden) >
Dátum: 2018 november 8 14:28:03
Tárgy: Re: bison for nlp
Címzett: r0ller < address@hidden (Link -> mailto:address@hidden) >
 
> On 7 Nov 2018, at 10:09, r0ller <address@hidden> wrote:
>
> Numbering tokens was introduced in the very beginning and has been questioned 
> by myself quite a many times if it's still needed. I didn't give a hard try 
> to get rid of it mainly due to one reason: I want to have an error handling 
> that tells in case of an error which symbols could be accepted instead of the 
> erroneous one just as bison itself does it but in a structured way (as bison 
> returns that info in an error message string). Though, I could not come up 
> with any better idea when it comes to remapping a token to a symbol.

If the token numbers are replaced by strings "…", the Bison parser will print 
those, and they can also be used in the grammar. Would that suffice?