[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Eliminate MARKUP_IDENTIFIER and MARKUPLIST_IDENTIFIER (issue 6561053
From: |
Janek Warchoł |
Subject: |
Re: Eliminate MARKUP_IDENTIFIER and MARKUPLIST_IDENTIFIER (issue 6561053) |
Date: |
Sat, 29 Sep 2012 17:56:57 +0200 |
On Sat, Sep 29, 2012 at 4:30 PM, <address@hidden> wrote:
> Actually, it is not really "simplifying" the grammar. At the current
> point of time, the lexer has to make decisions about the type of
> identifiers (and functions) at a point of time where those decisions are
> actually premature. As a result of those decisions, different tokens
> are generated for identifiers and functions. I am moving towards
> generating only one kind of token. The same kind of decisions as before
> still have to be made, and since the lexer no longer makes them, the
> decisions are instead taken in the actions of the parser. The results
> of those decisions are only apparent in the parser rules when those
> decisions lead to "synthetic" tokens (similar to the previous "real"
> ones) being generated in the parser actions.
ok. That's what i meant when i said "have things happen on higher
level" (i expect that it's not a technically correct statement, of
course :) )
thanks for explanations!
Janek