Re: [savannah-help-public] [sr #109423] Non-BMP characters truncate comments

[Ineiev]

On Tue, Dec 12, 2017 at 11:05:30AM -0700, Bob Proulx wrote:
> Ineiev wrote:
> > Bob Proulx wrote:
> > > Can we scan the data before storing it
> > > and detect when we will have the problem and then encode it then?
> > 
> > Probably we could. I think some UTF-8 parsing would be needed, it's
> > somewhat harder than to encode unconditionally.
> 
> If we encode unconditionally does that mean that previous entries
> already stored would need to be encoded?

My idea was: new entries are prefixed with a magic string no old entries
begin with; when extracting, Savane checks if the string begins with
the prefix and decodes it when it does.

signature.asc
Description: Digital signature