bug#10494: 24.0.92; Syntax table and non-ASCII character interaction

[Aaron Ecay]

This bug report will be sent to the Bug-GNU-Emacs mailing list
and the GNU bug tracker at debbugs.gnu.org.  Please check that
the From: line contains a valid email address.  After a delay of up
to one day, you should receive an acknowledgement at that address.

Please write in English if possible, as the Emacs maintainers
usually do not have translators for other languages.

Please describe exactly what actions triggered the bug, and
the precise symptoms of the bug.  If you can, give a recipe
starting from `emacs -Q':

This bug relates to setting a non-ASCII character punctuation character
(U+2019, which is ’) to have word syntax, and using word-motion
commands.  Here’s a recipe from emacs -Q:

M-x text-mode
don't
C-a M-f
  -> (as expected, the cursor moves to the end of the line)
RET RET
don M-x ucs-insert 2019 t
  -> (text in buffer: "don’t")
C-a M-f
  -> (cursor is on the quotation mark, as expected)
M-: (modify-syntax-entry ?’ "w" text-mode-syntax-table)
C-a M-f
  -> (BUG: cursor is on quotation mark, which should count as part of the word)

If you re-run the experiment substituting - for ’ everywhere, there is a
difference in behavior – the cursor moves to the end of the line after
the call to modify-syntax-entry, as expected.  This leads me to think
that the problem has to do with ’ being outside the ASCII charset.

This is with a recent-ish bzr trunk build, btw.  The most recent commit
is:
revno: 106824 [merge]
committer: Chong Yidong <cyd@gnu.org>
branch nick: trunk
timestamp: Mon 2012-01-09 13:48:13 +0800
message:
  Merge changes from emacs-23 branch

If Emacs crashed, and you have the Emacs process in the gdb debugger,
please include the output from the following gdb commands:
    `bt full' and `xbacktrace'.
For information about debugging Emacs, please read the file
/Users/aecay/Applications/Emacs.app/Contents/Resources/etc/DEBUG.


In GNU Emacs 24.0.92.1 (i386-apple-darwin10.8.0, NS apple-appkit-1038.36)
 of 2012-01-09 on awe
Windowing system distributor `Apple', version 10.3.1038
configured using `configure  '--with-ns' '--without-gnutls''

-- 
Aaron Ecay