netsurf/utils
John Mark Bell 23fb72ea6b The core code has always assumed a locale of "C".
Do not change the locale globally, else things will break in weird and 
wonderful ways.

Introduce utils/locale.[ch], which provide locale-specific wrappers for various 
functions (currently just the <ctype.h> ones).

Fix up the few places I can see that actually require that the underlying 
locale is paid attention to.

Some notes:

  1) The GTK frontend code has not been touched. It is possible that reading of 
     numeric values (e.g. from the preferences dialogue) may break with this 
     change, particularly in locales that use something other than '.' as their
     decimal separator.
  2) The search code is left unchanged (i.e. assuming a locale of "C"). 
     This may break case insensitive matching of non-ASCII characters. 
     I doubt that ever actually worked, anyway. In future, it should use
     Unicode case conversion to achieve the same effect.
  3) The text input handling in the core makes use of isspace() to detect
     word boundaries. This is fine for western languages (even in the C locale,
     which it's currently assuming). It will, however, break for CJK et. al. 
     (this has always been the case, rather than being a new issue)
  4) text-transform uses locale-specific variants of to{lower,upper}. In future
     this should probably be performing Unicode case conversion. This is the
     only part of the core code that makes use of locale information.

In future, if you require locale-specific behaviour, do the following:

  setlocale(LC_<whatever>, "");
  <your operation(s) here>
  setlocale(LC_<whatever>, "C");

  The first setlocale will change the current locale to the native environment.
  The second setlocale will reset the current locale to "C".
  Any value other than "" or "C" is probably a bug, unless there's a really
  good reason for it.

In the long term, it is expected that all locale-dependent code will reside in 
platform frontends -- the core being wholly locale agnostic (though assuming 
"C" for things like decimal separators).


svn path=/trunk/netsurf/; revision=4153
2008-05-13 14:37:44 +00:00
..
.cvsignore [project @ 2004-05-20 20:55:36 by matthewh] 2004-05-20 20:55:36 +00:00
base64.c Initial attempt at implementing data: URLs. Needs cleaning and verifying that I'm using the fetcher API correctly. Appears to work, though. 2008-03-05 14:21:29 +00:00
base64.h Initial attempt at implementing data: URLs. Needs cleaning and verifying that I'm using the fetcher API correctly. Appears to work, though. 2008-03-05 14:21:29 +00:00
config.h Remove text export build config option. Tidy up save_text code. 2008-04-13 21:58:43 +00:00
container.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
container.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
filename.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
filename.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
hashtable.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
hashtable.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
locale.c The core code has always assumed a locale of "C". 2008-05-13 14:37:44 +00:00
locale.h The core code has always assumed a locale of "C". 2008-05-13 14:37:44 +00:00
log.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
memanalyze.pl [project @ 2004-07-28 22:35:02 by bursa] 2004-07-28 22:35:02 +00:00
memdebug.c [project @ 2004-07-28 22:35:02 by bursa] 2004-07-28 22:35:02 +00:00
memdebug.h [project @ 2004-07-28 22:35:02 by bursa] 2004-07-28 22:35:02 +00:00
messages.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
messages.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
ring.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
talloc.c [project @ 2005-04-03 10:56:49 by bursa] 2005-04-03 10:56:49 +00:00
talloc.h Make GTK build compile on FreeBSD. 2007-01-29 22:27:15 +00:00
themes.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
themes.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
transtab [project @ 2003-12-29 20:16:37 by tlsa] 2003-12-29 20:16:37 +00:00
tt2code Remove the netsurf/ from the include paths and rationalise use of <> vs "" in includes 2007-05-30 22:39:54 +00:00
url.c - riscos/gui.c(path_to_url): escape the characters which need to be escaped when converting the host path to file: URL. 2008-04-02 00:43:51 +00:00
url.h - riscos/gui.c(path_to_url): escape the characters which need to be escaped when converting the host path to file: URL. 2008-04-02 00:43:51 +00:00
useragent.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
useragent.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
utf8.c Avoid magic numbers. 2008-03-09 16:34:57 +00:00
utf8.h Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
utils.c Update all source code file headers to reflect GPL version 2 only and contain appropriate licence text 2007-08-08 16:16:03 +00:00
utils.h Add -D_NETBSD_SOURCE to Makefile.unix for building on NetBSD. Also don't provide prototype for strcasestr under NetBSD. Fixes segfaults. 2008-03-12 21:16:15 +00:00
warning-blame.sh Update to use new build system. 2008-03-19 17:26:22 +00:00