Aren
/
NetBSD
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
156,235 Commits 606 Branches 0 Tags 3.1 GiB
Commit Graph

137 Commits

Author SHA1 Message Date
tnozaki be0ee7c9f3 citrus_csmapper.c: find_best_pivot_pvdb() 
- don't break loop until all the src/dst combinations are tested.
charset.pivot.CP.src
	- redo rev 1.3.
 2007-02-17 12:39:44 +00:00
tnozaki c61eef3da4 make del(\x7f) pass through. 2006-12-13 16:16:56 +00:00
tnozaki 3fb79e8260 don't read input string more than MB_LEN_MAX(maybe redundant escape sequence). 2006-11-24 17:27:52 +00:00
tnozaki 663e0dad61 don't throw EILSEQ when byte sequence is "zW ". 2006-11-24 16:52:20 +00:00
tnozaki 068d17c461 c99 istyle initializer, pointed by uebayasi-san. thanks a lot! 2006-11-23 13:59:03 +00:00
tnozaki c8ab6b2b31 add missing rcsid. 2006-11-22 23:47:21 +00:00
tnozaki 45e156694b oops, forgot to remove unused enum. 2006-11-22 23:44:17 +00:00
tnozaki 8033a5b008 1. add iconv support for following encodings: 
Chinese Simplefied
        HZ, HZ8 - 7/8bit stateful encoding, see RFC1842,1843. (libHZ)
        zW      - 7bit stateful encoding, see RFC1842. (libZW)
2. add citrus_prop.[ch] - parser for encoding module's init parameter strings.
 2006-11-22 23:38:25 +00:00
tnozaki 5bda830543 fix memory leak. 2006-11-22 20:11:03 +00:00
dogcow cfe7a78c9c change uint32_t to size_t; fixes build issue on 64-bit platforms. 2006-11-14 02:55:34 +00:00
tnozaki 74fca02cf1 avoid infinity loop, iso2022 module's stdenc_get_state_desc_generic() 
never return _STDENC_SDGEN_INITIAL.
 2006-11-13 19:08:19 +00:00
tnozaki 79a70a823d 1. add iconv support for followint encoding: 
Vietnamese
	TCVN	8bit Viet Nam National Standard
	VISCII	8bit RFC1456
	VIQR	7bit RFC1456(libVIQR)
    Unicode Escape (GNU libiconv compatibility)
	C99, JAVA (libUES)
2. fix iconv_std module:
	add special treatment for POSIX Defect Report #288 case.
 2006-11-13 15:16:28 +00:00
tnozaki 1a00f7afa4 don't pass through surrogate character(0xD800 - 0xDFFF). 2006-10-27 14:13:55 +00:00
tnozaki 2e2fc44e22 add new iconv module libJOHAB, 
this supports S.Korean character encoding scheme ``JOHAB''.
 2006-10-18 17:54:54 +00:00
tnozaki 8316f5b826 correct typo in _DIAGASSERT() and some KNF. 
pointed by uebayashi-san, thanks!
 2006-09-11 13:06:33 +00:00
tnozaki 48d386f61a mapper_std iconv module and mkcsmapper(1) now can treat 
plain-row-col charset and 4byte code(like GB18030) as SRC_ZONE.
 2006-09-09 14:35:17 +00:00
tnozaki f264ea3a01 cleanup code 2006-08-23 12:57:24 +00:00
tnozaki 4e2e31b9fe merge recent DragonFlyBSD's change, original commit message is: 
Remove all occurences of double semicolons at the end if a line by single ones.
Submitted-by: Bill Marquette <bill DOT marquette AT gmail DOT com>
 2006-08-21 20:30:52 +00:00
tnozaki 2bcfe3b4c8 added Chinese Tradisional Big5 family, 
Big5-2003, Big5-ETen, Big5-IBM, Big-5E, Big-5+.

``Big5 is now the alias of Big5-ETen,
if you want Unicode.org's obsolete mappings, use Big5-IBM instead.
 2006-06-19 17:28:24 +00:00
tnozaki b29e60b31d if INIT0 specified, use it instead of ASCII. 2006-06-07 16:28:34 +00:00
mrg 084c052803 quell GCC 4.1 uninitialised variable warnings. 
XXX: we should audit the tree for which old ones are no longer needed
after getting the older compilers out of the tree..
 2006-05-10 21:53:14 +00:00
christos 7dc4aac2d8 Fix memory leak. 2006-03-27 01:09:11 +00:00
christos c8780d3168 Coverity CID 1440: off by one in array count. 2006-03-22 00:08:09 +00:00
christos 15cc8e46f6 Coverity CID 1439: Prevent array index out of bounds access. 2006-03-19 01:55:48 +00:00
christos 95f6be8b1a Coverity CID 2461: Bail out quickly instead of accessing uninitialized variables 2006-03-19 01:25:44 +00:00
christos 68259ab10a Coverity 2462: Bail out quickly instead of accessing uninitialized variables. 2006-03-19 01:24:09 +00:00
christos f2194f03cc Coverity CID 2463: Bail out instead of accessing uninitialized variables. 2006-03-19 01:21:28 +00:00
christos 5bd7f658fe Coverity CID 2464: Don't use uninitialized variables; exit with error quickly. 2006-03-19 01:19:32 +00:00
christos adcc2139d9 Coveriry CID 2472: If the number of bits is invalid, return immediately 
instead of accessing uninitialized variables.
 2006-03-19 01:17:30 +00:00
christos f174420e75 Coverity CID 2473: Fix uninitialized variable reference. 2006-03-19 01:15:06 +00:00
tnozaki 1b24b76f6b MB_CUR_MAX should be 2 when MODE_2BYTE flag set. 2006-02-15 19:50:27 +00:00
dogcow 86811edb37 change #include <sys/endian.h> => #include <machine/endian.h> so that 
it's (more) consistent in the tree; this, along with changing tools/compat's
autoconf detection from AC_CHECK_FUNCS to AC_CHECK_DECLS makes the vast
majority of htobe16 and friends' redefinition errors bite the dust.
Tested with -current and FreeBSD.
 2006-02-09 22:03:15 +00:00
tshiozak bb345c8a27 add missing _citrus_MSKanji_stdenc_get_state_desc_generic() function. 
pointed out by Patrick Welche <prlw1 _at_ newn _dot_ cam _dot_ ac _dot_ uk>
 2005-12-07 06:20:20 +00:00
yamt 307c0260b8 remove unnecessary __UNCONST. 2005-12-02 11:14:20 +00:00
christos 03256c6e55 WARNS=4 2005-11-29 03:11:58 +00:00
martin c66ae167ce Initialize error return value. 2005-10-29 19:19:38 +00:00
tshiozak 1beef8fe93 fix lib/31874. 
- add _citrus_stdenc_get_state_desc() interface to get
  encoding-scheme-independent encoder/decoder state descriptions.
- make sure that iconv_std module uses it to judge whether the last
  sequences forms complete shift sequences.
- bump minor of i18n_module because of get_state_desc().
 2005-10-29 18:02:04 +00:00
tshiozak c8a7d58fe9 make sure that this module can handle all private/vendor-defined 
character area.
This is reported by MORIYAMA Masayuki <msyk _at_ mtg.biglobe.ne.jp> and
"NARUSE, Yui" <naruse _at_ airemix.com>, and fixed by MORIYAMA-san.
 2005-10-18 06:44:28 +00:00
tshiozak eda4f3c630 fix a problem on wc->mb conversion for G2 plane. 
This is reported by MORIYAMA Masayuki <msyk _at_ mtg.biglobe.ne.jp> and
"NARUSE, Yui" <naruse _at_ airemix.com>, and fixed by MORIYAMA-san.
 2005-10-18 06:42:12 +00:00
tshiozak a023aa0fb7 * add some comments. 
* add some functions:
   _citrus_memory_stream_bind_ptr()
   _citrus_memory_stream_tell()
   _citrus_memory_stream_ungetc()
   _citrus_region_get_subregion()
* fix a bug in _citrus_memory_stream_seek().
 2005-05-14 17:55:42 +00:00
tnozaki a3b248100e add csmapper:CNS11643-1,2 and esdb:ISO-2022-CN, 
integrate esdb:EUC-TW, locale:zh_TW.eucTW.
 2005-03-27 22:30:05 +00:00
christos bc0c808b3b Don't sign extend characters when they get converted to wide characters in 
mbtowc. Otherwise you are not going to be able to wctomb them. Added
regression test. From kim, many thanks.
 2005-03-27 18:51:19 +00:00
tnozaki 6e2609d649 anonymous union between chlen and _UTF7StatePrive has 
compilation problem with gcc295.
this union attempt to make mbsinit(3) handle multibyte state correctly,
but it's useless as far as we use utf-7 only iconv interface.
so i eliminate ctype feature.

patch contributed by Joerg Sonnenberg(who porting Citrus to DragonFlyBSD).
and yamt-san gave me advice, thanks a lot.
 2005-03-14 03:43:10 +00:00
christos 068081ef36 Fix another _DIAGASSERT issue (Joerg Sonnenberger) 2005-03-12 04:20:30 +00:00
christos 61e7a23268 UTF8EncodingInfo is an empty struct; remove noop code and DIAGASSERT. 
From Joerg Sonnenberger
 2005-03-11 23:32:03 +00:00
tnozaki fe05f588fb add new citrus iconv module UTF-7. 
thanks advice, yamt-san.
 2005-03-05 18:05:14 +00:00
tnozaki 97264db5f1 correct uninitialized value `err'. 2005-03-05 17:31:03 +00:00
simonb 3cebd9325e White space nit- don't put a space before/after increment/decrement 
operators.
 2005-02-11 06:21:21 +00:00
tnozaki 476f0d92a1 fix typo in _DIAGASSERT 2005-02-10 19:03:51 +00:00
mycroft ffcb3c5a45 Use FD_CLOEXEC. 2005-01-19 00:52:37 +00:00