mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
28,294 Commits 1,487 Branches 166 Tags 416 MiB
55a4bea72a
Commit Graph

36 Commits

Author SHA1 Message Date
drh
32d184e049 Only register the fts3_tokenizer() function using a single text encoding. 
FossilOrigin-Name: 966964af1021feebc56cfda7b08bc787be7f447d682299f7958463aca30a73af
 2020-01-09 20:33:36 +00:00
drh
1e732787da Set the SQLITE_DIRECTONLY flag on the fts3_tokenizer() function of FTS3, 
thus preventing that function from being called from within a trigger or
view.

FossilOrigin-Name: f3171dc22e4d3a40ca17fe609391d92fc6a997b775bfefa5947aec69c889aa73
 2019-12-31 18:12:36 +00:00
drh
804725a6b9 Improvements to detection of corruption in the %_stat shadow table of FTS4. 
FossilOrigin-Name: 6b67eba54e7b4887a8cdab7537b12a95e9f17bcdaa0b423af5ed5bd91f69f2c6
 2019-11-18 14:04:21 +00:00
drh
3b574e4ea9 Use the 64-bit memory allocator interfaces in extensions, whenever possible. 
FossilOrigin-Name: 07ee06fd390bfebebc014b47583d489747b0423bb96c810bed5c605ce0e3be71
 2019-04-13 04:38:32 +00:00
drh
7678fdc33d Change the fts3_tokenizer() function to always return the pointer as a BLOB 
as long as the first argument is a bound parameter, regardless of the
SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER setting.

FossilOrigin-Name: 27160df7b3a04ac59d06013ede1d2ee27a4ace86a525ecc333bf7f8b5c580afb
 2019-03-29 17:26:44 +00:00
drh
5155b75be2 The two-argument version of fts3_tokenizer() works regardless of the 
value of SQLITE_DBCONFIG_ENABLE_FT3_TOKENIZER as long as the second
argument is a bind parameter.

FossilOrigin-Name: ab76e3a90e56bd36a17ded9c7a77e88632ca12d3bd73f197df747a634c81e0cf
 2019-03-29 11:39:41 +00:00
drh
f10c535fa5 The fts3_tokenizer() function returns NULL if the 
SQLITE_DBCONFIG_ENABLE_FTS_TOKENIZER setting is disabled, which is is
by default.

FossilOrigin-Name: f5732f4caf7a37a6445c61ae0d0ac14cc9deb897376e73aa36a1ead025b92c69
 2019-03-01 21:33:29 +00:00
mistachkin
52b1dbb5fc Allow the 'testfixture.exe' target to be compiled with the __stdcall calling convention. 
FossilOrigin-Name: e8be3dfeabaa31b3490793cf8230faae1204be15
 2016-07-28 14:37:04 +00:00
drh
d42908fb0e Provide the new SQLITE_DBCONFIG_ENABLE_FTS3_TOKENIZER option to 
sqlite3_db_config() that can be used to activate the two-argument version
of fts3_tokenizer() for a specific database connection at run-time.

FossilOrigin-Name: 374b5108087a2eae03676c0f3469b37a272145bf
 2016-02-26 15:38:24 +00:00
drh
83d7920e55 Fix a compiler warning when compiling without SQLITE_ENABLE_FTS3_TOKENIZER. 
FossilOrigin-Name: 6926f28cd56bf61f7c92877baa54024bee7cbab5
 2016-02-08 20:06:52 +00:00
dan
e064c4066c Disable the two-argument form of the fts3_tokenizer() SQL function unless the library is built with -DSQLITE_ENABLE_FTS3_TOKENIZER. 
FossilOrigin-Name: e0eb217aca7e4aadf9c44ed20822b78139f7c83c
 2016-02-08 19:40:17 +00:00
drh
abf582509d Use the sqlite3Fts3ErrMsg() function to set error message text in FTS3, 
and to ensure that error messages are not overwritten and thus leaked.

FossilOrigin-Name: 605347e087ec5eb817f3c94f4616abe26c7ab66b
 2015-05-01 14:07:30 +00:00
mistachkin
8e18922f12 Fix harmless compiler warnings seen with MSVC 2015. 
FossilOrigin-Name: d05becd873a03a366843a34e7f4c732dd8f88c86
 2015-04-19 21:43:16 +00:00
dan
e10d87f65a Avoid a segfault if NULL is passed as the first argument to SQL scalar function fts3_tokenizer(). 
FossilOrigin-Name: 6d0989695b486275824c14d5f88357267c1e8104
 2015-03-21 19:35:09 +00:00
dan
b7134d0863 Fix an FTS3/4 problem with handling empty tokenizer declarations (e.g. "CREATE VIRTUAL TABLE t(tokenize=);"). 
FossilOrigin-Name: 26d2def8a53094356008861636d66f9ae8f2448a
 2015-03-19 16:25:42 +00:00
mistachkin
48864df97d Many spelling fixes in comments. No changes to code. 
FossilOrigin-Name: 6f6e2d50941e444ebc83604daddcc034137a05b7
 2013-03-21 21:20:32 +00:00
dan
6c42aa4a0e Initialize variables used as outputs of custom tokenizer method calls in fts4. 
FossilOrigin-Name: 514505a84bcc677518d60a42896598f85ed78265
 2012-10-17 20:15:10 +00:00
dan
25cdf46ae4 Add the "tokenchars=" and "separators=" options, for customizing the set of characters considered to be token separators, to the unicode61 tokenizer. 
FossilOrigin-Name: e56fb462aa1f11bb23303ae0dc62815c21e26a52
 2012-06-07 15:53:48 +00:00
dan
996073b3ae Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater. 
FossilOrigin-Name: f8e9c445dd358c40e5a7bf3756b9f291909dbea7
 2012-03-03 18:46:41 +00:00
dan
0ea2517c4e Changes to allow FTS to be compiled as a loadable module again. 
FossilOrigin-Name: 29e69f389cb0078e125ba5814a68b3fe8cf634c6
 2011-06-28 07:15:43 +00:00
drh
051eb38a26 Fix various harmless compiler warnings in FTS3 and RTREE. 
FossilOrigin-Name: fe62179efdea40887e23a16f898060b879013824
 2011-06-20 17:24:29 +00:00
drh
6b96771b82 Changes to #ifdefs so that the build goes correctly if the only FTS macro 
defined is SQLITE_ENABLE_FTS4.

FossilOrigin-Name: a0b43a320e6491de7070966ed7c3ec55fd660a85
 2011-06-16 00:54:45 +00:00
drh
6ea28d6d84 Fix various compiler warnings. 
FossilOrigin-Name: c412f61229b6ab1ac90b932afd56f7c5e3ba1cfe
 2010-11-26 16:49:59 +00:00
dan
af4c214e1f Changes to allow FTS4 tables to be created without the underlying %_docsize table (in order to save space). 
FossilOrigin-Name: 31989b18f53d97eddfb39660ef04fbf9463583e0
 2010-11-02 17:41:52 +00:00
drh
c78db070a3 Remove all vestiges of ctype.h from FTS3. 
FossilOrigin-Name: b8b465ed2c56b23b50334680a2a940885b1ac530
 2010-08-06 19:00:12 +00:00
shaneh
ef4114dd24 Avoid declaring and freeing test variables if SQLITE_TEST not defined. 
FossilOrigin-Name: c2d22960f652264c48ec41b9ca4047aa142d86f7
 2009-12-10 21:11:28 +00:00
dan
84db21ec6a Add tests to improve coverage of fts3. Associated bugfixes. 
FossilOrigin-Name: f0eac4175aee6c50ee68acc253f76fbe44574250
 2009-12-08 19:05:53 +00:00
dan
7bf44fc018 Remove a redundant line from fts3. 
FossilOrigin-Name: cd50acf37fd1e3b388f98fb2df7ed03cff454b24
 2009-12-07 16:26:52 +00:00
shaneh
0d935576a4 Move some SQLITE_TEST code down to avoid mixing code and variable declarations. 
Fix a test for high-order bit handling in sqlite3Fts3InitTokenizer().

FossilOrigin-Name: fad43d290f9489726aaa2e999a17ea17ed78b27b
 2009-12-07 16:18:37 +00:00
shaneh
e585b8f05c Updates to FTS3 to correct compiler warnings under MSVC. 
FossilOrigin-Name: 37495b55ffbdc2db4482367ac7d8e32d4d71d58e
 2009-12-03 06:26:46 +00:00
drh
c12075b3b2 Change an error message in FTS3 to avoid using an uninitialized variable. 
FossilOrigin-Name: 620a8a2b38f5f2ad3db304b2bc88360285c174db
 2009-12-02 20:25:57 +00:00
dan
16708c4a0d Fix some fts3 related issues with the autoconf and amalgamation build systems. 
FossilOrigin-Name: 3b17924754343c0163464dabf01a9c46ffccef28
 2009-11-19 15:25:25 +00:00
dan
09977bb9f0 Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). 
FossilOrigin-Name: 30a92f1132801c7582007ee625c577ea2ac31cdf
 2009-11-13 10:36:20 +00:00
drh
dd95535f20 Minor fixes to FTS3 so that it works better when appended to the end 
of the amalgamation. (CVS 4769)

FossilOrigin-Name: 62ede6699d8f116921a5a0baddca5e7e63740cd3
 2008-02-01 15:34:09 +00:00
drh
8255feca02 The FTS3 amalgamation can now be appended to the SQLite amalgamation to 
generate a single source file that contains both components. (CVS 4558)

FossilOrigin-Name: 0fc61f99b54bd269fcc011f448b9b971e902cb01
 2007-11-24 00:41:52 +00:00
shess
acce22f5c7 Copy fts2 to fts3, renaming, and replacing references to fts2 with 
fts3, including capitalization variants. (CVS 4249)

FossilOrigin-Name: 216c91d2fc49792d9ff53596746f1162f5b7f8d4
 2007-08-20 17:37:02 +00:00