mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,536 Commits 1,487 Branches 166 Tags 416 MiB
6ae2454a67
Commit Graph

229 Commits

Author SHA1 Message Date
dan
42b2653871 Fix a buffer overread in fts5. 
FossilOrigin-Name: 0e3de8abbb0c7ae64e637776cb055ce79736f99a103e00e44d17a6b091b98c81
 2018-07-25 15:25:55 +00:00
dan
b80bb6ce88 Add the "categories" option to the unicode61 tokenizer in fts5. 
FossilOrigin-Name: 80d2b9e635e3100f90cffdcffa5b5038da6fbbfccc9f5777c59a4ae760d4cb62
 2018-07-13 19:52:43 +00:00
dan
cb38809159 Add a test case to check that the fts5 unicode64 tokenizer is dealing with 
codepoints greater than 65535 correctly.

FossilOrigin-Name: 9f7a6ae878cd17ff4de7c55e654406773e0ea2b9fe1c4e2a9fc2b0da84d059a4
 2018-05-09 16:32:00 +00:00
drh
cdf88760da More test case updates. Tests are all running now. 
FossilOrigin-Name: dab5e5294813891469660cceb211ac1a1e526715bb57dcdbb1ab90321e6a4dad
 2018-05-02 19:42:33 +00:00
drh
b3f0276b9e Fix test cases so that they work with the new EXPLAIN QUERY PLAN output 
format.  Only some of the cases have been fixed.  This is an incremental
check-in.

FossilOrigin-Name: 5f0e803e33aa557865d5fc830d9202d628de9a94c9757058ca48f1a560702cd3
 2018-05-02 18:00:17 +00:00
dan
67ecf1f5c2 Fix the fts5 xBestIndex method so that it is not confused by "IS", "!=", 
"REGEXP", "GLOB" or "LIKE" operators.

FossilOrigin-Name: a0ca4ddbbf179b8f0a5f30c127f2f8c92b6d45a08be3e1ef2194e44ebcc28120
 2018-04-09 14:26:44 +00:00
dan
eab0e10304 In extensions rtree, fts3 and fts5, ensure that when dynamic buffers are bound 
to persistent SQL statements using SQLITE_STATIC, the binding is replaced with
an SQL NULL before the buffer is freed. Otherwise, a user may obtain a pointer
to the persistent statement using sqlite3_next_stmt() and attempt to access
the freed buffer using sqlite3_expanded_sql() or similar.

FossilOrigin-Name: 2a5f813bc61f9e780f2ccbda425611f65ad523b6d486a1e5e2b9d5e9f1d260a2
 2018-02-07 18:02:50 +00:00
dan
30fe26c47f Update test file fts5fault6.test to account for test tokenizers implemented in 
Tcl returning SQLITE_ERROR instead of SQLITE_NOMEM following an OOM error.

FossilOrigin-Name: c232f6424a858ede44940a927fe4e26ee99c6ab614aa6f63e13ba46e88dbb280
 2018-01-17 12:57:07 +00:00
dan
4bd387495f Fix a test problem causing an error in fts5fault9.test. 
FossilOrigin-Name: 8e2048113fc6ed87fc7d5ba470261926aa0bd35474744bb2b99ea596bc468f02
 2018-01-16 20:44:00 +00:00
dan
c8f44d245c Fix crashes that could occur if SQL NULL values were passed to the built-in 
FTS5 snippet function. Edit: breaks amalgamation builds.

FossilOrigin-Name: 6a790b67a0a5c698526db16ea262b13ecdd1b6ca74e80bdccfcad88ddbdc933a
 2017-12-26 14:32:25 +00:00
dan
2e6ca188c4 Fix a buffer overwrite in fts5 that could occur when processing a prefix 
query.

FossilOrigin-Name: 92fc146bc2b781e7e2d7138b00e5ea649c6fee1c2b8449420460a1b3e5c9661b
 2017-12-11 17:20:37 +00:00
dan
d37ce8396a Add the "^" syntax from fts3/4 to fts5. 
FossilOrigin-Name: 24d7058e2799133dd681d2fef341025ca50554861bb4cd39e93ee87ae1d8a605
 2017-11-24 19:24:44 +00:00
dan
865c3c58ab Add test cases for ticket [be436a7f4587ce517] using virtual table modules fts5 
and rtree.

FossilOrigin-Name: 2101b4208787d297788e05f2bd82d4a9aff26e2237a7016ac857a52fb5252ce0
 2017-08-17 14:12:16 +00:00
dan
3c77a1e9f1 Add new test file fts5vocab2.test. 
FossilOrigin-Name: 02174842c353bfaa747019cb3dcdee5bca6551d0a06d83fc1ac6d4569e16bc34
 2017-08-12 18:31:31 +00:00
mistachkin
885f410472 Remove some 'breakpoint' commands in test files. 
FossilOrigin-Name: d14fc621e918915bbf8e04597eb238ea78dff3d9c5eb4402cb88692d00dbdfee
 2017-07-19 18:01:42 +00:00
drh
72495b44e0 Improved the interface to the fts5() extension mechanism for enhanced 
security.

FossilOrigin-Name: bc78235f547977f1a821342ca8f3e03103a0eb351f8b3115ac10b43dd9c7044d
 2017-07-17 15:38:57 +00:00
drh
a690ff360b Change the error message text for SQLITE_ERROR to omit the part about 
"missing database" as that meaning is now obsolete (since approx SQLite 2.0).

FossilOrigin-Name: 732f90d6327c5c6368fc8b4cc207bd644ef08e3ae6d2e7295258ab099deaba63
 2017-07-07 19:43:23 +00:00
dan
210ec4c855 Fix a virtual table problem that can occur when the vtab is on the RHS of a 
LEFT JOIN and there is a MATCH constraint in the ON clause, or when the vtab
is in a sub-query that is the RHS of a LEFT JOIN and there is a MATCH
constraint in the WHERE clause of the sub-query.

FossilOrigin-Name: 87b381663398f029f52cb5598aadd069b03034b6f833ce80ba762b406075a44e
 2017-06-27 16:39:01 +00:00
mistachkin
831265f962 Fix harmless compiler warnings in FTS5. 
FossilOrigin-Name: 57a60e959c198b87ed29fab14356f89e0ea7cdb1dd99adbea45b40e8d0cb310a
 2017-05-24 15:32:44 +00:00
dan
6b4fbabd6a Do not save the state of an fts5 merge operation mid-way through an input 
term, even if no previous entry for that term has caused any output. Doing so
may corrupt the FTS index.

FossilOrigin-Name: 9a2de4f05fabf7e725666fb8824ae1adad56834d7ae4f2e118375bb6f9c0ae77
 2017-05-11 18:14:06 +00:00
dan
0619838c55 Fix an FTS5 bug that could cause a prefix-query without a prefix-index on a 
database that contains delete-markers to return extra, non-matching, rows.

FossilOrigin-Name: 840042cb2bed2924e2263f21887317f661e5a585c4466c3af25b91ed57a6b49b
 2017-04-21 16:04:18 +00:00
dan
929b695111 Allow a user column name to be used on the LHS of a MATCH operator in FTS5. 
FossilOrigin-Name: 6f54ffd151b0eca6f9ef57ac54802584a839cfc7373f10c100fc18c855edcc0a
 2017-04-13 09:45:21 +00:00
dan
03155f659f Update fts5 to support "<colset> : ( <expr> )" for column filtering, as well 
as "<colset> : NEAR(...)" and "<colset> : <phrase>".

FossilOrigin-Name: c847543f8bb1376fef52bca72b4191162a32eb7e6c5f0cd1aa0ab116b3183396
 2017-04-12 17:50:12 +00:00
dan
be0bc8bb4d Have fts5 close any open blob-handle when a new savepoint is opened. This 
ensures that fts5 does not prevent DROP TABLE statements (which always open a
savepoint) from succeeding.

FossilOrigin-Name: a921ada89050ce1d162fd1b0056939573635e2cec7ac0c2a99ae924b3ae593f7
 2017-04-08 09:12:20 +00:00
dan
9c58b63c18 Add an sqlite3_set_last_insert_rowid() method. Use it to work around fts4 and 
fts5 modifying the last-insert-rowid unintuitively from within commit
processing.

FossilOrigin-Name: fe41bb5632a5d438acfd682809f1bd12315b970a
 2017-02-27 14:52:48 +00:00
dan
f0e808c60b Fix an FTS5 problem that could cause a crash when certain queries were 
interrupted using sqlite3_interrupt().

FossilOrigin-Name: e400909f313c317b7b67be6eb867ed61df7383dc
 2017-02-21 17:52:58 +00:00
dan
1b9fd2651b Fix a problem preventing FTS5 from correctly passing the FTS5_TOKENIZE_PREFIX 
flag to custom tokenizer implementations.

FossilOrigin-Name: 03c601344ed56b316bcc5fd02f6648b0009ba61b
 2017-01-23 07:06:27 +00:00
dan
55092c1504 Fix an fts5 bug that could cause a crash following an OOM error or 
sqlite3_interrupt() interrupt.

FossilOrigin-Name: 0ea3ece988883874bb88e3daaa220d7fc0cf36ef
 2016-12-09 16:12:04 +00:00
dan
158e4e56d7 Simplify some code in fts5_expr.c. Add some extra test cases for the same. 
FossilOrigin-Name: 7cc2d60dce90b8d4dca35708e33002ae6387806e
 2016-11-28 14:52:23 +00:00
dan
b3e845ba33 Fix an fts5 problem causing a crash in phrase queries where the first token of 
the phrase matches one or more rows but some other token within the phrase
matches zero.

FossilOrigin-Name: e78f6f3bbf4781850960fe6741f7cba480f2c27d
 2016-11-14 08:19:37 +00:00
dan
49377a8fb7 Fix a problem with the fts5 auxiliary function API causing a crash when a query contained a phrase of zero terms. 
FossilOrigin-Name: 0741812d7fcd558479e4849fbb3ba8d03738d018
 2016-09-21 19:43:34 +00:00
dan
48a72ebfa3 Update the fts5vocab table to handle "ORDER BY term" efficiently. 
FossilOrigin-Name: d4928fb5cd63a72808f01778fa5a11395385dedf
 2016-09-21 14:41:09 +00:00
dan
37ff4d4c77 Fix a bug in the fts5 snippet function causing it to return text containing zero phrase instances. 
FossilOrigin-Name: b174ed2bde43a1872374ce18b85ac9f067e86fbb
 2016-08-24 18:50:47 +00:00
dan
783e778f38 Fix other minor problems with the fts5 snippet() function. 
FossilOrigin-Name: b56b2a85cf377686727f3929208ede43f797cf76
 2016-08-20 17:23:45 +00:00
dan
b39a5ac229 Adjust some tests to account for recent changes to the fts5 snippet function. 
FossilOrigin-Name: 184ecbe9c0c3280a22cdeda5c7836a7b280c3e1f
 2016-08-18 14:47:48 +00:00
dan
e7036202bc Bias the fts5 snippet() function to return snippets that look like they start at the start of sentences. 
FossilOrigin-Name: 60de159476edbd48dc363f7f77f09c32ea68422f
 2016-08-17 19:05:12 +00:00
dan
8c2b1fde58 Fix a problem in the fts5 snippet() auxiliary function. 
FossilOrigin-Name: a861713cc6a3868a1c89240e8340bc7b2b9559da
 2016-08-17 11:14:39 +00:00
dan
460d38f15e Fix an fts5 problem with corrupt database handling found by address-sanitizer. 
FossilOrigin-Name: e22252e1da4cd9e41b970970a1c4f466aa6cc133
 2016-08-13 10:34:12 +00:00
dan
ccf03677a3 Minor update to the way fts5 column filters are parsed. 
FossilOrigin-Name: 14864f2b8470fe98dbd17f59963bf1be8d4962f9
 2016-08-09 19:48:37 +00:00
dan
882ef0b8c0 Have fts5 interpret column lists that begin with a "-" character as "match any column except" lists. 
FossilOrigin-Name: e517545650631d1e8a7ee63c6646a8b183a0a894
 2016-08-09 19:26:57 +00:00
drh
07d9a03187 Fix a test case in FTS5 to make it compatible with Tcl 8.5. 
FossilOrigin-Name: a495f8e77e14241150f79e746c7303284f04621a
 2016-07-25 21:11:53 +00:00
dan
033ac6af7e Add extra test cases to verify the fix in [64ca1a835]. 
FossilOrigin-Name: bf98a2de7ed41a8acca89d7369b353f12182cfb4
 2016-07-21 18:02:20 +00:00
dan
0df5024e83 Fix an FTS5 problem (segfault or incorrect query results) with "... MATCH 'x OR y' ORDER BY rank" queries when either token 'x' or 'y' is completely absent from the dataset. 
FossilOrigin-Name: 64ca1a835a89fd211078d2cd8f9b649e89be528d
 2016-05-30 08:28:21 +00:00
dan
170b66493d Fix the FTS5 xQueryPhrase() API function so that it recognizes column filters. 
FossilOrigin-Name: 48505cde05d74748454dc135d4ec25954ecf020e
 2016-05-09 18:05:44 +00:00
dan
848b190e40 Explicitly limit the size of fts5 tokens to 32768 bytes. 
FossilOrigin-Name: 70fc69eed9b09159899d7cbd1416a59d04210a63
 2016-03-23 15:04:00 +00:00
dan
0a2f2b546a Fix some errors in fts5 test scripts. 
FossilOrigin-Name: e1ab2d376a72786098125a41c1ea8140fcbd15c6
 2016-03-22 15:01:54 +00:00
dan
6737aab5cf Add tests to ensure that fts5 is now deterministic. 
FossilOrigin-Name: 3d076094ce411bffcfeb76c0284d15d0f83bd459
 2016-03-21 16:25:34 +00:00
dan
cf9bce34ab Add test file fts5multiclient.test. 
FossilOrigin-Name: 7832466f9177cca59455ba272802145297fcd53d
 2016-03-19 14:47:28 +00:00
dan
f55fb6615b Have fts5 cache the decoded structure of fts5 indexes in memory. Use "PRAGMA data_version" to detect stale caches. 
FossilOrigin-Name: 33ef2210ef19e55c8d460bfe9d3dc146034c8acc
 2016-03-16 19:48:10 +00:00
dan
7d85774da8 Fix a memory leak in fts5 that could occur following a syntax error in a query expression. 
FossilOrigin-Name: 54b8968e335760105206b894672213c1d56771a4
 2016-03-14 12:16:23 +00:00