dan
|
a2af0aecdb
|
Avoid allocating a large object on the stack in the incremental merge code. Use sqlite3_malloc() instead.
FossilOrigin-Name: 36ae510de45be44efd34cff242d02fb21b7419ac
|
2012-03-14 12:17:40 +00:00 |
|
dan
|
8af1fc721e
|
Fix another bug in the incremental merge code.
FossilOrigin-Name: f97b12e0955c4c29f9c31a186d72d87f7407782e
|
2012-03-14 11:51:31 +00:00 |
|
dan
|
604f58a686
|
Fix some bugs in the incremental merge code. Some remain.
FossilOrigin-Name: bff21683705a61b8b8672e0b44c287d1dc7c32a9
|
2012-03-13 19:56:34 +00:00 |
|
drh
|
ab4f6385de
|
Minor commenting and stylistic changes only.
FossilOrigin-Name: a1747086c5e0c152fcf4bd9fa80a61b6f03f4a94
|
2012-03-09 12:52:43 +00:00 |
|
dan
|
593c9824bc
|
Add the 'merge=?,?' command to fts4. This still needs some work.
FossilOrigin-Name: 741b8f897750eac3c9774fd65de7e40bb89781b1
|
2012-03-08 18:39:03 +00:00 |
|
dan
|
996073b3ae
|
Add the xLanguageid method to sqlite3_fts3_tokenizer versions 1 and greater.
FossilOrigin-Name: f8e9c445dd358c40e5a7bf3756b9f291909dbea7
|
2012-03-03 18:46:41 +00:00 |
|
dan
|
8fb662b0be
|
Fix the FTS 'optimize' command on multi-lingual databases.
FossilOrigin-Name: 65fa693729a336e4d905ce72e6b9ccf4faa772bd
|
2012-03-02 12:26:19 +00:00 |
|
dan
|
e3ddd1ac42
|
Fix a bug in merging FTS language tables for languages other than language 0.
FossilOrigin-Name: d281cb8984c911a4c0cce2ec299e1351d8e580e4
|
2012-03-02 11:48:50 +00:00 |
|
dan
|
7fcb214b93
|
Add the "languageid=" option to fts4. This code is still largely untested and alsmost certainly buggy.
FossilOrigin-Name: bea257f70f10dd1111d79cabd1e1462dc651704d
|
2012-03-01 19:44:20 +00:00 |
|
drh
|
548af8b69e
|
Fix a compiler warning in FTS4.
FossilOrigin-Name: b4cad1ce78e6bb967c472bec5c562a24b4dfebaf
|
2012-01-31 23:34:21 +00:00 |
|
dan
|
585db0e23a
|
Fix an FTS problem triggered by querying for an N character prefix using an N+1 character prefix index after rows have been deleted from the FTS table.
FossilOrigin-Name: c05c3fd20d93f430140d762ead23bacd337ffb4d
|
2012-01-25 16:29:45 +00:00 |
|
drh
|
64803bd2fa
|
Fix minor issues with FTS and RTREE discovered by coverity.
FossilOrigin-Name: 1c27d842163e27c39bbe9409f50657b9de9ade6e
|
2011-12-22 17:31:17 +00:00 |
|
dan
|
0c8cda6e0d
|
Fix a problem in fts3_write.c causing stack memory to be referenced after it is out of scope.
FossilOrigin-Name: f9c4a7c8f4e5821b47c1393d6272e32416d8886c
|
2011-12-22 15:30:46 +00:00 |
|
drh
|
6ed18b7110
|
Fix harmless compiler warnings in FTS4.
FossilOrigin-Name: 1af4a25631c4077a9bfc64e15eb92fbf5146c89c
|
2011-10-19 18:21:47 +00:00 |
|
dan
|
e459b07601
|
Merge the fts4-content branch with the trunk.
FossilOrigin-Name: 8a4077057ddeb08e8edc5f20a75abaaba7a278ba
|
2011-10-19 16:20:40 +00:00 |
|
dan
|
d17f70a624
|
Change the way ^ tokens work in FTS so that the filtering is done as part of reading the FTS index instead of waiting until an entire doclist has been retrieved and then filtering it.
FossilOrigin-Name: 9b58c59eb4efaa38ce50a3ce1b52f9ba578c71d6
|
2011-10-19 11:57:13 +00:00 |
|
dan
|
3f1ea8d114
|
If a token within an FTS query is prefixed with a '^' character, it must be the first token in a column of data to match.
FossilOrigin-Name: 63ac33c860eb32ce96699f06bf83121cec2ffaca
|
2011-10-18 19:39:41 +00:00 |
|
dan
|
8dab211632
|
Handle updating the only row of an FTS table correctly. Fix for [9fd058691].
FossilOrigin-Name: 7e24645be2fe0ffe092212e7bcfa5b4500305811
|
2011-10-13 17:16:45 +00:00 |
|
dan
|
deb9473250
|
Change FTS4 so that if both the content=xxx option and column names are specified, the virtual table assumes that the named columns correspond to columns of table xxx.
FossilOrigin-Name: 289ee43179369fce2fde50870d72c445e184e896
|
2011-10-05 15:11:30 +00:00 |
|
dan
|
8361b189c9
|
Fix a problem with IO error handling in the rebuild-index code.
FossilOrigin-Name: c6ba81fcad32192674bd510e607f787adc1f7038
|
2011-10-05 06:07:00 +00:00 |
|
dan
|
d8e454e19a
|
Add experimental 'content' option to FTS4.
FossilOrigin-Name: 1d27ea741f61c624e18bdc6a3b1c2d8574a64ddc
|
2011-10-04 11:22:59 +00:00 |
|
drh
|
7fd3392981
|
More compiler warning fixes.
FossilOrigin-Name: ed2dda9329ca42e9c0be1986c78b091051e7598f
|
2011-06-20 19:00:30 +00:00 |
|
dan
|
d4d21fea8e
|
Fix a problem with NEAR queries executed inside a transaction that writes the FTS table.
FossilOrigin-Name: 051c756c367837908f6691c0a36108e088c94f99
|
2011-06-16 16:06:05 +00:00 |
|
drh
|
6b96771b82
|
Changes to #ifdefs so that the build goes correctly if the only FTS macro
defined is SQLITE_ENABLE_FTS4.
FossilOrigin-Name: a0b43a320e6491de7070966ed7c3ec55fd660a85
|
2011-06-16 00:54:45 +00:00 |
|
dan
|
376d1e5c4f
|
Add an interface to better test incremental loading of doclists by FTS4. Also some tests for this and term prefix queries.
FossilOrigin-Name: 7a3813138d1a5c5d99f4756c79998831d779774f
|
2011-06-15 08:30:29 +00:00 |
|
dan
|
abf2545ed9
|
Fix various issues to do with deferred tokens, NEAR expressions and matchinfo().
FossilOrigin-Name: 3972a787df5ec253b99b148385655e7b68d851fa
|
2011-06-08 18:39:07 +00:00 |
|
dan
|
5289b01524
|
Modify fts3rnd.test to run tests for both "ORDER BY docid ASC" and "ORDER BY docid DESC" with both order=ASC and order=DESC FTS tables. Fixes for some bugs found.
FossilOrigin-Name: 89f2f482e077241ac29a58eadf44a72a9c01f98c
|
2011-06-06 14:51:50 +00:00 |
|
dan
|
b46ee91729
|
Allow the "order=DESC" and "order=ASC" parameters in FTS4 "CREATE VIRTUAL TABLE" statements. Tables created with "order=DESC" store all doclists in descending order, which allows optimizations normally applied to "ORDER BY docid ASC" queries to be used with "ORDER BY docid DESC" queries instead.
FossilOrigin-Name: f6a0193f5a32603eb48bddc6297042dbd2ffe96e
|
2011-06-04 20:04:35 +00:00 |
|
dan
|
126ba6c0ac
|
FTS changes: Remove unreachable code. Fix bugs. When processing a large doclist incrementally, read from disk incrementally too.
FossilOrigin-Name: a4c7e2820824e82580730c36f85aede2efa66754
|
2011-06-03 18:00:19 +00:00 |
|
dan
|
e414854800
|
Changes to improve performance and support LIMIT clauses on fts3 tables. This branch is unstable for now.
FossilOrigin-Name: 28149a7882a1e9dfe4a75ec5b91d176ebe6284e9
|
2011-06-02 19:57:24 +00:00 |
|
dan
|
382874fc5c
|
Minor changes made while planning a larger change.
FossilOrigin-Name: 84097a4c759b1d65890af885f137d3cb16eef584
|
2011-05-28 15:57:40 +00:00 |
|
dan
|
98b08e71f2
|
If a prefix index of size N is not present, use a prefix index of size N+1 along with the terms index for queries for prefixes of length N.
FossilOrigin-Name: cc83991caae7c7d647432d5711b6cd80228c3002
|
2011-05-25 19:17:32 +00:00 |
|
dan
|
9d1f874ab3
|
Change fts4 so that the prefix= parameter is passes a comma-separated list of integers. For each integer N, a separate index of all prefixes of length N bytes is created.
FossilOrigin-Name: be59bf49402d2e2f4b95fb6668849f3745cb7bf2
|
2011-05-25 18:34:53 +00:00 |
|
dan
|
09643ab745
|
If the fts4 option prefix=1 is specified, have the fts4 module maintain an index of prefixes as well as terms.
FossilOrigin-Name: b5bdc639898ee22eebedeb560810e94e74de8aa4
|
2011-05-24 18:49:45 +00:00 |
|
dan
|
133d7dab17
|
Add extended return code SQLITE_CORRUPT_VTAB. Returned when the tcontents of the sqlite tables used internally by a virtual table module are invalid or inconsistent.
FossilOrigin-Name: 8844e8bfb87314fb40ecb92705e8fff88f72bb38
|
2011-05-17 15:56:16 +00:00 |
|
dan
|
62d6c7e32b
|
Fix a couple of compiler warnings in the FTS code.
FossilOrigin-Name: 1a113359705d307efa1833b1dfa5542b045dae43
|
2011-05-04 16:30:05 +00:00 |
|
dan
|
3480a01dad
|
Add documentation for the newly introduced sqlite3_vtab_config() and on_conflict() API functions. Test that encountering an SQLITE_MISMATCH in fts3 does not corrupt the full text index.
FossilOrigin-Name: abdd70ae0424ccadb7edaf16e970c78b5257d23c
|
2011-04-27 16:02:46 +00:00 |
|
dan
|
a311b80392
|
Extra tests for fts3. And fixes for conflict-handling related problems in fts3.
FossilOrigin-Name: fb4a355871d9482ccb28b6ba03b842b3cc87b696
|
2011-04-26 19:21:34 +00:00 |
|
dan
|
b061d058cb
|
Add support for on conflict clauses to fts3/fts4.
FossilOrigin-Name: 6d2633a6d0a9bb88fb1a6adac0827dc51df2d4d2
|
2011-04-25 18:49:57 +00:00 |
|
dan
|
355c53b6ef
|
Avoid passing NULL to the xOpen method of an FTS3/4 tokenizer.
FossilOrigin-Name: 0dd09fc034c127718366d3a3183e367d2f9fd82d
|
2011-04-19 06:43:22 +00:00 |
|
dan
|
4c600ac389
|
Change fts4aux to (additionally) report on term frequency in individual columns of an fts table.
FossilOrigin-Name: 3996f92a9aca9ac2628be003eca83c8f954c71de
|
2011-02-04 18:56:25 +00:00 |
|
dan
|
20d5f354e9
|
Optimize handling of equality and range constraints on the "term" column of an fts4aux table.
FossilOrigin-Name: 386701ded2bcee5309ec9f285d94e6eb1eade193
|
2011-02-02 17:30:43 +00:00 |
|
dan
|
0bfda98155
|
Fix a case in fts4 where a corrupt %_stat table could lead to a crash.
FossilOrigin-Name: 4ade96ce974244fc34bb97713d3cba10e3d33056
|
2011-02-01 17:55:48 +00:00 |
|
dan
|
a240fd01b6
|
Add virtual table module "fts4aux", used to inspect the full-text index of an fts4 table directly. Also add the "compress" and "uncompress" fts4 options.
FossilOrigin-Name: b010ddcc52889160af2183a33c5f483bb0ae91b9
|
2011-02-01 16:34:32 +00:00 |
|
dan
|
a8ab60c648
|
Fix a couple of crashes in fts3 that can occur if the database contents are inconsistent.
FossilOrigin-Name: 811e12cddfb3246c6cf3d5085bd9b72b12e05550
|
2011-01-13 11:20:04 +00:00 |
|
dan
|
86596e552e
|
Fix a segfault that can occur in matchinfo if an fts4 table contains mostly zero-length documents. Specifically, if the table contains more rows than it does bytes of text.
FossilOrigin-Name: fe9047668eaaf76e7aa1ef1f32dec7c7c4226e45
|
2011-01-13 10:58:26 +00:00 |
|
dan
|
b9a93d70b8
|
Reduce the number of calls to sqlite3_realloc() made by fts3 when querying for position information of a term prefix.
FossilOrigin-Name: 7088d9450f403f12f67eed558e368573101245d6
|
2010-12-24 15:49:27 +00:00 |
|
shaneh
|
556f6bbc92
|
Fix some warnings under MSVC in fts3 module.
FossilOrigin-Name: c7771c0b22f2b45a47070cf84b9ecf1011e40404
|
2010-12-01 15:36:00 +00:00 |
|
drh
|
6ea28d6d84
|
Fix various compiler warnings.
FossilOrigin-Name: c412f61229b6ab1ac90b932afd56f7c5e3ba1cfe
|
2010-11-26 16:49:59 +00:00 |
|
dan
|
f9376540fa
|
Add code for the matchinfo 'longest common substring' feature.
FossilOrigin-Name: 71011a4f9baf09ec6935ad591145252bf3c286ed
|
2010-11-24 19:26:18 +00:00 |
|
dan
|
ad3acbbfb3
|
Remove some unused code from fts3. Add tests to fts3matchinfo.test.
FossilOrigin-Name: ae40b34cf7c24c9601bdfb5cbe5b20f05a376ea8
|
2010-11-24 11:51:56 +00:00 |
|
dan
|
1e66e40eb9
|
Experimental changes to fts3 function matchinfo().
FossilOrigin-Name: 9cf0f2b76bc68c168e3fa861b7235f384db21d38
|
2010-11-23 19:16:47 +00:00 |
|
dan
|
af4c214e1f
|
Changes to allow FTS4 tables to be created without the underlying %_docsize table (in order to save space).
FossilOrigin-Name: 31989b18f53d97eddfb39660ef04fbf9463583e0
|
2010-11-02 17:41:52 +00:00 |
|
dan
|
cfddb09e3b
|
Test cases and minor changes to make fts3 more robust in the face of a corrupt database.
FossilOrigin-Name: b770290561f5450e4d985ca0050ef5eb01657c80
|
2010-10-30 15:21:13 +00:00 |
|
dan
|
797f3ee87c
|
Add extra test cases and changes to fts3 to avoid crashing on a corrupt database.
FossilOrigin-Name: 252f0e457d3e33404df87d3e6c44ede61b78319c
|
2010-10-29 18:45:10 +00:00 |
|
dan
|
8aaa252d8c
|
Fix a buffer overread in fts3 that can occur if the database is corrupt.
FossilOrigin-Name: 84194c4195d7144ff7f9cedcdc74fdd908f3bfcd
|
2010-10-27 16:52:27 +00:00 |
|
dan
|
8c30711208
|
In fts4, store the total number of bytes of for all records in the table in the %_stat table.
FossilOrigin-Name: 941647d121ac60e2eabc998cfe79b157fb918d7e
|
2010-10-27 10:55:54 +00:00 |
|
dan
|
378d0ab97b
|
Fixes for the matchinfo() function related to FTS4 common token handling.
FossilOrigin-Name: deb80eac9112d21835dfd3cee08ed8f09d975bf7
|
2010-10-23 19:07:30 +00:00 |
|
dan
|
789cb8f5cf
|
Add missing comments and fix compiler warnings in new FTS3/4 code. Other minor fixes too.
FossilOrigin-Name: 1c9c70fec3c88319f7b2efe5316694a6ce0ab1a5
|
2010-10-22 16:44:39 +00:00 |
|
dan
|
4e76cc3650
|
Updates to FTS4 to improve performance and make more accurate cost estimates for prefix terms.
FossilOrigin-Name: d0a450ce78e99f55c862f26f9332786660007a0a
|
2010-10-20 18:56:04 +00:00 |
|
dan
|
4f7c5e684a
|
Experimental changes to fts4 to try to selectively avoid loading very large doclists.
FossilOrigin-Name: 5ae0ba447a561e3b6637b52f9b83a9fc683d2572
|
2010-10-19 14:07:59 +00:00 |
|
dan
|
8786f7f589
|
Have all FTS3 queries obtain a read or write table-lock at the shared-cache level before doing anything else.
FossilOrigin-Name: 018e82c775d0fb8c0d90cddf7a87c20c8c8172a9
|
2010-09-17 15:28:41 +00:00 |
|
dan
|
3b6f4c06ac
|
Rewrite a couple of queries used internally by FTS3 to take advantage of the "SELECT max(x) FROM ..." optimization.
FossilOrigin-Name: b7e42ae77443b33e0ab83265064830594094dc7c
|
2010-03-19 06:59:19 +00:00 |
|
shaneh
|
84f4b2f237
|
Minor changes to silence some compiler warnings with MSVC.
FossilOrigin-Name: 4927c62d6214d93e582bf1266215ed3519630c15
|
2010-02-26 01:46:54 +00:00 |
|
drh
|
b4a1fed2ea
|
Add a new full-text search variant that tracks the total number of documents
and document sizes, to make ranking search results easier. Currently
called FTS4.
FossilOrigin-Name: 1b6e6094c88214e02c9e3638932997ac20bfe413
|
2010-02-03 19:55:13 +00:00 |
|
dan
|
8718183ea5
|
Fix a bug triggered by optimizing an FTS3 table when there are no segments on disk but pending terms in the hash table.
FossilOrigin-Name: a3b50e4f80ca2dacc1f72435b8c72d55ffdb64e7
|
2009-12-29 10:32:36 +00:00 |
|
dan
|
971742058f
|
Fix a broken assert() in fts3_write.c. Also fix a couple of compiler warnings in fts3 code.
FossilOrigin-Name: a730a05b39c45138765df98d34b9db1ab4e72152
|
2009-12-14 14:49:57 +00:00 |
|
dan
|
55be7449f9
|
Further fts3 coverage tests.
FossilOrigin-Name: d2a8c0f683271f5fb8c9badfb13e4e46fd78db71
|
2009-12-12 16:04:32 +00:00 |
|
dan
|
45bcd6c274
|
Extra tests for coverage of fts3 code.
FossilOrigin-Name: eee921a99e69a9cd868a89de620bf47c4e26e4b5
|
2009-12-12 13:16:09 +00:00 |
|
dan
|
f5fff2a7b2
|
Add coverage test cases for fts3.
FossilOrigin-Name: 8fcb0478c82507403165719724b62a308cb83b57
|
2009-12-12 09:51:25 +00:00 |
|
dan
|
601cd9aa24
|
Change the fts3 test interface used to configure the advisory node size paraemeter.
FossilOrigin-Name: 87fc0ce151c89beb5a43b65c0b1706f340c0c173
|
2009-12-11 16:03:45 +00:00 |
|
dan
|
4f887abc4c
|
Rationalize some code in fts3 used by optimize operations, queries of the pending-terms hash table and segment merges. Add the "INSERT INTO tbl(tbl) VALUES('optimize')" syntax.
FossilOrigin-Name: 29476da353df4c67fe744c1c5f466ba5b9c1a54b
|
2009-12-11 12:29:04 +00:00 |
|
dan
|
b893721a45
|
Changes to fts3 to avoid flushing data to disk within a SELECT statement.
FossilOrigin-Name: 48c0db0eb2d134bb302bb5eca6beb0ec46736257
|
2009-12-10 16:04:25 +00:00 |
|
dan
|
18ff7fa6b4
|
Improve test coverage of fts3.c.
FossilOrigin-Name: 56b6432f8622d53ffd3a4d9a2244114f8531ed71
|
2009-12-09 14:39:41 +00:00 |
|
dan
|
84db21ec6a
|
Add tests to improve coverage of fts3. Associated bugfixes.
FossilOrigin-Name: f0eac4175aee6c50ee68acc253f76fbe44574250
|
2009-12-08 19:05:53 +00:00 |
|
dan
|
e2e5145441
|
Fix an incorrect assert() in fts3.c. Add further fts3 tests.
FossilOrigin-Name: 75863c2d55e0801add5b8dcf88d575c5c870af04
|
2009-12-03 17:36:22 +00:00 |
|
shaneh
|
e585b8f05c
|
Updates to FTS3 to correct compiler warnings under MSVC.
FossilOrigin-Name: 37495b55ffbdc2db4482367ac7d8e32d4d71d58e
|
2009-12-03 06:26:46 +00:00 |
|
dan
|
bc7c039ce2
|
Clear the Pager.dbModified flag when unlocking the database. Assert that it is clear when locking the database.
FossilOrigin-Name: d17ec16b7c5051c904c09580a856593b2fb85edc
|
2009-12-02 14:44:32 +00:00 |
|
dan
|
3acb07d6c3
|
Open a savepoint within the FTS3 optimize() function.
FossilOrigin-Name: 4924fbb244bd1b7103e29e045812cb1c4d2d81c8
|
2009-12-01 13:48:13 +00:00 |
|
dan
|
612b1d5cd0
|
Fix a segfault that can occur when querying an empty FTS3 table. Also restore the rowid/docid conflict handling to work as it did in version 3.6.20.
FossilOrigin-Name: c022f66b5a65aa54d5ebd55cfe941118a2042280
|
2009-12-01 12:00:22 +00:00 |
|
drh
|
0a62730d3f
|
Updates to snippet() and offsets() functions of FTS3 so that they work
sanely following an OOM fault.
FossilOrigin-Name: b939a37a8ce296785a300e79ab9d3d87ad91343f
|
2009-11-28 21:33:21 +00:00 |
|
dan
|
81fa6dc319
|
Fix a bug introduced by the fts3 refactoring (segfault when creating a table with zero module args). Also a fix to handle an OOM error.
FossilOrigin-Name: eada284bc10cafcab9beb3473bb0c70b3b4de2f9
|
2009-11-28 12:40:32 +00:00 |
|
dan
|
7eee299243
|
Add some missing comments to fts3 files. No source code changes.
FossilOrigin-Name: b6402b2065b844acb3f1bb94ad964568706bcb86
|
2009-11-21 03:03:21 +00:00 |
|
dan
|
e6828f5503
|
Merge leaf accidentally created by [1c4984c62f].
FossilOrigin-Name: cae949ce971ca216e0f8880b2f93866619fa05be
|
2009-11-20 10:23:12 +00:00 |
|
dan
|
d1414c58e5
|
Improve comments and other things in fts3_write.c.
FossilOrigin-Name: 1cf0e3cc14bad22867e740736c2886dc1c4a48dc
|
2009-11-20 05:05:19 +00:00 |
|
dan
|
d313865550
|
Minor optimizations to fts3 code.
FossilOrigin-Name: b456eacbbb16513d1b27e90015ea58a6dc92cc3b
|
2009-11-20 02:24:15 +00:00 |
|
dan
|
16708c4a0d
|
Fix some fts3 related issues with the autoconf and amalgamation build systems.
FossilOrigin-Name: 3b17924754343c0163464dabf01a9c46ffccef28
|
2009-11-19 15:25:25 +00:00 |
|
dan
|
5dc842ddf7
|
Fix problems introduced into fts3 as part of the refactoring.
FossilOrigin-Name: fa0998e19d984ee57f4f506c34eb858026cc49c3
|
2009-11-19 00:15:27 +00:00 |
|
dan
|
bd61689382
|
Add some missing comments and fix some other issues in fts3 code.
FossilOrigin-Name: 2fe579e778b75fbf503c02e01e5424c1926f2b49
|
2009-11-18 15:35:58 +00:00 |
|
dan
|
f13b704ee6
|
Improvements to the way fts3 reads the full-text index.
FossilOrigin-Name: 45c051e78651d8204c17cecdda2bde705698881f
|
2009-11-17 12:52:10 +00:00 |
|
dan
|
09977bb9f0
|
Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.).
FossilOrigin-Name: 30a92f1132801c7582007ee625c577ea2ac31cdf
|
2009-11-13 10:36:20 +00:00 |
|