dan
|
aacf3d1a3b
|
Remove the iPos parameter from the tokenizer callback. Fix the "tokenchars" and "separators" options on the simple tokenizer.
FossilOrigin-Name: 65f0262fb82dbfd9f80233ac7c3108e2f2716c0a
|
2015-01-06 19:08:26 +00:00 |
|
dan
|
2a28e507f7
|
Further fixes and test cases related to external content tables.
FossilOrigin-Name: ce6a899baff7265a60c880098a9a57ea352b5415
|
2015-01-06 14:38:34 +00:00 |
|
dan
|
ded4f41d1a
|
Tests and fixes for fts5 external content tables.
FossilOrigin-Name: 047aaf830d1e72f0fdad3832a0b617e769d66468
|
2015-01-05 20:41:39 +00:00 |
|
dan
|
0fbc269fef
|
Add support for external content tables to fts5.
FossilOrigin-Name: 17ef5b59f789e9fa35c4f053246d819987fd06f8
|
2015-01-03 20:44:58 +00:00 |
|
dan
|
ade921c3ad
|
Allow the rank column to be remapped on a per-query basis by including a term similar to "rank match 'bm25(10,2)'" in a where clause.
FossilOrigin-Name: 1cd15a1759004d5d321056905dbb6acff20dc7d9
|
2015-01-02 14:55:22 +00:00 |
|
dan
|
6024772ba2
|
Add a version of the unicode61 tokenizer to fts5.
FossilOrigin-Name: d09f7800cf14f73ea86d037107ef80295b2c173a
|
2015-01-01 16:46:10 +00:00 |
|
dan
|
e716aca24b
|
Move all fts5 test files to new directory "ext/fts5/test".
FossilOrigin-Name: 7f148edb30103c5f4fee20cd08e38537f9615bf2
|
2014-12-29 15:59:36 +00:00 |
|
dan
|
5fa3acabf4
|
Fixes to built-in tokenizers.
FossilOrigin-Name: b33fe0dd89f3180c209fa1f9e75d0a7acab12b8e
|
2014-12-29 11:24:46 +00:00 |
|
dan
|
2a615fa627
|
Fix the fts5 bm25() function so that it matches the documentation.
FossilOrigin-Name: 1ac7a8d0af9a71ddf6a1421033dcb9fa67c6120c
|
2014-12-23 19:18:34 +00:00 |
|
dan
|
005e10e39a
|
Fixes and simplifications for the snippet() and highlight() functions.
FossilOrigin-Name: ca5d44042aa7461dcc8b700b0763df4df9d4a891
|
2014-12-22 21:01:52 +00:00 |
|
dan
|
1616d55153
|
Remove the fts5_test() aux function. Test aux functions using the tcl interface instead.
FossilOrigin-Name: 67e3ffd950c5347d219a06b33ad51949cffa7d90
|
2014-12-19 20:53:51 +00:00 |
|
dan
|
2ae0f4c931
|
Fix a problem with prefix queries and the AND operator.
FossilOrigin-Name: 38b3c65e3ee95eb7afadb76e0110570fbbc41e1b
|
2014-12-18 20:01:15 +00:00 |
|
dan
|
e4bec37900
|
Fix various problems in fts5 revealed by fault-injection tests.
FossilOrigin-Name: e358c3de5c916f2c851ab9324ceaae4e4e7a0fbd
|
2014-12-18 18:25:48 +00:00 |
|
dan
|
845d0ab323
|
Begin testing fts5 OOM and IO error handling.
FossilOrigin-Name: 2037dba62fdd995ad15b642abe499a790f5ffe5c
|
2014-12-03 17:27:35 +00:00 |
|
dan
|
615a9ae5db
|
Add a configuration option to remap the "rank" column to an auxiliary fts5 function.
FossilOrigin-Name: b5f5971283b9b2f60c16f9675099855af95012cd
|
2014-12-02 20:18:11 +00:00 |
|
dan
|
89a89560d6
|
Add code to parse a rank() function specification. And a tcl interface to add auxiliary functions to fts5.
FossilOrigin-Name: 9c1697a2aa1f601e6eb11704abe63a73c8105447
|
2014-12-01 20:05:00 +00:00 |
|
dan
|
ca7fad3d2c
|
Add a cookie mechanism to ensure that the %_config table is re-read as required.
FossilOrigin-Name: bb4a37b53de60da9ec8b9317eec14afa99690828
|
2014-11-28 20:01:13 +00:00 |
|
dan
|
cb11e73fc2
|
Add a %_config table to fts5.
FossilOrigin-Name: 83491c56661ca78f96020ba68184bb3fb19e674f
|
2014-11-27 20:03:45 +00:00 |
|
dan
|
cb62aae034
|
Add the auxiliary highlight() function to fts5.
FossilOrigin-Name: 059092379f981eb919b500ce447006f9e645fc5a
|
2014-11-24 16:24:33 +00:00 |
|
dan
|
48d7014067
|
Fix the customization interfaces so that they match the documentation.
FossilOrigin-Name: fba0b5fc7eead07a4853e78e02d788e7c714f6cd
|
2014-11-15 20:07:31 +00:00 |
|
dan
|
4aee5dff83
|
Add documentation for tokenizer api to fts5.h. Also add a script to extract extension API docs and format them as html.
FossilOrigin-Name: e240d467e60b7755486aae5e8b0824f7c741f852
|
2014-08-25 19:58:54 +00:00 |
|
dan
|
6885bbc713
|
Add an "automerge=0" mode that disables auto-merging and falls back to fts4-style crisis merges.
FossilOrigin-Name: 2397404e152b908d838e6491294b263b05943b3f
|
2014-08-18 19:30:01 +00:00 |
|
dan
|
0bbd9c27c2
|
Cache the value of the "totals" record in memory during transactions.
FossilOrigin-Name: 05dfdad445b22f375b71abe0b1fa1bf7ca331be7
|
2014-08-12 16:07:35 +00:00 |
|
dan
|
e2fb318e34
|
Automatically resize the hash table used by fts5.
FossilOrigin-Name: f1cb48f412a5f200f1fe04f91072864f379db08f
|
2014-08-12 08:36:00 +00:00 |
|
dan
|
1a669f84a1
|
Simplify the way position lists are copied when merging data.
FossilOrigin-Name: 9f8d678a0ea75e169daf8b3f00bd05f52a050ea6
|
2014-08-11 20:26:34 +00:00 |
|
dan
|
c7fe7a969b
|
Replace the hash table borrowed from fts3.
FossilOrigin-Name: 617e2fac1c128212254f71b1a8fddaf0d1d90262
|
2014-08-11 19:44:52 +00:00 |
|
dan
|
c45f24b281
|
Fix an uninitialized variable causing a problem during fts5 table initialization.
FossilOrigin-Name: a14fa876f0eb66028e302b908967cc4a05ede9fc
|
2014-08-09 18:22:59 +00:00 |
|
dan
|
b191db8390
|
Use multiple memory allocations for a single Fts5Structure object. This is probably less efficient but much easier to get right.
FossilOrigin-Name: 2821825f7a481755a333dcdcad780b3e24448f20
|
2014-08-09 18:02:27 +00:00 |
|
dan
|
1d3ed1f46a
|
Add "segment promotion" to fts5. This prevents the FTS index from growing indefinitely as data is added and deleted.
FossilOrigin-Name: ba359d78e166d78e0dc89e3c63a9a41e9ffea989
|
2014-08-07 18:47:33 +00:00 |
|
dan
|
d90aab8f94
|
Avoid writing delete markers to the oldest segment in an FTS index.
FossilOrigin-Name: 1baeb1cee61d9c56c718b50af034a24f1018a322
|
2014-08-06 20:04:14 +00:00 |
|
dan
|
7b71fbaf93
|
Add support for savepoints to fts5.
FossilOrigin-Name: 3b19eba042bb2eeb1be60f8d58ebaa0a045d6a5c
|
2014-08-06 16:30:21 +00:00 |
|
dan
|
192d413e95
|
Use doclist indexes for AND queries as well as phrases.
FossilOrigin-Name: 5d38e6edc40ef188fbf96505073797036aa6783a
|
2014-08-05 19:35:20 +00:00 |
|
dan
|
d5997d80cb
|
Use doclist-indexes with "ORDER BY rowid ASC" fts5 queries as well.
FossilOrigin-Name: d028ba6589f3122b635474c2683c0f93d5bc6c7c
|
2014-08-05 19:00:22 +00:00 |
|
dan
|
9a67058a63
|
Fix fts5_index.c to use doclist-indexes when possible. Only some cases work so far.
FossilOrigin-Name: 90b82d3ef613b2915e0e280dc1d2e5a2b617d59c
|
2014-08-04 20:07:40 +00:00 |
|
dan
|
9af0705e84
|
Start changing things to use doclist indexes as required. code is not activated yet.
FossilOrigin-Name: b8864da95db2c0e611116304d607e35a86c9247d
|
2014-08-02 20:49:36 +00:00 |
|
dan
|
ff31da03e5
|
Add a special case to the integrity-check code to check that the final integer in a doclist index is as expected.
FossilOrigin-Name: c98934155cb48adfda57bd0fd1b950226d45f67a
|
2014-08-01 20:13:49 +00:00 |
|
dan
|
d34742901d
|
Have the fts5 integrity-check verify that doclist indexes match the contents of the leaf pages that they index.
FossilOrigin-Name: 37a7d3035eb4bbad7e32fe550321ac9fae611a57
|
2014-08-01 19:27:07 +00:00 |
|
dan
|
a29284d65f
|
Add "doclist index" records to the database. These are to make navigating within very large doclists faster. They are not yet used by queries.
FossilOrigin-Name: 89377421ff69f2450364987afe781b6d8bcbf087
|
2014-08-01 11:16:25 +00:00 |
|
dan
|
3dbfc8d8e8
|
Add a comment explaining why fts5 cannot cache "sorter statements".
FossilOrigin-Name: e6af3b7a3cf331210f4c87848e2af007dbd5ef30
|
2014-07-31 17:53:03 +00:00 |
|
dan
|
937490d4b4
|
Add further tests for the extension APIs with "ORDER BY rank" queries.
FossilOrigin-Name: 37a417d27e4ebafd4783f62728d7467316b75b17
|
2014-07-31 11:57:59 +00:00 |
|
dan
|
3fc4a856a2
|
Fix things so that the fts5 extension API works with "ORDER BY rank" queries.
FossilOrigin-Name: f1b4e1a98d49ecaba962beba16f8224175e4ba59
|
2014-07-30 20:26:24 +00:00 |
|
dan
|
fdb4a30af2
|
Add hidden column "rank". Currently this always returns the same value as the bm25() function.
FossilOrigin-Name: 4cc048c3651e830a6aeded924c7f3a60b634e133
|
2014-07-30 19:41:58 +00:00 |
|
dan
|
92e497e517
|
Add the "loadfts" program, for performance testing the loading of data into fts3/fts4/fts5 tables.
FossilOrigin-Name: 770b9540c19ad1e3d24adff382332bf032065efd
|
2014-07-28 20:14:02 +00:00 |
|
dan
|
454b5ce524
|
Add tests and fixes for bm25() function.
FossilOrigin-Name: 71d32f53e81921e43c933cc968cb1c18d83fe1e0
|
2014-07-26 18:38:51 +00:00 |
|
dan
|
700b33d7a5
|
Add extension apis xRowCount, xQueryPhrase, xSetAuxdata and xGetAuxdata. And a ranking function that uses all of the above.
FossilOrigin-Name: c4d50428ab97f77e6721c4f8d03eaaf3ea91f3eb
|
2014-07-25 20:30:47 +00:00 |
|
dan
|
b30860abe2
|
Add a snippet() function to fts5.
FossilOrigin-Name: bdc58fd28a63ac9632c3df6c7768a9a236566605
|
2014-07-23 19:31:56 +00:00 |
|
dan
|
a5983da6e1
|
Fix DELETE and UPDATE operations on fts5 tables.
FossilOrigin-Name: d44d3a8518ff7a1a3e2c0ab97493aa590676ee8c
|
2014-07-21 15:45:26 +00:00 |
|
dan
|
5c1b820460
|
Add the xTokenize extension API.
FossilOrigin-Name: 8c6b0aff3443fae4b7f0b9adcbf1514992b70653
|
2014-07-21 14:22:38 +00:00 |
|
dan
|
84d6fb394f
|
Fix the xColumnSize() extension API.
FossilOrigin-Name: 19504c4108472d2ad1281221642b8bd06eb69f4e
|
2014-07-21 11:44:47 +00:00 |
|
dan
|
e1c77bcfcd
|
Add simple tests for the xColumnText() extension api.
FossilOrigin-Name: 1e9053abdaf5e128d44504ee00dfd909dc25f378
|
2014-07-19 20:27:54 +00:00 |