mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,113 Commits 1,487 Branches 166 Tags 416 MiB
0ef54fa6e8
Commit Graph

101 Commits

Author SHA1 Message Date
dan
f443e317f7 Remove accidental global variable "doclist" from fts3Int.h. 
FossilOrigin-Name: f244b2f3959e86fac555b91438cfe90528ab1648
 2011-07-07 07:37:53 +00:00
dan
b8ae1afba1 Merge latest trunk changes with fts3-changes branch. 
FossilOrigin-Name: 226686475c28cdc87e86d2d3f10014436a9a2b8f
 2011-06-28 09:51:22 +00:00
dan
0ea2517c4e Changes to allow FTS to be compiled as a loadable module again. 
FossilOrigin-Name: 29e69f389cb0078e125ba5814a68b3fe8cf634c6
 2011-06-28 07:15:43 +00:00
dan
17fb042578 Fix some of the code issues (missing comments etc.) in the new FTS code. 
FossilOrigin-Name: 8230d83120e0f4d217fde56e22c6f05aa5adee09
 2011-06-23 17:09:51 +00:00
drh
7fd3392981 More compiler warning fixes. 
FossilOrigin-Name: ed2dda9329ca42e9c0be1986c78b091051e7598f
 2011-06-20 19:00:30 +00:00
dan
c5f21892a8 Avoid loading doclists for infrequent terms that are part of phrases twice. 
FossilOrigin-Name: 8f939723f742329cedba8930f71dff42004f3d0d
 2011-06-17 17:37:31 +00:00
dan
10fc4d8c45 Add a missing declaration to fts3Int.h. 
FossilOrigin-Name: 3bfd4466f50711eb71d1a13231025ff4e1e76246
 2011-06-17 16:04:39 +00:00
dan
d4d21fea8e Fix a problem with NEAR queries executed inside a transaction that writes the FTS table. 
FossilOrigin-Name: 051c756c367837908f6691c0a36108e088c94f99
 2011-06-16 16:06:05 +00:00
drh
6b96771b82 Changes to #ifdefs so that the build goes correctly if the only FTS macro 
defined is SQLITE_ENABLE_FTS4.

FossilOrigin-Name: a0b43a320e6491de7070966ed7c3ec55fd660a85
 2011-06-16 00:54:45 +00:00
dan
abf2545ed9 Fix various issues to do with deferred tokens, NEAR expressions and matchinfo(). 
FossilOrigin-Name: 3972a787df5ec253b99b148385655e7b68d851fa
 2011-06-08 18:39:07 +00:00
dan
b46ee91729 Allow the "order=DESC" and "order=ASC" parameters in FTS4 "CREATE VIRTUAL TABLE" statements. Tables created with "order=DESC" store all doclists in descending order, which allows optimizations normally applied to "ORDER BY docid ASC" queries to be used with "ORDER BY docid DESC" queries instead. 
FossilOrigin-Name: f6a0193f5a32603eb48bddc6297042dbd2ffe96e
 2011-06-04 20:04:35 +00:00
dan
126ba6c0ac FTS changes: Remove unreachable code. Fix bugs. When processing a large doclist incrementally, read from disk incrementally too. 
FossilOrigin-Name: a4c7e2820824e82580730c36f85aede2efa66754
 2011-06-03 18:00:19 +00:00
dan
e414854800 Changes to improve performance and support LIMIT clauses on fts3 tables. This branch is unstable for now. 
FossilOrigin-Name: 28149a7882a1e9dfe4a75ec5b91d176ebe6284e9
 2011-06-02 19:57:24 +00:00
dan
382874fc5c Minor changes made while planning a larger change. 
FossilOrigin-Name: 84097a4c759b1d65890af885f137d3cb16eef584
 2011-05-28 15:57:40 +00:00
dan
9d1f874ab3 Change fts4 so that the prefix= parameter is passes a comma-separated list of integers. For each integer N, a separate index of all prefixes of length N bytes is created. 
FossilOrigin-Name: be59bf49402d2e2f4b95fb6668849f3745cb7bf2
 2011-05-25 18:34:53 +00:00
dan
09643ab745 If the fts4 option prefix=1 is specified, have the fts4 module maintain an index of prefixes as well as terms. 
FossilOrigin-Name: b5bdc639898ee22eebedeb560810e94e74de8aa4
 2011-05-24 18:49:45 +00:00
drh
e485522462 Do not invoke the xRollbackTo or xRelease methods of a virtual table without 
having first invoked an appropriate xSavepoint method.  Add assert() statements
to FTS3/4 to verify that this is happening in all cases.

FossilOrigin-Name: 651ef24249d8c22c4f13e4c0bb98a60099cfd23a
 2011-05-24 15:36:01 +00:00
dan
807d0fcaba Avoid including fts3_term.c in the amalgamation, as it contains test code only. 
FossilOrigin-Name: f392b7ae0266b4c694836583cb91b10f2b6c0752
 2011-05-17 14:41:36 +00:00
dan
0f599faa29 Optimize "ORDER BY rowid/docid DESC/ASC" clauses on FTS tables. 
FossilOrigin-Name: 13395121e3d17ab6581dc5f6736ea324321a374c
 2011-05-04 12:52:59 +00:00
dan
20d5f354e9 Optimize handling of equality and range constraints on the "term" column of an fts4aux table. 
FossilOrigin-Name: 386701ded2bcee5309ec9f285d94e6eb1eade193
 2011-02-02 17:30:43 +00:00
dan
a240fd01b6 Add virtual table module "fts4aux", used to inspect the full-text index of an fts4 table directly. Also add the "compress" and "uncompress" fts4 options. 
FossilOrigin-Name: b010ddcc52889160af2183a33c5f483bb0ae91b9
 2011-02-01 16:34:32 +00:00
drh
6ea28d6d84 Fix various compiler warnings. 
FossilOrigin-Name: c412f61229b6ab1ac90b932afd56f7c5e3ba1cfe
 2010-11-26 16:49:59 +00:00
dan
ad3acbbfb3 Remove some unused code from fts3. Add tests to fts3matchinfo.test. 
FossilOrigin-Name: ae40b34cf7c24c9601bdfb5cbe5b20f05a376ea8
 2010-11-24 11:51:56 +00:00
dan
1e66e40eb9 Experimental changes to fts3 function matchinfo(). 
FossilOrigin-Name: 9cf0f2b76bc68c168e3fa861b7235f384db21d38
 2010-11-23 19:16:47 +00:00
dan
af4c214e1f Changes to allow FTS4 tables to be created without the underlying %_docsize table (in order to save space). 
FossilOrigin-Name: 31989b18f53d97eddfb39660ef04fbf9463583e0
 2010-11-02 17:41:52 +00:00
dan
c7c91257d5 More coverage tests for fts3.c. 
FossilOrigin-Name: 7a2f2864002d4e9a487e2779ae05513880ecb4d1
 2010-10-26 07:14:25 +00:00
dan
378d0ab97b Fixes for the matchinfo() function related to FTS4 common token handling. 
FossilOrigin-Name: deb80eac9112d21835dfd3cee08ed8f09d975bf7
 2010-10-23 19:07:30 +00:00
dan
789cb8f5cf Add missing comments and fix compiler warnings in new FTS3/4 code. Other minor fixes too. 
FossilOrigin-Name: 1c9c70fec3c88319f7b2efe5316694a6ce0ab1a5
 2010-10-22 16:44:39 +00:00
dan
ca3b8f9c86 Merge trunk changes into experimental branch. 
FossilOrigin-Name: fd1e5cade04961c2f5438a1dfcc2e15eafb4503f
 2010-10-21 15:49:47 +00:00
dan
4e76cc3650 Updates to FTS4 to improve performance and make more accurate cost estimates for prefix terms. 
FossilOrigin-Name: d0a450ce78e99f55c862f26f9332786660007a0a
 2010-10-20 18:56:04 +00:00
dan
4f7c5e684a Experimental changes to fts4 to try to selectively avoid loading very large doclists. 
FossilOrigin-Name: 5ae0ba447a561e3b6637b52f9b83a9fc683d2572
 2010-10-19 14:07:59 +00:00
dan
8786f7f589 Have all FTS3 queries obtain a read or write table-lock at the shared-cache level before doing anything else. 
FossilOrigin-Name: 018e82c775d0fb8c0d90cddf7a87c20c8c8172a9
 2010-09-17 15:28:41 +00:00
drh
7bca0a3660 More commenting and documentation enhancements in FTS3. 
FossilOrigin-Name: 892e286709c4a72aae364b85dd43bea525bb1b4d
 2010-03-23 18:24:06 +00:00
drh
b4a1fed2ea Add a new full-text search variant that tracks the total number of documents 
and document sizes, to make ranking search results easier.  Currently
called FTS4.

FossilOrigin-Name: 1b6e6094c88214e02c9e3638932997ac20bfe413
 2010-02-03 19:55:13 +00:00
dan
b023b04fcb Change the fts3 snippet function to return (hopefully) more relevant snippets in less time. 
FossilOrigin-Name: 8a208223a74d451f60d9cd707d63fb7d157d1737
 2010-01-06 17:19:21 +00:00
dan
a98af17af6 Add experimental implementation of FTS3 functions matchinfo() and snippet() (not enabled by default). 
FossilOrigin-Name: 51f7ee844057086789dcfcdcba7daf45343cae62
 2010-01-02 19:02:02 +00:00
dan
3540c1f7b8 Add the experimental FTS3 matchinfo() function. Provides details of the match that may be used for result ranking and other purposes. 
FossilOrigin-Name: 37a1de02d1d8a34604f1bee896eaf579d4ba149a
 2009-12-22 18:56:19 +00:00
dan
f5fff2a7b2 Add coverage test cases for fts3. 
FossilOrigin-Name: 8fcb0478c82507403165719724b62a308cb83b57
 2009-12-12 09:51:25 +00:00
dan
b893721a45 Changes to fts3 to avoid flushing data to disk within a SELECT statement. 
FossilOrigin-Name: 48c0db0eb2d134bb302bb5eca6beb0ec46736257
 2009-12-10 16:04:25 +00:00
dan
84db21ec6a Add tests to improve coverage of fts3. Associated bugfixes. 
FossilOrigin-Name: f0eac4175aee6c50ee68acc253f76fbe44574250
 2009-12-08 19:05:53 +00:00
dan
e2e5145441 Fix an incorrect assert() in fts3.c. Add further fts3 tests. 
FossilOrigin-Name: 75863c2d55e0801add5b8dcf88d575c5c870af04
 2009-12-03 17:36:22 +00:00
shaneh
e585b8f05c Updates to FTS3 to correct compiler warnings under MSVC. 
FossilOrigin-Name: 37495b55ffbdc2db4482367ac7d8e32d4d71d58e
 2009-12-03 06:26:46 +00:00
dan
6bd3b2aa64 Use #include "sqlite3.h" instead of <sqlite3.h> in fts3Int.h. 
FossilOrigin-Name: 7737db490ceba02c29c36fe181b4e7895b40aa75
 2009-12-01 17:08:09 +00:00
dan
8c4499764b Add typedefs for i16 and u8 to fts3Int.h when not building via the amalgamation method. 
FossilOrigin-Name: fa56c1c47296c2f9ba1de9450d421dd06fde5a6a
 2009-12-01 17:05:50 +00:00
drh
65e8c82e1a Changes to the TCL interface header to allow it to be compiled independently 
from the amalgamation.

FossilOrigin-Name: 58113932d93926b4aa037a7487105a55f883cd0a
 2009-12-01 13:57:48 +00:00
drh
ff3f307cd0 Test coverage improvements in the FTS3 porter stemmer. 
FossilOrigin-Name: 6d112bfd53998b8f6693d3f2edbcd5ab4cdf5fb1
 2009-11-30 19:48:16 +00:00
dan
d313865550 Minor optimizations to fts3 code. 
FossilOrigin-Name: b456eacbbb16513d1b27e90015ea58a6dc92cc3b
 2009-11-20 02:24:15 +00:00
dan
bd61689382 Add some missing comments and fix some other issues in fts3 code. 
FossilOrigin-Name: 2fe579e778b75fbf503c02e01e5424c1926f2b49
 2009-11-18 15:35:58 +00:00
dan
f13b704ee6 Improvements to the way fts3 reads the full-text index. 
FossilOrigin-Name: 45c051e78651d8204c17cecdda2bde705698881f
 2009-11-17 12:52:10 +00:00
dan
91f0ce39e4 Further OOM testing for fts3 code. Add Tcl code implementing an integrity-check for fts3. 
FossilOrigin-Name: c27d46b33e8596b45c562c2742b05030e8899092
 2009-11-14 11:41:00 +00:00
dan
09977bb9f0 Start reworking fts3 code to match the rest of SQLite (code conventions, malloc-failure handling etc.). 
FossilOrigin-Name: 30a92f1132801c7582007ee625c577ea2ac31cdf
 2009-11-13 10:36:20 +00:00