sqlite/fts3 at d4ddae985bb3638ce6ffa43a2823b5874914b6f3 - sqlite - SynapseOS git

mirrors/sqlite

History

dan a4bbc8b119 Add the "languageid" hidden column to fts4aux.

FossilOrigin-Name: 891df358e51075fb937f34952ce43bf51130b0d0

2013-10-15 19:06:17 +00:00

..

Add output of PRAGMAs auto_vacuum and encoding to the "schema" command of the

2012-03-27 18:00:05 +00:00

Up until now the fts4 "unicode61" tokenizer has treated all private use codepoints except the first and last of each of the three ranges as alphanumeric (eligible to be part of tokens). This commit fixes this so that all private use codepoints are considered alphanumeric. In other words, it fixes the handling of codepoints 0xE000, 0xF8FF, 0xF0000, 0xFFFFD, 0x100000 and 0x10FFFD.

2013-06-05 16:17:21 +00:00

fts3_aux.c

Add the "languageid" hidden column to fts4aux.

2013-10-15 19:06:17 +00:00

fts3_expr.c

Add the SQLITE_FTS3_MAX_EXPR_DEPTH compile time option.

2013-06-11 14:22:11 +00:00

fts3_hash.c

…

fts3_hash.h

Many spelling fixes in comments. No changes to code.

2013-03-21 21:20:32 +00:00

fts3_icu.c

Make sure substructure elements have proper alignment in the ICU tokenizers

2012-10-19 02:10:53 +00:00

fts3_porter.c

…

fts3_snippet.c

Add some extra assert() statements to silence a few clang warnings.

2013-08-19 18:17:03 +00:00

fts3_term.c

Fix harmless compiler warnings on x64 MSVC, mostly in test code, but also in

2012-04-19 18:04:28 +00:00

fts3_test.c

Many spelling fixes in comments. No changes to code.

2013-03-21 21:20:32 +00:00

fts3_tokenize_vtab.c

Fix a couple of harmless compiler warnings in the fts3_tokenize virtual

2013-05-08 17:06:28 +00:00

fts3_tokenizer1.c

…

fts3_tokenizer.c

Many spelling fixes in comments. No changes to code.

2013-03-21 21:20:32 +00:00

fts3_tokenizer.h

Many spelling fixes in comments. No changes to code.

2013-03-21 21:20:32 +00:00

fts3_unicode2.c

Up until now the fts4 "unicode61" tokenizer has treated all private use codepoints except the first and last of each of the three ranges as alphanumeric (eligible to be part of tokens). This commit fixes this so that all private use codepoints are considered alphanumeric. In other words, it fixes the handling of codepoints 0xE000, 0xF8FF, 0xF0000, 0xFFFFD, 0x100000 and 0x10FFFD.

2013-06-05 16:17:21 +00:00

fts3_unicode.c

Many spelling fixes in comments. No changes to code.

2013-03-21 21:20:32 +00:00

fts3_write.c

Fix compilation issue with MSVC.

2013-10-07 21:49:16 +00:00

fts3.c

Fix a crash in FTS incremental phrase processing that can occur if the second or subsequent token is much more common in the dataset than the first.

2013-10-14 20:30:51 +00:00

fts3.h

…

fts3Int.h

Add a test to check that the new multi-token phrase optimization is actually helping.

2013-10-02 08:04:27 +00:00

fts3speed.tcl

…

mkfts3amal.tcl

…

README.content

…

README.syntax

…

README.tokenizers

Change the name of the "unicode" tokenizer to "unicode61" to emphasize that the case folding and separator-character identification routines are based on unicode version 6.1.

2012-05-26 14:54:50 +00:00

README.txt

…

README.txt

This folder contains source code to the second full-text search
extension for SQLite.  While the API is the same, this version uses a
substantially different storage schema from fts1, so tables will need
to be rebuilt.