dan 95dca8d0cf FTS5 does not handle tokens that contain embedded nul characters. Prevent the trigram tokenizer from returning such tokens. Fix for [2ba5930b2]. ...

FossilOrigin-Name: b1d048748c054575425a4bebf0c5d09962f9329d5ce6a978cf54e508b238584c

2020-10-03 14:36:06 +00:00

..

test

FTS5 does not handle tokens that contain embedded nul characters. Prevent the trigram tokenizer from returning such tokens. Fix for [2ba5930b2].

2020-10-03 14:36:06 +00:00

tool

Add the -trigram option to the fts5txt2db.tcl script.

2020-10-01 17:15:12 +00:00

extract_api_docs.tcl

…

fts5_aux.c

…

fts5_buffer.c

…

fts5_config.c

Add experimental unicode-aware trigram tokenizer to fts5. And support for LIKE and GLOB optimizations for fts5 tables that use said tokenizer.

2020-09-30 20:35:37 +00:00

fts5_expr.c

Add tests for the trigram tokenizer. Fix minor issues.

2020-10-01 16:10:22 +00:00

fts5_hash.c

Fix a problem in fts5 causing the in-memory hash table to be flushed more often than necessary.

2020-09-17 15:16:50 +00:00

fts5_index.c

In fts5 integrity checks, do not compare the contents of the index against an external content table unless specifically requested.

2020-09-21 14:53:21 +00:00

fts5_main.c

Add experimental unicode-aware trigram tokenizer to fts5. And support for LIKE and GLOB optimizations for fts5 tables that use said tokenizer.

2020-09-30 20:35:37 +00:00

fts5_storage.c

In fts5 integrity checks, do not compare the contents of the index against an external content table unless specifically requested.

2020-09-21 14:53:21 +00:00

fts5_tcl.c

…

fts5_test_mi.c

…

fts5_test_tok.c

…

fts5_tokenize.c

FTS5 does not handle tokens that contain embedded nul characters. Prevent the trigram tokenizer from returning such tokens. Fix for [2ba5930b2].

2020-10-03 14:36:06 +00:00

fts5_unicode2.c

…

fts5_varint.c

…

fts5_vocab.c

Avoid an infinite recursion on an illegal recursive definition of an

2020-02-16 17:40:35 +00:00

fts5.h

…

fts5Int.h

Add experimental unicode-aware trigram tokenizer to fts5. And support for LIKE and GLOB optimizations for fts5 tables that use said tokenizer.

2020-09-30 20:35:37 +00:00

fts5parse.y

…

mkportersteps.tcl

…