mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,836 Commits 1,487 Branches 166 Tags 416 MiB
60ce5d3135
Commit Graph

7130 Commits

Author SHA1 Message Date
dan
e105dd7622 Fixes for "ROWS BETWEEN <expr> FOLLOWING AND <expr> FOLLOWING" and "ROWS 
BETWEEN <expr> FOLLOWING AND UNBOUNDED FOLLOWING"

FossilOrigin-Name: 5ac44872fd5c4f92851e7bf57d7207bb4d67de88ea2b5c746ff97f20bd6352e1
 2018-05-25 09:29:11 +00:00
dan
31f5639fb7 Allow "<expr> PRECEDING" to be used to specify the end of a window frame. 
FossilOrigin-Name: 7b709a989c188dbcf429989a0785294b36c8a7e89b5de8cefc25decf1f5b7f5a
 2018-05-24 21:10:57 +00:00
dan
99652dda3c Support other frame types that use "<expr> PRECEDING" or "<expr> FOLLOWING" as 
start or end conditions.

FossilOrigin-Name: ec7b648c7f0ee266653561bbb9daa45b9be0d8a1a14f11dc93bce467c35154e6
 2018-05-24 17:49:14 +00:00
drh
cf8784cd8f Addition cases for rtree preformance testing in speedtest1.c. Add the 
--nodiff option to the speed-check.sh script.

FossilOrigin-Name: 95f2d62cf3cf8dbe0f12b652b47fe1f8e0f52bc269e269955fafdf802afc47c1
 2018-05-24 16:18:35 +00:00
dan
c3a20c19a8 Add support for "ROWS BETWEEN <expr> PRECEDING AND <expr> FOLLOWING" window 
frames.

FossilOrigin-Name: 3a203660f1e4da3b8d2d605c494f4843f6e00752f28042b49e11d7d6550dd406
 2018-05-23 20:55:37 +00:00
drh
186ebd41cf Verify that the sqlite_sequence table exists and is in approximately the 
correct format prior to using it to process an autoincrement table.
Fix for ticket [d8dc2b3a58cd5dc2918a1d4a].

FossilOrigin-Name: e199e859ace4f8381c6380175206e7a276e3f2228fadbbca9341bca8d2fc445d
 2018-05-23 16:50:21 +00:00
dan
8471be3311 Add comments to window.c describing how other window frames will be implemented. 
FossilOrigin-Name: 16168146b202915252f9375aef38e65ca20c5d4aa906e851d4d3a484db57562d
 2018-05-22 20:35:37 +00:00
dan
f9eae18b56 Begin adding support for more esoteric window frames. 
FossilOrigin-Name: bc4b81d60d40583de0f929730159011c1a7696802532ebd02220de3ace94a60d
 2018-05-21 19:45:11 +00:00
dan
b6e9f7a4d1 Fix minor problems on this branch. 
FossilOrigin-Name: 19c2e4b2f164521eab84cb0a0e12984be9431eaedd001dd3671e9ea1a6212353
 2018-05-19 14:15:29 +00:00
dan
e2f781b9d1 Evaluate multiple window functions in a single pass if they use the same 
window definition. Add xValue callbacks for other built-in aggregate
functions.

FossilOrigin-Name: c9f0f140941660ff368e5bb5752d54feb1964b7a9eac986d4bfb8f24a1c20d86
 2018-05-17 19:24:08 +00:00
dan
2e362f9775 Handle multiple window-functions in a single query. 
FossilOrigin-Name: 35af0b750e70dcf0f343b115f4bbd0860a7e8064be204d4dfba1a43c22ff07b1
 2018-05-17 14:26:27 +00:00
dan
86fb6e1738 Start of experimental implementation of SQL window functions. Does not yet 
work.

FossilOrigin-Name: 3781e520854808fe02ad3fe77dd11fc917448c58ff1fd79123289dd91937decd
 2018-05-16 20:58:07 +00:00
drh
dd7460f0fd Correct output for the fullkey column of json_each() when the total JSON 
input is a simple value, not an array or object.

FossilOrigin-Name: b45b18850c59f22a163ee482f529f578a8798f96d0e26b5a061d336d480a1540
 2018-05-16 12:19:11 +00:00
dan
a44005af4f Fix a test case problem in wherelimit.test. 
FossilOrigin-Name: 3012df8b2c0b19d27260f389147a96c501aee9a4aee3813834cc9e438dbacede
 2018-05-15 09:09:00 +00:00
drh
69ed38a822 Add the --append option to the ".backup" command in the CLI. 
FossilOrigin-Name: 0dfdbdee527b0c429703bc2696bf8d8e44a852aafe0aca742b9d7152eb1f932e
 2018-05-14 00:23:08 +00:00
drh
f2cf412a0a Fix a harmless compiler warning in fuzzcheck. Add new OSSFuzz test cases 
to the test case library.

FossilOrigin-Name: d2619746cb233f4be127a77988548dd1d90eebddf0d0ac9107913b240553e5d0
 2018-05-08 13:03:31 +00:00
drh
5ecf9039b0 Fuzz test cases for UPSERT. 
FossilOrigin-Name: fd11fbd21893d520de5a2249f825ecb5839fa4943f5c207e9e9bf8b52f4e2695
 2018-05-08 12:49:53 +00:00
drh
e3c05a5597 On an UPDATE, try to overwrite an existing btree cell with the modified 
content, if the old and new cell are the same size.  Use memcmp() first
to avoid dirtying pages that are unchanged.

FossilOrigin-Name: 5887d8beb502ad62689d31b850f46ab50831a1e9db36adf20d55ad45619d207e
 2018-05-07 11:48:22 +00:00
drh
c6f36fa33a In an ORDER BY LIMIT, make sure the ORDER BY expression evaluator does not 
try to reuse values from the result set if the result set has not yet
be computed.  This fixes a bug in the recent deferred-row loading 
optimization, check-in [c381f0ea57002a264fd958b28e].
OSSFuzz discovered the problem.

FossilOrigin-Name: 5d61e75f32de09c81dbe844443209f063cccb005d60b846900de5b023643fc3b
 2018-05-05 16:50:35 +00:00
drh
cb737dc29e Merge enhancements from trunk. 
FossilOrigin-Name: 9650f71b82ca1b3759e776bbd8a2e8ca61c51f80038e37c9c9a675a8c13b0b06
 2018-05-04 19:18:27 +00:00
drh
e3d511c078 Fix requirements marks. No code changes. 
FossilOrigin-Name: 7fdad122a21e4b01bd678198fd5131dc32febe3af366bd6368505398255f9822
 2018-05-04 18:32:11 +00:00
drh
5d72d9245d Make a separate limb in the EXPLAIN QUERY PLAN output for the various lines 
associated with the OR-optimization.

FossilOrigin-Name: 75ac7b4e4fd0811ca80c719badacff207e0bbd00ac64dde3b3d4ec676fad472d
 2018-05-04 00:39:43 +00:00
drh
98b677f2cb Overhaul of EXPLAIN QUERY PLAN. The output is now in the form of a tree. 
More details of the query plan are shown, and what is shown is truer to what
actually happens.

FossilOrigin-Name: ff01bbdabc4b9db3db8b928979442c91b32d72082158e4f5fe62ae51a73649d2
 2018-05-03 19:56:50 +00:00
drh
d5aa9262a6 Fix various error handling conditions on the cell overwrite optimization. 
Fix a test case so that it works with the new optimization.

FossilOrigin-Name: f89b54f41405ed7e28132f66b8a0c690a087c2412c8f55790c2beabb0b521645
 2018-05-03 16:56:06 +00:00
drh
fa16f5d9d6 Enhance EXPLAIN QUERY PLAN to report the generation of constant rows using 
VALUES or just a SELECT without FROM.

FossilOrigin-Name: c75eee69fa8a9b56ee58a4cc539e80cc982f43390dc3a357344d58479dd89a41
 2018-05-03 01:37:13 +00:00
drh
cdf88760da More test case updates. Tests are all running now. 
FossilOrigin-Name: dab5e5294813891469660cceb211ac1a1e526715bb57dcdbb1ab90321e6a4dad
 2018-05-02 19:42:33 +00:00
drh
b3f0276b9e Fix test cases so that they work with the new EXPLAIN QUERY PLAN output 
format.  Only some of the cases have been fixed.  This is an incremental
check-in.

FossilOrigin-Name: 5f0e803e33aa557865d5fc830d9202d628de9a94c9757058ca48f1a560702cd3
 2018-05-02 18:00:17 +00:00
drh
03c3905f94 Fix a dangling-else problem that was causing recursive CTEs to malfunction. 
Begin fixing test cases to work with the new EQP output.

FossilOrigin-Name: 82ca44b82fed6814c84440ba8bfaa019488ab956e84ac165180e2fcece6facb2
 2018-05-02 14:24:34 +00:00
dan
fa5c69f5cb Fix a problem in the xBestIndex method of the closure extension causing it to 
allocate non-contiguous argvIndex values in some cases (an "xBestIndex
malfunction" error).

FossilOrigin-Name: 0c67150749cb3d067e14b2dcac9c3489e0f14bd18c0387f1d9bc93d21fc96fe5
 2018-05-02 08:12:22 +00:00
drh
b57e3ec5d8 Test cases added for SQLITE_DBCONFIG_RESET_DATABASE. 
FossilOrigin-Name: 08665a9e2e50a0a1e62529884cf65f8090debe89a306a3904b53268729ab5ad5
 2018-04-28 19:08:02 +00:00
drh
6bfd973ce6 Fix compiler warnings in FTS3. 
FossilOrigin-Name: de508e831a43f02c3b354a24ea34798da03c163bae5521c852c9ddd252723739
 2018-04-28 04:10:55 +00:00
dan
03db962ab5 Update test script fts3expr4.test so that it always creates fts3 tokenizers in 
the "en_US" locality.

FossilOrigin-Name: 576a8f69ae25883f752e58953624e9f7126db998bebaa1f07f7c2ec47aaecabe
 2018-04-27 18:05:01 +00:00
dan
0ef54fa6e8 Fix a test script error causing tests to fail in soak.test. 
FossilOrigin-Name: 462b52b121c1882e0eca819bc30c0f6e94d7fdd60047d2c32adeff3a1eb70546
 2018-04-27 16:35:44 +00:00
drh
6876dccbfe The previous fix for ticket [d85fffd6ffe856092ed8da] in check-in 
[0a514e62ad1ebe5c12da8dae] did not completely address the
probably in that it only worked for cases where the OP_SCopy that loaded
the register was the last instruction in the sequence for the expression, which
is not necessarily the case for expressions like CASE...END.  This revision
prevents the registered that will be recomputed from being cached in the first
place.

FossilOrigin-Name: 9fd0faf517993587d2f54212638545fc85fbbc84a031bcfae8c1e5894825d83b
 2018-04-26 18:34:26 +00:00
drh
909066bba0 Ensure that new.* values of an UPDATE do not get clobbered after the 
BEFORE triggers run when unmodified columns of the row being updated are
reloaded.  Fix for ticket [d85fffd6ffe856092ed8da]

FossilOrigin-Name: 0a514e62ad1ebe5c12da8daed429ae2f9d9910471d3c5cef3b6870bdadfefca1
 2018-04-26 15:50:10 +00:00
drh
de7ca50dac Clarification of the behavior of a BEFORE UPDATE trigger when the trigger 
changes the values of some of the columns used to compute new columns in
the UPDATE.

FossilOrigin-Name: 7bb23c2a3d37f0d5e5515b917860818906819d54a0066e1ba8e9792a82f7d279
 2018-04-26 15:04:18 +00:00
dan
1e08074906 Update the "fuzz_malloc.test" script to print SQL statements in which OOM 
handling problems are found to stdout.

FossilOrigin-Name: a956363cf6881be590120c7718976b54b12c4bd0d9228d8142b45e0fe1826f7e
 2018-04-26 08:56:40 +00:00
dan
ccb9eb782c Remove a recently added NEVER() macro from a branch that can be taken in 
obscure circumstances.

FossilOrigin-Name: 2aa210030ae414782adab9291cc43a149a780f39bd3d306dc2892a8c20422a51
 2018-04-24 18:59:18 +00:00
dan
820fcd2ce9 Fix a problem with processing "LEFT JOIN tbl ON tbl.a = ? AND (tbl.b=? OR 
tbl.c=?)" in cases where there are indexes on both tbl(a, b) and tbl(a, c).

FossilOrigin-Name: ce35e39c5cc2b00dd6b4a9ffaa9d5eb7d9b862759e87d5f053729de7643eee9c
 2018-04-24 18:53:24 +00:00
drh
c447595df5 Do not attempt to use terms from the WHERE clause to drive indexes on the 
right table of a LEFT JOIN.  Fix for ticket [4ba5abf65c5b0f9a96a7a40cd18b]

FossilOrigin-Name: aeb694e3f787f1f8b55650c17f90c197eee3f7f9b890a88f458c33e43009a082
 2018-04-24 17:34:03 +00:00
drh
cb23e5d5d1 All the OR optimization to proceed even if the OR is also converted into 
an IN operator.

FossilOrigin-Name: e252c6540db266b93beeb47a8f7dbf3b275f8c782cd2d36ba4c00648c382f63f
 2018-04-24 16:41:37 +00:00
dan
4da04f784f Do not attempt to read values from indexes-on-expressions if the index is on 
the RHS of a LEFT JOIN. This won't work if the index cursor points at a
null-row. Fix for [7fa80496].

FossilOrigin-Name: b8ef967ab1bebf2846c06c4f7200d6fa1c60e52e55711ea171c25ef1331f8a24
 2018-04-24 14:05:14 +00:00
drh
4d3e61403a Fix a memory leak following failure to open an external CSV file in the 
csv.c extension.

FossilOrigin-Name: 526ee07d19dbc8fd1af3a02a8da12b337020a4be40e045da9a19d0a7c2b6ab54
 2018-04-24 10:57:10 +00:00
drh
8349c11d02 In EXPLAIN QUERY PLAN output, do not show an EXECUTE LIST SUBQUERY line for 
IN operators where the RHS is a list and not a subquery, since in that case
there is no SUBQUERY to execute.

FossilOrigin-Name: 8bc0207abdeeb3ffac003703e78826759f07994698f6cdf40c89c3443ba22a47
 2018-04-24 01:10:12 +00:00
drh
f49ff6ffb3 Fix a problem in sqlite3ExprCompare() associated with UPSERT. 
FossilOrigin-Name: 67d0b2c15299dd20bca7254ecb33e71b5eee6024e2709bfdc36f877bf2a5679f
 2018-04-23 20:38:40 +00:00
dan
42d181604c A few more tests for upsert. 
FossilOrigin-Name: b78005b6d41640203c163ffde4faf9336f11f47f42e8b7fe10b95415bbaed028
 2018-04-21 14:11:18 +00:00
drh
f3d7bbb767 Fix UPSERT so that it plays nicely with AUTOINCREMENT. 
FossilOrigin-Name: 359725ab36339b443b7745e84f6d27991038ceb063c653805dde17f3eb5a03c5
 2018-04-21 03:06:29 +00:00
dan
224d92c8c0 Add tests for name resolution in ON CONFLICT clauses. 
FossilOrigin-Name: cf253584ecf7aed04406b4bae78b536818fadfb3fb96c05f2c99954b841db85f
 2018-04-20 17:50:49 +00:00
dan
a46838cb13 Add test cases for UPSERT. And a fix for a "REPLACE INTO ... ON CONFLICT" 
statement where the new row conflicts with both the IPK and the ON CONFLICT
indexes.

FossilOrigin-Name: d8eb9f8d9b61400c7e12f01ef5c233257b03532221f7c7a8386f7ac2db439626
 2018-04-20 15:34:08 +00:00
drh
7963691314 Fix the handling of "PRAGMA count_changes=ON" with UPSERT. Also improved 
the implementation of count_changes in other places, without changing the
behavior.

FossilOrigin-Name: c6f71115eb933c2aee295bc31e5139112463c28e15a3b3ea242fd9bac168aed9
 2018-04-19 23:52:39 +00:00
dan
a67d02f509 Modify a test case in zipfile2.test to take into account that with some 
platform/file-system combinations it is possible to fopen() and fread() (but
not fwrite()) a directory.

FossilOrigin-Name: 893e6089c875e947ddadb23f031a81bc36da8b060d2212363098992ddb90378b
 2018-04-19 20:06:10 +00:00
drh
482dc64505 Add the --upsert option to the wordcount test program. 
FossilOrigin-Name: ee1e750baaf4c66b4e1f103d8b80362f57e711ac601e57f99ed6a33913f443d2
 2018-04-19 16:52:37 +00:00
drh
bb6b1ca73d Fix a problem in the new upsert implemention, discovered by OSSFuzz. 
FossilOrigin-Name: b6d5ea59fe83716f464e408b7eef0310c6d30b3493e3f966362db2e30b36e821
 2018-04-19 13:52:39 +00:00
drh
5e3a6ebf34 Fix the table name aliasing on INSERT so that it occurs before the column list 
rather than afterwards, just as it does for PostgreSQL.  Add table name
aliasing to UPDATE and DELETE.

FossilOrigin-Name: 861a2e2a4895f96a5d8e1730e744983b2ac4311d0c2cf201c0e59f409030d5d7
 2018-04-19 11:45:16 +00:00
dan
dedff6be8a Add the "sorter-reference" optimization, allowing SQLite to be configured so 
that some required values may be loaded from the database after external
sorting occurs for SELECT statements with ORDER BY clauses that are not
satisfied by database indexes.

FossilOrigin-Name: ef74090a40ceaef2fd93a7613ec99a191ce986811c852e96f4a19719f18af4f0
 2018-04-18 19:56:14 +00:00
dan
52b3e340cc Minor changes to test script upsert4.test. 
FossilOrigin-Name: 0cb83c84d10b89ef7a5504862566a609307c63e7571dd711d8b9f995d29e5a8c
 2018-04-18 19:45:14 +00:00
drh
4e8b9925bf Fix a test case inside distinct.test. 
FossilOrigin-Name: 61cb8a391a0c709340ac60ffd0c58f950567892a8404c2bec7b9b1f64b3cc5cf
 2018-04-18 18:19:25 +00:00
dan
370c32628f Add extra test cases for UPSERT. 
FossilOrigin-Name: 7ea08d0750dd9e07d2ffea336127034800db14aa23e60adec384d338871bf53a
 2018-04-18 17:56:37 +00:00
drh
6651e10ee7 Add support for PostgreSQL UPSERT syntax and functionality. 
FossilOrigin-Name: fba24aec235dd6f124c1ece66cdac485c9d96e0578c4fbacd8f49d7b767a5b4a
 2018-04-18 16:03:36 +00:00
drh
3bc431550a Enhance ALTER TABLE ADD COLUMN to support "DEFAULT true" and "DEFAULT false". 
FossilOrigin-Name: 594ebc69557095c9262db39129dd50a3dbf038556a3d2a3ea69b82ed4c61e2b9
 2018-04-18 11:35:35 +00:00
dan
2cc00423a0 Add some more simple test cases for UPSERT. And a minor fix. 
FossilOrigin-Name: 27cd3b2fb2ad0cf2b36741bd1057cb7973954d40456e9db158261a38b049d2b5
 2018-04-17 18:16:10 +00:00
drh
5015c9b50e New test cases for upsert. 
FossilOrigin-Name: 907b5a37c539ea67c285c87399b494c7fe15014389a2ea3d49e90640b58946ae
 2018-04-17 16:16:40 +00:00
dan
2e3a5a810a Add SQLITE_CONFIG_SORTERREF_SIZE configuration option. 
FossilOrigin-Name: b25a7bb769b8397a00736bd922bd24b1200b2f82d36d42ecb4c3eb17efb4b84d
 2018-04-16 21:12:42 +00:00
dan
24e25d32ce Experimental change to "SELECT * FROM ... ORDER BY" processing to load some 
column values from the db after sorting.

FossilOrigin-Name: 9719cb46bbf501ce80f185159d594f593dd0b2639b9ef5a71a6c7b70046cb08d
 2018-04-14 18:46:20 +00:00
drh
c8a0c90b62 Get the ON CONFLICT DO NOTHING form of upsert working by mapping it 
into INSERT OR IGNORE.

FossilOrigin-Name: d07f05e98bb9ce0f9b46db159d9df161b7499d6face6a5299ecd2d00a94fb8d0
 2018-04-13 15:14:33 +00:00
drh
d5af54207d Get the conflict-target clause parsing working correctly, with test 
cases.  This change involves an enhancement to sqlite3ExprCompare() which
needs to be reviewed on trunk prior to merging.

FossilOrigin-Name: 5bf704256206f84b3db7a5d8523215604eeb218ef8db86316d1e43ecd7248d6a
 2018-04-13 14:27:01 +00:00
drh
3b45d8bfb7 Improved conflict-target matching logic. 
FossilOrigin-Name: 98d32ba661f4ba662b639994b74352b695d53a33bc8a498bd09b9e02f794c81e
 2018-04-13 13:44:48 +00:00
drh
e9c2e772f1 Back off of the extended upsert syntax that allows multiple ON CONFLICT 
clauses.  The syntax now is exactly as in PostgreSQL and MySQL.  Add support
for WHERE clauses on the conflict-target phrase, for partial indexes.

FossilOrigin-Name: 2c1b1987d8de1efa8ed7e1f199710e32ff20edf8ceec570514fc63bb1ef264e0
 2018-04-13 13:06:45 +00:00
drh
788d55aa77 Begin adding upsert logic. This is an incremental check-in. 
FossilOrigin-Name: 809696434097e62e8ef486c7478b5eb62c0cf1342522a5584939fade82821410
 2018-04-13 01:15:09 +00:00
drh
84fbff18d0 Prohibit bound parameters in the arguments to table-valued functions within 
a trigger.  Problem discovered by OSSFuzz.

FossilOrigin-Name: b7178209152452e82f5908513385018524472640d67547927d6b4c0aa0c15a46
 2018-04-11 16:04:01 +00:00
dan
0493222ff8 Fix a problem causing the LEFT JOIN strength reduction optimization to be 
incorrectly applied in some cases where the WHERE clause of the query contains
a filter expression of the form "lhs.x IS NOT ?".

FossilOrigin-Name: 1fdaf2c34431adcac1c7ff29aae0623c4cbaa6a7f38e843c786bd407d8b3e730
 2018-04-10 15:31:56 +00:00
dan
a1054dcc3f Fix a problem causing the LEFT JOIN strength reduction optimization to be 
incorrectly applied in some cases where the WHERE clause of the query contains
a filter expression of the form NOT(x AND y). Ticket [1e39b966].

FossilOrigin-Name: 38d319c153641ea4138fab2d5a47c31a86f57a071a1e1c299ca54c980cfb2b60
 2018-04-10 12:10:01 +00:00
dan
9a3c375fce Fix an instance where an uninitialized VM register might be accessed. Fix for 
[093420fc0]. This problem was found by OSSFuzz.

FossilOrigin-Name: a3b02db74681a215996c5ed110eb0ece5ed24f71a1b131c10e9f33e666af0256
 2018-04-05 16:26:39 +00:00
mistachkin
33fc27790a Fix segfault in 'eval.c' extension when used with 'empty_result_callbacks'. 
FossilOrigin-Name: e8b87bd4954437041139344d6d1ce3e4aace40ea6891b70f9c20cd95671270e7
 2018-04-04 12:21:33 +00:00
drh
b14e6de579 Fix an error message in speedtest1.c and make the "trigger" testset sensitive 
to the --size parameter.

FossilOrigin-Name: 5a6fd9e0156a14e6509c4ea713c4b332b2d050432b49571c7a45a7ecc7cb5da4
 2018-04-03 20:44:53 +00:00
dan
b278c594f1 Update speedtest1.c with new testset "trigger" based on the tests in 
speed4p.test.

FossilOrigin-Name: 7b7fa5fa0dd0dcef759ce1e22ade3a4e5fc8e8a244eac19b1abcc96d89c99721
 2018-04-03 20:00:09 +00:00
dan
22f60b847c Fix a few small test script issues affecting SQLITE_TEMP_STORE=3 builds. 
FossilOrigin-Name: e171f3722f78c58d2f20443e3bbcce2bd9701b8537f6e8d482ae804154d7a17f
 2018-04-03 17:05:13 +00:00
dan
4f9a7e5cb7 Fix an assertion failure triggered by a SELECT with a compound sub-query that 
contains an incorrectly placed ORDER BY clause. This problem is just an
assert() failure - non-DEBUG builds are not affected. Problem found by
OSSFuzz.

FossilOrigin-Name: 823779d31eb09cda5effe747d9adb35e600a52d4274226586437f674e7824d91
 2018-03-31 16:31:51 +00:00
dan
d99f49fcc9 Another change to test file zipfile.test to help it run on systems without "unzip". 
FossilOrigin-Name: b6252feb125db16dabf6ce07568159f0002f9053df1b7b600e2614cc9da24873
 2018-03-29 23:54:00 +00:00
dan
a8728e7428 Fix a test script bug causing zipfile.test to fail on systems that do not have 
the "unzip" program installed.

FossilOrigin-Name: d99022a5a8e4469a87a9fab8a976271e5785524da73ac1d2fae47d00d90fc07a
 2018-03-29 16:39:09 +00:00
dan
d88690bd10 Update memdb1.test so that it works with SQLITE_DEFAULT_AUTOVACUUM builds. 
FossilOrigin-Name: d67f1c7d18d076b18e327ae4e3bccf6086b8f3fd370a7550d77753fc1f1ce07f
 2018-03-29 11:02:19 +00:00
drh
928ba14904 Fix a harmless compiler warning in the kvtest.exe program. 
FossilOrigin-Name: d48972cf873f8e2499f7c77f8062fde439e7426b616514c147810763469d7c6a
 2018-03-28 22:08:44 +00:00
dan
3a95c65e37 Add -DSQLITE_ENABLE_DESERIALIZE to the "Device-Two" configuration in 
releasetest.tcl.

FossilOrigin-Name: 765a014d8e91be18ac0f12f0fe94f4126bf8ce101f5c9d7f234376e2368f6db3
 2018-03-28 20:29:04 +00:00
drh
6a9b9527fa The push-down optimization was being too aggressive such that it sometimes 
generated incorrect results.  Reinstate the restriction (4) (with
qualifications) that was removed by check-ins
[b5d3dd8cb0b1e4] and [dd568c27b1d765].

FossilOrigin-Name: f08c1731b0b1dddcba190b094a35306a159713d3db939330f73075ff1d72c81e
 2018-03-27 15:13:43 +00:00
dan
b948948542 Fix a typo preventing test script avtrans.test from running in auto-vacuum 
mode.

FossilOrigin-Name: c7473bdb1055df06dc6a93a39ba7f56116f6866292784c4938d843531500c368
 2018-03-26 17:56:39 +00:00
drh
e3eff266bc Yet another fault in the sqlite3ExprImpliesNotNull() routine, causing errors 
in the LEFT JOIN strength reduction optimization of check-in
[dd568c27b1d76563].

FossilOrigin-Name: e88cf3d4df64097ebc19aae464b88d0faf9b7d4c30d057042b582d78327e7ad3
 2018-03-24 15:47:31 +00:00
dan
07f119e470 Fix a test script problem causing shell1.test to fail with 
-DSQLITE_OMIT_VIRTUAL_TABLE builds.

FossilOrigin-Name: 2e06906e0959e1256fc2feb9dc2c3a9d1e9c19c4ba59585fe52df9af174ab443
 2018-03-24 15:08:48 +00:00
drh
2c492061ce Bug fix in the LEFT JOIN strength reduction optimization of 
check-in [dd568c27b1d76563].  The sqlite3ExprImpliesNotNull() routine was
mistakenly assuming that a CASE expression must always be NULL if contained
any reference to a variable that was NULL.

FossilOrigin-Name: cf171abe954a5f25262161dd69f2e8cecdbf9446c3f6b298201507dbc743567e
 2018-03-24 13:24:02 +00:00
mistachkin
cf847d44ac Add some more tests for the IS TRUE / IS FALSE operators. 
FossilOrigin-Name: 9fe5bebefe909288e583226b5dc32e0465f6b2d8eda850d01820e3f1f8091ddd
 2018-03-23 14:56:05 +00:00
mistachkin
9d107262e4 Enhance .schema in shell to enable matching patterns with literal underscores. 
FossilOrigin-Name: 98e3f5247a6012f58642a2fcdc9be062f7afe8f2e154d06007f4935a0fd87aac
 2018-03-23 14:24:34 +00:00
drh
cedfecf90a Fix the ANALYZE command so that it will process tables whose names begin 
with "sqlite" as long as they do not being with "sqlite_".

FossilOrigin-Name: 0249d9aecf69948d9343feef9291273beef5fc98aa9a8f95b1e35cc2ce8e6cbd
 2018-03-23 12:59:10 +00:00
drh
c6c5ab80ee Add the left join strength reduction optimization. Enhance the push-down 
optimization so that it works with many LEFT JOINs.

FossilOrigin-Name: dd568c27b1d7656388ea5b4132cc0265aedd7348d265d8e8c7412b00b28a31aa
 2018-03-22 12:00:43 +00:00
drh
66651c2b4b Add the --valid-sql option to the optfuzz test program. 
FossilOrigin-Name: a8dfeec73b069f2dd7371c2792b36f152945d32120843db5361ff7e04de177bc
 2018-03-22 11:28:31 +00:00
drh
00f0375df7 Get the optfuzz program working. 
FossilOrigin-Name: 21346bbce9fd161e8a2037834a6e8eb443a901109ddb3a52c1b7a29000ffeac8
 2018-03-21 20:21:29 +00:00
drh
30f30133d7 Add the optfuzz.c program for verifying the query planner using a fuzzer. 
This is an initial code check-in.

FossilOrigin-Name: 3fb21251b0c9c731513e8fb137867c2710a77d99411c99348d3ac45d3babffd7
 2018-03-21 19:25:59 +00:00
drh
efce69de37 Do a more thorough job of cleaning erasing traces of the strength-reduced 
LEFT JOIN.

FossilOrigin-Name: 08833dda3a25965cc509d0244d7cd68bdb2306351ca52862f347e1efe5db4508
 2018-03-20 22:52:27 +00:00
drh
2589787c5a If terms of the WHERE clause require that the right table in a LEFT JOIN 
not be a null row, then simplify the LEFT JOIN into an ordinary JOIN.

FossilOrigin-Name: 5b7abecc7ab8ccbbb8cb5e0f672e67625c2555ad03442efbf34cb395f5bb71a8
 2018-03-20 21:16:15 +00:00
drh
f6e6f02308 Fix incorrect testcase labels on two cases in join5.test. No changes to code. 
FossilOrigin-Name: 4661ac81c9589b06a07df8b7931fbd0a7f9a4e9ba1448192b70701dc85a29bd2
 2018-03-20 19:02:03 +00:00
dan
93c803e960 Fix handling of "UPDATE OR REPLACE" statements run on zipfile virtual tables. 
FossilOrigin-Name: 9a5ef341de2bd2fc4657a510f48159f7876f58d340b457b4272a71d389f88da3
 2018-03-20 13:26:01 +00:00
dan
d30830e42d Add a test case for the fix on this branch. 
FossilOrigin-Name: 7834cf6c28c63f6ca0e29a508c0f6e3ec9c5c48715344c2db99a9866e92ef205
 2018-03-20 12:12:06 +00:00
mistachkin
2cc8f4831e For 'zipfile', detect attempts to cause a duplicate entry via UPDATE. 
FossilOrigin-Name: cf78a882799424610209e9ac5e76771db3f5e6704ffa181f9598eb0986d93eb8
 2018-03-17 02:13:13 +00:00
mistachkin
d42d8ae337 Another Win32 portability fix for the 'zipfile' tests. 
FossilOrigin-Name: 9f604418ca21472d84d754f4c3b7f170e5c2bff05e8cee86640e45b43bc53a49
 2018-03-17 00:44:29 +00:00
mistachkin
b5a4a7053b Enable more 'zipfile' tests on Win32. 
FossilOrigin-Name: 49d2566c8e7d0df37494ee001fc6eae5f47f95e16f6a575f2d8d6777b62e6068
 2018-03-16 23:54:26 +00:00
mistachkin
3c6de3266e Make a couple tests less sensitive to timing. 
FossilOrigin-Name: bc2af8e0aa28d8d10612ab9464c008a970348b4720bb34d0c546d341e2bc09e0
 2018-03-16 23:54:12 +00:00
mistachkin
2d44d556b5 Fix a duplicate test number and cleanup a bit of Makefile whitespace. 
FossilOrigin-Name: 56d11c250961790579a7aeee65e83fdb29462ae37f9de93da13fbd890fc0a01d
 2018-03-16 23:53:47 +00:00
dan
9f2b04533e Fix a problem in test script thread001.test causing a spurious "-1 files were 
left open" error when run separately.

FossilOrigin-Name: 1774f1c3baf0bc3d83a53c52702696ff21814fa1de07cc38fd098832e6757b09
 2018-03-16 07:48:43 +00:00
drh
3571e7bf4c Fix an issue with the fsdir() table-valued function not resetting correctly 
after each pass of a join.

FossilOrigin-Name: 7ce4e71c1b7251be9e922b21dfeba1f9aef6a47ce6495ecb7f94fd785ab564f2
 2018-03-15 15:09:45 +00:00
drh
20a1f35928 Add the SQLITE_DBSTATUS_CACHE_SPILL option to sqlite3_db_status(). 
FossilOrigin-Name: 48a06eb02b42a021b835ff9766535805723259b9701b87fb17fa488b133cb53a
 2018-03-14 15:25:43 +00:00
drh
15ca9e3e8c Disable one of the test cases from check-in [21ecbce1378f3cc4] when 
API_ARMOR is not enabled.

FossilOrigin-Name: 8fb23d4281915b4507e4d42a300f4b5f958ad88ad408218659c7459775d7b114
 2018-03-14 15:06:42 +00:00
drh
ffc78a41ea Add the SQLITE_DBSTATUS_CACHE_SPILL option to sqlite3_db_status() 
FossilOrigin-Name: 3faeb851374471a6f94a6fab3a62c73d03330eae6fc72cd1a277b03ad12dcdd0
 2018-03-14 14:53:50 +00:00
dan
68cf69ed8d Improve detection of out-of-range parameters in sqlite3_stmt_status() for 
SQLITE_ENABLE_API_ARMOR builds.

FossilOrigin-Name: 21ecbce1378f3cc4b1051628b8c1580bb807c8745a1f525bc089036af93a54af
 2018-03-14 08:27:39 +00:00
mistachkin
840c300f4a Add more tests for the profile output of the Tcl trace_v2 method. 
FossilOrigin-Name: 61eeb48f03f8a9a32330a5cae4387bb4e5618078cf669a5831910f99126900ec
 2018-03-10 20:45:44 +00:00
drh
42f3c5ff25 Add support for INSERT OR REPLACE and INSERT OR IGNORE on the zipfile 
extension.

FossilOrigin-Name: 8ad35d483e4293d5571eeacc20fd26cdc4064fbee7b63d974879d507a0ee5792
 2018-03-10 14:17:01 +00:00
drh
41a6f2cb6d Improved error messages from the zipfile extension. 
FossilOrigin-Name: f634a7e386918b829389f20c330d312315fdd61125cd2c5f66cf17a5d74bce49
 2018-03-10 13:21:41 +00:00
dan
2d066bbfd8 Fix a problem in test file nockpt.test causing errors with 
SQLITE_DEFAULT_AUTOVACUUM builds.

FossilOrigin-Name: e547c83f3eb71175574d4b49a0981b048bf525f57d36a2410d955cf1832bec22
 2018-03-09 14:11:36 +00:00
drh
6131adc074 Fix a test case in zipfilefault.test so that it only runs if JSON1 is 
available.

FossilOrigin-Name: 072b244790893a699dc49d7a2cead85bed016f8e28d18ae7662fbeb3298cb235
 2018-03-09 14:06:11 +00:00
mistachkin
069720ea8b Fix harmless compiler warning. 
FossilOrigin-Name: 706800ba377e4a1f615ee6ab44530742f23e1d1be5b658608ca2fd352b363cb2
 2018-03-07 21:29:15 +00:00
mistachkin
98cb7a4894 Enable compilation of 'sessionfuzz' tool using MSVC. 
FossilOrigin-Name: c58de43b8f2723d659fc9820caf667e215fdfa9aa2d7337fc82ba5b6f8db2e4c
 2018-03-07 21:13:49 +00:00
drh
f94c1902b9 Add the sessionfuzz test program and data obtained from a week of running 
AFL.  Automatically run this test program on any "make test" on unix.

FossilOrigin-Name: ecaedfe596d4c05546bfd798fdca94aff6a81f55be7b17ddb65fc5547c4b5aa6
 2018-03-07 20:48:21 +00:00
mistachkin
ac8ba26ecb Fix utility compilation issues with MSVC. 
FossilOrigin-Name: 5bd5a79898790bef150b2bc7f275333444b1a723385e595931377ff4d32190bf
 2018-03-07 14:42:17 +00:00
drh
b0f0dc3073 Add the sqlite3_serialize() and sqlite3_deserialize() interfaces, enabled 
when the -DSQLITE_ENABLE_DESERIALIZE compile-time option is used.

FossilOrigin-Name: fc42d31d6fca21abc5377a463ed800e3066b2f3fbd2d85cb486f402d2ae7cb15
 2018-03-07 13:01:54 +00:00
drh
9c6396ecc7 Improved documentation for sqlite3_serialize() and sqlite3_deserialize(). 
Change the name of the compile-time option to enable these interfaces
from SQLITE_ENABLE_MEMDB to SQLITE_ENABLE_DESERIALIZE.

FossilOrigin-Name: f07e97aed435b02e1473053c0257ec5c89bf0b3e46076b7a9382de432bbc2497
 2018-03-06 21:43:19 +00:00
dan
a48b020ddd Avoid running a couple of tests in crash8.test that depend on the presence of 
the journal file if running on an F2FS file-system that does not require a
journal file.

FossilOrigin-Name: 797e02e0ee703ab0fd53e26ba5c96ac7429b8022522bec201423718d508acf24
 2018-03-06 11:46:34 +00:00
drh
2825e4ebb1 Merge the latest enhancements from trunk. 
FossilOrigin-Name: c8083de14b54fba1071385f8530d03d5684efd4963fde0f83ddc53ae3118a75b
 2018-03-01 13:44:40 +00:00
drh
5597cd42b8 Add support for TRUE and FALSE keywords and for operators IS TRUE, IS FALSE, 
IS NOT TRUE, and IS NOT FALSE.  If there is are columns named TRUE or FALSE,
then the keywords resolve to the column names, for compatibility.  The
behavior of the "DEFAULT true" phrase is changed to mean what it says,
rather than being an alias for "DEFAULT 'true'".

FossilOrigin-Name: 9a7f02c50e6c8a3dc3addf4e51b7e04bd31670d6ce58d26d55273c43b5ecc8b0
 2018-02-27 15:40:59 +00:00
drh
43c4ac8bfe Code simplifications. New test cases. 
FossilOrigin-Name: 57508518ef9d003d259ba98dcc32e5104aca26731a7161808741fe10bc0830d0
 2018-02-26 21:26:27 +00:00
drh
171d16bb21 Get the "DEFAULT true" and "DEFAULT false" phrases working correctly in 
CREATE TABLE.

FossilOrigin-Name: 8002f87d96b3f885cd208e7d204907a33ba60c4057ce2338b71e2de41215b0e5
 2018-02-26 20:15:54 +00:00
drh
8abed7b907 Refactor for correct NULL handling in the IS TRUE, IS FALSE, IS NOT TRUE, 
and IS NOT FALSE operators.

FossilOrigin-Name: cf2abd59be9971a55bd3d6c5df374c6aaa23bf81819482b42f01ee2484dcd739
 2018-02-26 18:49:05 +00:00
mistachkin
6bd4140d33 More tests pursuant to ticket [36fae083b450e3af857a459e20]. 
FossilOrigin-Name: c26f236da61aef7c7a8fe38f1c7f33eea894c8fae38de6a085d4cce933a70502
 2018-02-26 17:03:03 +00:00
drh
1fcfa7240f Always interpret non-zero floating-point values as true even if their 
integer part is zero.  Fix for ticket [36fae083b450e3af857a459e20].

FossilOrigin-Name: a983fa857048c748112c2f805f13aadeae43b43b3d27fa55433a3699b51c9a0e
 2018-02-26 15:27:31 +00:00
drh
57f29b7bfb More test cases for unicode handling in printf. 
FossilOrigin-Name: ac188211119bfd77f43e4aba8acab733a56aac90b4c8a11f7ef8e6388582438f
 2018-02-19 20:41:01 +00:00
drh
cf7c8370d1 Test cases and a bug fix on the new unicode handling in %c. 
FossilOrigin-Name: e41d64e95b9b6fec5dc329553822925e7d648a41912b420cfa1ba198736e6bab
 2018-02-19 20:23:20 +00:00
drh
e28eb64d09 Fix a memory leak in the processing of nested row values. This problem has 
existed every since row values support was added (version 3.15.0, 2016-10-14)
but was only just now detected by OSSFuzz.

FossilOrigin-Name: 2df6bbf1b8ca881c8a465d6624de66fde4c5975ccae6b2f2dda392b137f577de
 2018-02-18 17:50:03 +00:00
drh
713f34ace9 Do not allow parameters or schema references inside of WITH clause of 
triggers and views.  This fixes a bug discovered by OSSFuzz and present
since common-table-expressions were first added in 2014-02-03.

FossilOrigin-Name: b918d4b4e546d3903ff20efc3c8ca26dd9761cc8ed9ef7d2799b66ff9ae1ae51
 2018-02-15 21:00:37 +00:00
drh
f4bc6c43d7 Improve performance of editdist3() by keeping the costs in sorted order. 
Also add a new regression test to editdist3().

FossilOrigin-Name: dc734c5b61464dfd6bfa7963f2ecce32e405a0c2ba1ef6f453ec9389da080256
 2018-02-15 03:56:33 +00:00
drh
4e6e5cef6c New test cases for the editdist3() function in the spellfix extension. 
FossilOrigin-Name: 2d3f1f22d53034576a0ec8d9c360fb19efbb05b2e95ad1b09d120fb1b7da33fd
 2018-02-14 15:30:48 +00:00
drh
e2d27e0259 Try to optimize spellfix1 by storing a NULL in the k1 column of %_vocab 
if it would otherwise have the same value as the word column.

FossilOrigin-Name: b76ec7cb5841f9ad02b342271e91c5f5a598006f69df7953a6213c706e01f7a2
 2018-02-14 14:13:09 +00:00
drh
a9abfb1e6c Improved test cases for the [f484b65f3d6230593c34f] bug. 
FossilOrigin-Name: 1f300514e6cdd32c755dc1b05dfa125b10eda2eb55a1024b66f66dbf5cf96289
 2018-02-13 19:13:05 +00:00
drh
4d1c6845ff Fix an incorrect table lookup used to find the appropriate search operator 
for a WHERE clause on a row-value inequality.  The incorrect table lookup
was causing an incorrect answer for the less-than operator.
Fix for ticket [f484b65f3d6230593c34f11]

FossilOrigin-Name: f3112e67cdb27c1aec8d2cee3cb91ade061d093e13505894698e26336898b336
 2018-02-13 18:48:08 +00:00
dan
e84c498be1 Ensure that multiple updates of the same FTS4 row (i.e. the row with the same 
rowid) within a single transaction are written to separate segments. Fix for
[d6ec09ec].

FossilOrigin-Name: d2a81a3752a8298ee65fddcf32dee2147ba6467f770315a41966b3533977aa64
 2018-02-13 16:21:32 +00:00
dan
1db7db1f03 Update test file func6.test so that it works with SQLITE_ENABLE_NULL_TRIM 
builds.

FossilOrigin-Name: e128d72f1a565551d3b6fdb3807fcb1c2a2bf355f0c09d04562b62f49d01fdbc
 2018-02-12 15:27:32 +00:00
drh
f313952097 Improve the performance of the built-in REPLACE() function in cases where 
it does many substitutions that make the string larger.  OSSFuzz is reporting
intermittant timeouts when running a test where it does a REPLACE() on a 
930KB random blob. Perhaps this enhancement will fix that.

FossilOrigin-Name: fab2c2b07b5d3cd851db3e6f5c8a44155e32b0df22905ea33412b153b825a928
 2018-02-09 23:25:14 +00:00
dan
91347c066b Make the tests in func6.test more robust against implementation changes. 
FossilOrigin-Name: b685d3231097fb90e7d61d9ac01cc560e8bf2671d49390ae7af5bfdbd6d04f11
 2018-02-09 15:42:40 +00:00
mistachkin
b189e4101c Fix typo in comment. Skip tests added by check-in [4761db83b6] when running on Windows. 
FossilOrigin-Name: 468a389cdc8b6f92c77b11f682e210ad8cce7e3dbc0df308a898f4115e85fce2
 2018-02-07 18:45:00 +00:00
dan
eab0e10304 In extensions rtree, fts3 and fts5, ensure that when dynamic buffers are bound 
to persistent SQL statements using SQLITE_STATIC, the binding is replaced with
an SQL NULL before the buffer is freed. Otherwise, a user may obtain a pointer
to the persistent statement using sqlite3_next_stmt() and attempt to access
the freed buffer using sqlite3_expanded_sql() or similar.

FossilOrigin-Name: 2a5f813bc61f9e780f2ccbda425611f65ad523b6d486a1e5e2b9d5e9f1d260a2
 2018-02-07 18:02:50 +00:00
dan
fa68815fa3 When the final connection disconnects from a wal mode database, check that the 
database file has not been moved or unlinked before deleting the wal and shm
files.

FossilOrigin-Name: 4761db83b6d3d57f281370899403c102e39ad0021d315dd6a6912d250436782a
 2018-02-07 16:14:41 +00:00
dan
d1317095b5 Fix another minor problem in walro2.test. 
FossilOrigin-Name: ba0631de60ca38bf7efa6dbd86ec8774bf6f438c804155968e97f17eabe3b20a
 2018-02-05 13:42:45 +00:00
dan
60d72b9bab Update test file walro2.test to account for systems with a page-size 
(getpagesize()) larger than 32KB.

FossilOrigin-Name: d9e59cfb8476e1ec1ca458b8382172526c0557ab785f41e31971d03045c9344c
 2018-02-05 13:28:51 +00:00
dan
668845bb0b Add a few more zipfile tests. No changes to code. 
FossilOrigin-Name: 3f621545879ea39502cfaf2b61883f92c077070274b4fdf45524ded81cac3e63
 2018-02-01 20:42:23 +00:00
dan
15daa6b53e Fix a problem triggered when a zipfile virtual table is created and written to 
within the same transaction. And add other zipfile test.

FossilOrigin-Name: 48f1c556994d7f8f359c649a1da81eec02306106b68946a9a20b276742c4610d
 2018-02-01 19:41:23 +00:00
dan
c3ef23a1c9 Fix a memory leak that could follow an IO error in the zipfile extension. And 
add other tests.

FossilOrigin-Name: e6bb750697c3c7ceb5ce41d216e8ef6a1d556822a3b55e0a007b4a03e194a7d9
 2018-02-01 15:19:54 +00:00
drh
06b3bd5b7a When an index is based on a text representation of a numeric column in the 
original table, make sure the indexed value uses the canonical text 
representation of the numeric value in the table.
Proposed fix for ticket [343634942dd54ab57b70].

FossilOrigin-Name: 88e2ce916791d488076584f3795a89eb4277fcb812af9e4c2f383815d55ff6f1
 2018-02-01 01:13:33 +00:00
dan
cfaffad65c Fix a test case in zipfile.test. 
FossilOrigin-Name: 4eb5b24c64ee5907c18371f563b79fa0caf58285a62b8f09e639a690e6727eaa
 2018-01-31 19:45:58 +00:00
dan
44091ed368 When creating a new archive entry, have zipfile store UTC instead of local 
time in the legacy MS-DOS format timestamp field.

FossilOrigin-Name: e2114df18383d111dd5fbac902e08b42a7f4b2b2d6f7bf29574a3722e4a4dad5
 2018-01-31 19:13:31 +00:00
drh
5cd253423b Improve the omit-left-join optimization so that it works in some cases 
when the RHS is subject to a UNIQUE but not NOT NULL constraint.

FossilOrigin-Name: 02ba8a7ba7ba71cd7abd5dd3093ea486f53a025f6972bb444f2da37e0e2fc3b2
 2018-01-31 16:50:27 +00:00
dan
4ea48144f9 Fix a failing assert() in the new code on this branch. 
FossilOrigin-Name: 74d857d178dfadea7e07ba47439fe11aa9d282b54caf78cd6961e593b37406d0
 2018-01-31 14:07:01 +00:00
dan
099fa84727 If a virtual table xColumn method sets an error message using 
sqlite3_result_error(), use that message in preference to any error message
left in the sqlite3_vtab object.

FossilOrigin-Name: 71e3b715ad36c2132a587b84221be6359c31d7a17c3fba201b7ed3baf17922f1
 2018-01-30 18:33:23 +00:00
dan
2f7260deba Add tests cases for the zipfile extension. 
FossilOrigin-Name: 13b786dafd308b7aef42328f26fe64981c83d524e4bf82ceb7d58afc7146c7d3
 2018-01-30 17:43:22 +00:00
dan
fdcd9d4e6c Prevent users from creating zipfile() virtual tables without an argument. 
FossilOrigin-Name: 81fdbe0cc5a360f818078d47a5888d0a29d555927da279a9a0213702d74ef09a
 2018-01-30 14:07:55 +00:00
dan
ea4125bbef Add unix-only tests to check that the "unzip" program can unpack archives 
generated by the zipfile extension.

FossilOrigin-Name: 438c5c5237a801ae78809bf324bb9251fb50250addfc1f8e36659442b0e26ab6
 2018-01-29 19:47:32 +00:00
dan
f8c4b99a02 Add aggregate function zipfile() to the zipfile extension. For composing new 
zip archives in memory.

FossilOrigin-Name: e364eeac76a8225146b37d801bc6cabe03e9abede5a1412ebe9d94a32d8838cc
 2018-01-29 18:41:07 +00:00
dan
8433e7166b Update the omit-left-join optimization so that it works in some cases when the 
RHS is subject to a UNIQUE but not NOT NULL constraint.

FossilOrigin-Name: 88411a402b29f19d69e0d06d9099eabb98c238ddb7c07ce110236316f008753e
 2018-01-29 17:08:52 +00:00
dan
26e731cc88 Ensure the "unique-not-null" flag is set for automatic indexes on columns 
declared with "col UNIQUE NOT NULL" (where the NOT NULL comes after the
UNIQUE).

FossilOrigin-Name: 8767f7b880f2e4112f75f0b6ef7be3f50ab1ae20e103e7d03d8bfe77e6c79438
 2018-01-29 16:22:39 +00:00
dan
26333ee3ca If a zipfile virtual table is created with no argument - "CREATE VIRTUAL TABLE 
zzz USING zipfile()" - accumulate data in memory. Support "SELECT
zipfile_blob(z) FROM zzz LIMIT 1" to retrieve a zip archive image.

FossilOrigin-Name: e63185edfe0c316aa60c1fa085d032425ecc7db54536dfa5a977772eaf3c240e
 2018-01-27 16:29:59 +00:00
drh
c9f3db33d5 New test case for ticket [ec32177c99ccac2b1] that works without the STAT4. 
FossilOrigin-Name: 5259d4847f2b73f26b2385f9d8cff8fe0cabc54b4deab8477c87c8d1bb5535b1
 2018-01-27 13:55:56 +00:00
drh
33f10207aa Proposed fix for the query planner problem of ticket 
[ec32177c99ccac2b1].

FossilOrigin-Name: eef8cbef3c49e6331301a8f3f8a5fd12090b1e99e68487c2d405e53ef771f688
 2018-01-27 05:40:10 +00:00
drh
33f763d154 Fix the query planner so that it takes into account dependencies in the 
arguments to table-valued functions in subexpressions in the WHERE clause.
Fix for ticket [80177f0c226ff54f6dd].

FossilOrigin-Name: 7daa687340e475972d6849f84fe1419a1f5700934f53fd80656849adc73d6d04
 2018-01-26 22:41:59 +00:00
dan
8005d60587 If the argument to table function zipfile() is a blob (not text), assume that 
it contains a zip file image to interpret, not the name of a file on disk.

FossilOrigin-Name: 029ebcd30cb261d949f7587ac54c23d7479796b6716fd4ca7512361b8f32de3e
 2018-01-26 18:59:25 +00:00
drh
4eb57ceffc Improve text-to-integer conversion in boundary cases. The 
sqlite3Atoi64() function always returns the minimum or maximum integer
if the magnitude of the text value is too large.  Trailing whitespace is
now ignored.

FossilOrigin-Name: ace0644a1a2a42a3ea42d44f00a31915b8a7e56c9ba90f90a6c02001f89f9c86
 2018-01-26 18:37:34 +00:00
drh
fe875027d7 Add the normalize.c extension. 
FossilOrigin-Name: 16ebe558d2f0982f630c39b6c1b00d14d27011d454cced213f17c26491a2c06e
 2018-01-24 15:07:37 +00:00
drh
31a13548f8 Merge changes from trunk. 
FossilOrigin-Name: 6ef3de810d54563c227045b16197b8011ce285ea867261946f93b2de55344f29
 2018-01-24 15:02:53 +00:00
drh
4d6d872c49 Adjust the fts3rank.test module so that it works on big-endian systems 
(hopefully - I don't have a big-endian machine to test the change on.)

FossilOrigin-Name: e4766cabdf64d8e998048ae43154466fc9c3fad0b86102a42b65122abfcbbe55
 2018-01-24 14:39:18 +00:00
dan
0aac5613d9 Update a couple of test scripts so that they work on F2FS file-systems that 
support atomic transactions.

FossilOrigin-Name: 49e58e645e0c114c71935a3b7fa4771e8a23e28127efd2efe0f2f18813c8f391
 2018-01-24 06:30:10 +00:00
drh
56f1774603 Make the shell functional even if compiled with SQLITE_OMIT_COMPLETE. 
Omit the sqlite3_complete() call from the fuzzing interface if it is
compiled with SQLITE_OMIT_COMPLETE.

FossilOrigin-Name: c3e816cca4ddf0967c4c790cdde2345101dde3f2d854e62589f1ac1d7f3c60b8
 2018-01-24 01:58:49 +00:00
drh
5347f3c111 Invoke the sqlite3_complete() interface from the fuzzer. 
FossilOrigin-Name: 332bf84625d2034c9e1c029aa8243aa34088217e52e34e1f5472217743a31af3
 2018-01-24 01:02:23 +00:00
dan
a916b57013 Fix a bug causing spurious "sub-select returns N columns expected 1" errors 
in join queries with a term like "(a, b) IN (SELECT ...)" in the WHERE clause.

FossilOrigin-Name: 14dfd96f9bca2df5033b2d894bf63cc8bf450a45ca11df5e3bbb814fdf96b656
 2018-01-23 16:38:57 +00:00
dan
b8fff29c68 In SQLITE_ENABLE_BATCH_ATOMIC_WRITE builds on F2FS file-systems, invoke 
SQLITE_FCNTL_ROLLBACK_ATOMIC_WRITE if an SQLITE_FCNTL_COMMIT_ATOMIC_WRITE call
fails. Also, do not use an atomic transaction to create the initial database.
This is because if an error occurs while writing to the db file, any changes
to the file-size do not seem to be rolled back automatically. The only time
this matters is when the file was 0 bytes in size to start with.

FossilOrigin-Name: b3122db1545aeb48b7c28d480534b4b0fe04e83d5336225714c3cad926e5960e
 2018-01-23 14:01:51 +00:00
dan
3a9b9b7749 Fix a test case in walro2.test so that it works with encryption extensions 
(when each page has a little less usable space available than usual).

FossilOrigin-Name: b79521d255a4aa2a7b4424f3498443f27d329ab5428171ba6b87c987f3ccdfc2
 2018-01-22 15:20:59 +00:00
drh
88284b0dc3 On the walro2-X.4.2.2 test case, show the size as part of the test output. 
FossilOrigin-Name: ac5091d7f870f1d0659a576723de454d544e5bfa2bdbba307d7c81eb5ab34e3b
 2018-01-22 14:49:15 +00:00
dan
f193937620 Omit the single test from zipfile.test that uses json functionality in 
non-SQLITE_ENABLE_JSON1 builds.

FossilOrigin-Name: 6bb2a10fad71bf8cec6bca538db7b00be0d26418ab62b83092d3a6a68d1c0d9f
 2018-01-17 12:58:11 +00:00
mistachkin
824f28426a Fix duplicate test names in 'walfault.test'. 
FossilOrigin-Name: 7274d05ff43fc9872f0e4857ae583689e4a6c429b7fa991dcc29744da3048879
 2018-01-17 01:15:08 +00:00
dan
2879952faa Fix a problem causing zipfile to store 0 in place of the CRC32 value for 
uncompressed files.

FossilOrigin-Name: ba44724bcca2e87788b7c6d8c5de7fa388360127bd894ee6a171fd66e794fcae
 2018-01-16 21:09:00 +00:00
dan
0c2ba13e02 Fix a problem causing an infinite loop or other malfunction in some UPDATE 
statements with an OR term in the WHERE clause.

FossilOrigin-Name: feb2c2b6f66b0f45490beb1642d99cdb89fa220e299a8c118929df557c814189
 2018-01-16 13:37:43 +00:00
drh
ded2d99d73 Disable the ".archive" command tests in shell8.test if the CLI is compiled without 
ZLIB support.

FossilOrigin-Name: ce8bfe6c2b87090a2de1e04bc88fcb878597fe1f4ecd5df6d9d588a65601c901
 2018-01-16 02:38:35 +00:00
dan
2d620070b9 Fix a problem in the zipfile module causing it to generate incorrect 
checksums. Remove the ability to insert compressed data into a zip archive.

FossilOrigin-Name: b0b7d0363acf38c2178e2d3041d8ce2a0de061a51caa64670dbf539ee6d4356b
 2018-01-15 19:00:35 +00:00
drh
b058d05452 Avoid excess stack usage when a VALUES clause with lots of rows occurs 
within a scalar expression.  This fixes a problem discovered by OSSFuzz.

FossilOrigin-Name: a4fa0581ba7cfd45fabe0198f55b3c2c8ee3ecfd2825aeed91116f44e77d760b
 2018-01-14 20:12:23 +00:00
dan
f42884c307 Support UPDATE statements against zipfile virtual tables. 
FossilOrigin-Name: f2d2a5df4f29b47212fd2411eae6545087b901a270655640c87ceb472e02a24c
 2018-01-13 19:08:24 +00:00
dan
2483a111db Fix a typo in crash8.test. 
FossilOrigin-Name: c3dc7b8d9de94e46fae75fcc96ec68743205e0a2591e14391c394fff203004d1
 2018-01-13 14:01:26 +00:00
dan
69aedc8db4 Fix various problems in test scripts preventing "make test" from passing on 
F2FS file-systems with the "atomic-write" feature.

FossilOrigin-Name: 56d93d070d6b92d8a5a3fec1b09aae8911116c73d072fc5022f0b51668ed996b
 2018-01-13 13:07:49 +00:00
dan
614efe2b4b Experimental change to include changes made to the sqlite_stat1 table in 
changesets generated by the sessions module. sqlite_stat1 entries in such
changesets are ignored by legacy clients.

FossilOrigin-Name: bd46c4429693545eb16db85692fc591ac529796aa746f5f21df1ce4380619320
 2018-01-12 16:44:29 +00:00
dan
66a3a91aa6 Change zipfile to be a WITHOUT ROWID virtual table and table-valued function. 
FossilOrigin-Name: 931201f64e04247ed613a0301fcc86c3a337c2ed162c6370a80c67a1dd919e7c
 2018-01-11 17:33:48 +00:00
drh
6c9dcc427d Update test cases for the new "usage" for .output. 
FossilOrigin-Name: fbf5e43c07e7c012cb39b33a74b3fab9e46ba946c48497fbd990110692125f57
 2018-01-10 23:27:30 +00:00
drh
e15c5e532a Add the lsmode(MODE) function in the fileio.c extension and use that function 
in the .archive implementation.  Add the --append and --dryrun options to
the .archive command and remove the --zip option, making it automatic.

FossilOrigin-Name: 38f28029d16df8489772c27867de8888dd1c26b170861acdc977fd4023939dde
 2018-01-10 17:44:03 +00:00
dan
4bfd182939 Return an SQLITE_CONSTRAINT error if an attempt is made to insert duplicate 
entries into a zip archive.

FossilOrigin-Name: 1f099b2b45074c89eeff8ff241aa49489c95c2221b25c305fcda670ebf63fb4e
 2018-01-10 17:37:58 +00:00
dan
f2ed70e4de Have the zipfile module automatically append "/" to directory names that do 
not already end with such a character. This is required for info-zip
compatibility.

FossilOrigin-Name: 94bc3c60e7d2ec849b90444b06e3057ed645edf3af334f2737252960602868e5
 2018-01-10 16:30:40 +00:00
drh
a5676c4d2d The ".ar" command deduces whether or not the target file is 
a ZIP or SQLAR and does the appropropriate thing.  The "-z" option is omitted.
The "--append" option is added to open auxiliary databases using apndvfs.

FossilOrigin-Name: 430d1a7daa823ae53606b7a158af4e7c16f62ff9b072b90606524e7c3f6131df
 2018-01-10 15:17:34 +00:00
dan
a688ca5ea9 Fix a problem in os_unix.c causing it to return SQLITE_CANTOPEN instead of 
SQLITE_READONLY_RECOVERY.

FossilOrigin-Name: 6a16f554f027ba268276b728588b5eaea837cbed85358a06a2f6da3b70e834ad
 2018-01-10 11:56:03 +00:00
drh
6116ee4eee Compute the correct column name even if the column identifier is the 
very last token in the SQL statement.  This fixes a problem introduced
by check-in [0fdf97efe5df745510c6b] and reported by the community during
beta-testing.

FossilOrigin-Name: 36b89d728ff13d395fe0e1db8e7c01263f73dccb278b3ece27f6ef78e909b492
 2018-01-10 00:40:06 +00:00
mistachkin
dc006e05aa When disconnecting from the 'swarmvtab' extension, close each database prior to invoking the 'openclose' function on it. 
FossilOrigin-Name: 3e5647cb6c4553683e24b9cb62548f16c79c4e2ac9e39cf135ea52a623f7cc33
 2018-01-09 22:23:42 +00:00
dan
2c4df97591 Return SQLITE_CONSTRAINT if a user attempts to update a zipfile table. 
FossilOrigin-Name: 64c9ccf6c5598a68135e78dad128ec070afa49416e1d1f35745a24276e7aeeea
 2018-01-09 20:44:04 +00:00
dan
c48e0271f6 Fix a potential crash in sqlite3expert.c caused by a missing sqlite3_reset() 
call.

FossilOrigin-Name: f6355970f04a3c4d85801c806366788139d8d5ad29383ec7faa81e2176ffe987
 2018-01-09 18:31:11 +00:00
dan
128011a258 Fix a zipfile problem with adding new directories to an archive. 
FossilOrigin-Name: 5fed67033c9dd4492bf8cfcf98874284581f448d8cc84fa5470dde239f218375
 2018-01-09 10:29:34 +00:00
drh
91694dbdd2 Test cases for sqlite3_normalize(). 
FossilOrigin-Name: 658f42257d56a3562dfa8e55023c6e497f55c565cd751d942de3a9e0cb2fa708
 2018-01-08 20:04:57 +00:00
dan
7c15ac1ada Update the zipfile module so that it matches the documentation. 
FossilOrigin-Name: 7e7e472fa91a2bad2e521d4d67f176c8eb9edc1a07b283e425ea0fa2b6abba1f
 2018-01-08 19:59:59 +00:00
dan
4064a4cc58 Add an "ifcapable trace {}" block to a test in fkey1.test that uses SQL 
tracing.

FossilOrigin-Name: 7182591d351dde22ed2f6a60521d1d7c10a610d702e79693412efc6938167be0
 2018-01-08 17:12:54 +00:00
mistachkin
f2e8aa637e Skip running the 'zipfile' test if the necessary static package cannot be loaded. 
FossilOrigin-Name: 5bc816ec4010c20407396a1051e9f9b0a360ca27c0a99dafa867225cf974e306
 2018-01-05 20:13:33 +00:00
mistachkin
992fdfc5d8 The 'releasetest' tool should pass the TCLDIR macro for MSVC to nmake. 
FossilOrigin-Name: eaa9c0dda73808f1458f9968be59947636fbd4781c9fc535eb50bcaf790093c1
 2018-01-05 19:27:19 +00:00
mistachkin
dfdfd8c7f2 Get the shell enhancements compiling with MSVC. 
FossilOrigin-Name: 335387f9e0d4569097d34cd99cd332b38a282e9b7ae25f088eb47df5c25837ef
 2018-01-04 22:46:08 +00:00
drh
c76ed3d57d Merge in all recent trunk enhancements. 
FossilOrigin-Name: 406f79183736b6ad360169b837172afef2c82a4312f5787db08c54167a44b15e
 2018-01-04 19:54:55 +00:00
drh
35100fb194 Remove the snarky "_supported_" qualifier from the name of the 
sqlite_offset() SQL function.

FossilOrigin-Name: a6eee0fcd89d3958f8720ebdb5f0a8558b4795d747128091dae283eb81c4f74f
 2018-01-04 19:20:37 +00:00
drh
a5bb43518b New test cases and fixes for minor problems. 
FossilOrigin-Name: e0da2cc382e0db33d0423372133115f52c77bd0093dbf816c7e88a0aad5f6582
 2018-01-03 23:40:02 +00:00
drh
3ec8665e22 Replace sqlite3_memdb_config() with sqlite3_deserialize(). Remove the 
"db memdb" command from the TCL interface, replacing it with "db serialize"
and "db deserialize".

FossilOrigin-Name: 2f6e9df9f0c5a9e5b1acb99cfa9486850cc1822d35b0989e779a7a10f3b1f1ac
 2018-01-03 19:03:31 +00:00
drh
cb7d541d3a Replace the sqlite3_memdb_ptr() interface with the more general 
sqlite3_serialize() interface.

FossilOrigin-Name: 8cf2ed4eff6d2e0958656e23384b05ead2128b678b0b69a591878af4190cd077
 2018-01-03 16:49:52 +00:00
drh
4dcac40e3d Simplify the "sqlite3" command in the TCL interface. The filename is now 
optional.  There is a new --memdb option with an argument that is the blob
to which the database content should be initialized.

FossilOrigin-Name: 47398ae77236a92f6b9345aa397361b6df127a9a2895c0771d506b0be10822b9
 2018-01-03 13:20:02 +00:00
drh
9eb8dbad4d Add another test case (found by OSSFuzz) for the problem fixed in 
check-in [2846458a] and described by ticket [dc3f932f5a147771].
No changes to code.

FossilOrigin-Name: 4165fae920a1176c68bfaa1f2cfe17df7f8dd8793519d458b71e3e63670b5495
 2018-01-03 01:47:30 +00:00
drh
ac442f41c1 Add support for the "memdb" VFS and the sqlite3_memdb_ptr() and 
sqlite3_memdb_config() interfaces, to enable an SQLite database to be
manipulated as an in-memory object.

FossilOrigin-Name: fb2ac2d2fa6374084f3325b41b257c7a3ace43aade4b666ec4be93b6b70dc39a
 2018-01-03 01:28:46 +00:00
drh
4d795ef7e4 In the constraint resolution logic, be careful not to cache column values 
in registers whose initialization might be bypassed by an OP_NoConflict opcode.
Fix for ticket [dc3f932f5a147771] reported by OSSFuzz.

FossilOrigin-Name: 2846458af5d029a8e4fdcc8f50873a44e57897bbfe6aee8a23a01ffc34c5579f
 2018-01-02 18:11:11 +00:00
drh
1d315cf7b8 Improved name quoting and escaping in the auxiliary column info section 
of the ".schema" output for views and virtual tables.

FossilOrigin-Name: d64b14e37d9624bf5d86059ddd091170d8e6d341a8043f84548b9b3dbb96a908
 2018-01-01 21:49:43 +00:00
drh
ceba792a2f In the output of ".schema", show the column names of virtual tables and 
views in a separate comment.

FossilOrigin-Name: 2234a87fa905312b23f46d52e06cff7cacbf23b187e16c4398a42e6bdae0ee9f
 2018-01-01 21:28:25 +00:00
dan
0cde0c62b1 Have zipfile support DELETE commands. 
FossilOrigin-Name: 01d4e866fb7b01aeada537d41c4a47747c7810e2028f51077ee5b8b78c348954
 2017-12-30 18:32:27 +00:00
dan
db0cb303ad Rearrange things a bit so that writing to a zipfile does not invert the order 
of objects it contains.

FossilOrigin-Name: f69e8194bfa7de436c96028730ebd57f186d2e6207792e172e1aa38c7f4211c9
 2017-12-30 14:26:29 +00:00
dan
373dc3bb3f Update ext/misc/zipfile.c to support creating and adding entries to existing 
zip archives.

FossilOrigin-Name: 2dec2dec592c0726ebe87b841b9c8d493dea7074a99f278eb1bf0b744d658a9d
 2017-12-29 20:19:03 +00:00
drh
9af41ff452 Stricter test cases. 
FossilOrigin-Name: 9406c0a685fd5ff3516a66402b0514a1440652822a5eecf0b7af85929f3079e8
 2017-12-29 16:37:33 +00:00
drh
092457b18c Change the function name to sqlite_unsupported_offset(X). Only enable the 
function if compiled with -DSQLITE_ENABLE_OFFSET_SQL_FUNC.  The makefiles add
that definition to shell builds.

FossilOrigin-Name: 7a7f826e324b1a2c332e2f1d0740fd0babffcaca6275a798572f02ad367b99ab
 2017-12-29 15:04:49 +00:00
drh
fe6d20e9f4 Enhance location(X) so that it works with indexes and WITHOUT ROWID tables. 
The function might return an offset to the main table or to an index,
depending on whether the column X would be loaded from the main table or
from the index.

FossilOrigin-Name: dd94d6a880dfec4bddd247239b815b84964f804d24841e25f33f1d46a4b5274d
 2017-12-29 14:33:54 +00:00
drh
7a8573bafa Merge recent enhancements from trunk. 
FossilOrigin-Name: 6251e438f2a76170fd1e95aa512a46086ed88ab93b9b97a1dba97c4558689305
 2017-12-29 13:35:09 +00:00
drh
ee052a1c94 Add test cases for the undocumented behavior of duplicate columns on an 
INSERT or UPDATE.

FossilOrigin-Name: f4349c0c26611de8a7d5beb99431a575cf531cdeb0ca2413efabcf0a61e6f424
 2017-12-29 12:50:43 +00:00
drh
e307e11d0a Omit all sqlite3_trace() output from the triggers associated with 
foreign key constraints.

FossilOrigin-Name: fda08e3d10cc850664a356efdafcfc68187053849e1b00991b0b35d892a6776b
 2017-12-27 21:30:34 +00:00
drh
f259df5fc8 Show the text of individual statements within a trigger, as they 
execute, as comments in the output from sqlite3_trace() and sqlite3_trace_v2().

FossilOrigin-Name: fe3d2b97d8945e6a9636472f77bcdc92cc5dda8b3e6e3a4fcbdd0a212ea5b9aa
 2017-12-27 20:38:35 +00:00
drh
9b2e0435d2 Add and use the internal sqlite3DbSpanDup() interface. 
FossilOrigin-Name: a8e1545cb7aacb6a26a8c92a3ad4a3d584d150c3a00d2828c8adbb1ee19fcb6d
 2017-12-27 19:43:22 +00:00
dan
f6c37dbc8c Add options to speedtest1.c and speed-check.sh for testing performance of 
floating-point computatations.

FossilOrigin-Name: ebfea8728fec955b1d74b1d0a3de498fd1a32e8b39572a8fdab606ed87b169b4
 2017-12-26 14:30:44 +00:00
drh
5060a67c4d Fix an assertion fault on a syntax error input caused by check-in 
[6b2ff26c25bb9da3].  Problem discovered by OSSFuzz.

FossilOrigin-Name: 90d6e4f10d3055a776d24854c442a2a68e726af8fc382cdb6241a834082e4c4c
 2017-12-25 13:43:54 +00:00
drh
512795dfea Fix a NULL pointer dereference after a syntax error that can occur as a 
result of check-in [6b2ff26c25bb9da3] yesterday.  This problem was
discovered by the OSSFuzz.

FossilOrigin-Name: d49afb8f9804e96662d1e3cadc4c6643908706d848a53d5ed019919c98f2ccba
 2017-12-24 18:56:28 +00:00
drh
60ba57d9c5 Merge enhancements from trunk. 
FossilOrigin-Name: 150f07fec1e6d1fc0601820d717d8712fc513fe0d4bed67c8679eb51bca30d53
 2017-12-23 18:34:49 +00:00
drh
755b0fd358 Move the generation of output column names earlier in the case of a 
CREATE TABLE AS.  This is a fix for ticket [3b4450072511e62] and a
continuation of check-in [ade7ddf1998190b2b63] that fixes cases of
ticket [de3403bf5ae5f72ed6] that were missed previously.

FossilOrigin-Name: 6b2ff26c25bb9da344add79c93fb3e49fa034a89b38ef56e08e18d21de61f707
 2017-12-23 12:33:40 +00:00
dan
43efc18669 Experimentally add the SQLite expert functionality to the shell tool. 
FossilOrigin-Name: 51068dbaeaef13bb80af8126b8c4f3a454dee63de5127d706db50bf789533e60
 2017-12-19 17:42:13 +00:00
drh
2fc865c115 Add an experimental location(X) SQL function that attempt to return the 
location of the payload within the database for the record that contains
column X.  location(X) returns NULL if X is not an ordinary table column or
if SQLite cannot figure out the location because it is using a covering index.

FossilOrigin-Name: 51be9558164301c5dd4df23ab8b3e67de0b522f8d36f79f3d84d45d3dc2a83a4
 2017-12-16 20:20:37 +00:00
dan
11546779b7 Merge latest trunk changes into this branch. 
FossilOrigin-Name: d5b597b52a1213cdf382d96f4df3535727be0852b25bafd12bbef54da946c5f2
 2017-12-16 19:16:24 +00:00
dan
2c44e370f1 Enhance the "swarmvtab" extension. See header comments in ext/misc/unionvtab.c 
for details.

FossilOrigin-Name: 01c173651ab22b7b0c139eded6f2ad8504efd09088df8ae6a3471230ebf2306f
 2017-12-15 20:21:17 +00:00
dan
ac15e2d7cc Have the writefile() function optionally set the modification-time of the 
files it writes or creates. And many small fixes to the new code on this
branch.

FossilOrigin-Name: 7b51269caebe1492885fe9b965892f49a3f8bdb1d666b0203d594c30f9e83938
 2017-12-14 19:15:07 +00:00
dan
7d935ab46d Merge latest trunk changes into this branch. 
FossilOrigin-Name: 803156cba8b056a1cb8d1bb186a57454afe72341abe7de1dfe529234c3415cd2
 2017-12-14 13:55:01 +00:00
drh
472e41ea16 Correctly invalidate a column cache line when it is overwritten with NULL. 
Fix for ticket [123c9ba32130a6c9d432].

FossilOrigin-Name: 65754dc3b830ef9482655d2e93c2cd4acaa7a8715a58d8309955d04378541f89
 2017-12-13 18:01:52 +00:00
dan
ece4b0c172 Add tests and fixes for the shell ".ar" command -f option. 
FossilOrigin-Name: 1a9867973c9d6675fa5254fdd74f36004707a98a91593a188033cf5a49cc7a0b
 2017-12-12 20:28:36 +00:00
dan
d4b56e5901 Add support for parsing options in non-traditional tar form to the ".ar" 
command. Have writefile() attempt to create any missing path components. And
not to throw an exception if it is called to create a directory that already
exists.

FossilOrigin-Name: 38dbeb1e777aa7ec742aa27002ad4dcee28af520dc43de96e5c56c39f16574ff
 2017-12-12 20:04:59 +00:00
dan
1ad3f61b81 Enhance virtual table "fsdir" in ext/misc/fileio.c. Add support for "-C" to 
the shell command's ".ar c" command.

FossilOrigin-Name: 0394889afed2479773af594e2d9659cf58b8959004ebcdeaff8e08e5dae684ef
 2017-12-11 20:22:02 +00:00
dan
2ad0949db4 Add support for -C to ".ar x". 
FossilOrigin-Name: 8cd70960c5ddf0d0b2c40b8b6af4ce6b0277ffdaf04f33fcb33227d2b99ad515
 2017-12-09 18:28:22 +00:00
dan
88be020916 Improve parsing of ".ar" commands. Add new test file for the same. 
FossilOrigin-Name: 840401cc8ce3a09e0663b46973ecd2856d9607be71d2d1e9b21f7df7a82dcbe5
 2017-12-09 17:58:02 +00:00
dan
21540ae479 Add compile time switch SQLITE_ENABLE_ICU_COLLATIONS. For enabling ICU 
collations without also enabling the tokenizer, the LIKE operator, the
REGEXP operator, or the unicode aware upper()/lower() scalar functions.

FossilOrigin-Name: a079f914522d7bc4b3d27d70114eb09adedfac936a64883e6ed8d382c428dd0e
 2017-12-08 16:23:38 +00:00
dan
f9679318f2 Fix the ".lint fkey-indexes" shell command so that it works with WITHOUT ROWID 
tables.

FossilOrigin-Name: 5771b1d611b3562ea6c040f3f893073c4d0ee58c35b37ae211520d9aee8ed547
 2017-12-01 18:40:18 +00:00
dan
92b67025d4 Fix some minor problems in test scripts. 
FossilOrigin-Name: 4c551fdebc7feda3dcfeec719387d879cd5e2cbe213c0c1aac0a965b3f9e882d
 2017-11-30 11:21:59 +00:00
dan
6302590677 Update test file walprotocol.test to account for the changes in the wal 
locking protocol.

FossilOrigin-Name: 64e567009dd56ef595850fe460925bc15fa875163541527638b654aa2b2cf785
 2017-11-30 07:55:15 +00:00
dan
3d9c7c3a4f Merge latest trunk changes into this branch. 
FossilOrigin-Name: 373fa21bffd37053bb1a741d3ace2f003a5639bf373c20ea7bb24a31080888b3
 2017-11-29 16:16:29 +00:00
dan
0895117512 Fix an assertion fault found by OSSFuzz. 
FossilOrigin-Name: 75d699877fa7d06d30285ecf008fbedfdf68cc7965bb328c96f5a931d1f13f04
 2017-11-28 20:43:40 +00:00
dan
05573e41a8 Lock the wal file for all snapshot transactions, even if they would not 
otherwise require this, preventing checkpointers and writers from wrapping the
wal file. This means that if one connection has an open snapshot transaction
it is guaranteed that a second connection can open a transaction on the same
snapshot.

FossilOrigin-Name: b81a31495bd27c1d96f7df653da3502054240cb5acf66b860da7f0f9b422a524
 2017-11-28 13:39:41 +00:00
drh
cb45eef4d1 Update tests to deal with SQLITE_FAST_SECURE_DELETE. 
FossilOrigin-Name: e6b89304695be371978e65dddd710c8bd563c66b9c94d23165142b6c235c82e1
 2017-11-28 00:52:14 +00:00
dan
7ac2d48eba Fix a faulty NEVER assert() that could fail for SQLITE_ENABLE_STAT4 builds 
that use foreign keys.

FossilOrigin-Name: 465350e55ddaf30cfba7874653301de7238a9dc2bc5e1f800fc95de9360679f6
 2017-11-27 17:56:14 +00:00
drh
53bf7175af Fix a problem in the omit-table-from-left-join optimization 
from check-in [0cd82ee9a8413cf] that was discovered by OSSFuzz.

FossilOrigin-Name: b016c28fa5617a20ad34c005372e738d28f7fc4388d19ee0cb7add4ed19d74aa
 2017-11-23 04:45:35 +00:00
drh
fa337cc115 Completely disable the skip-ahead-distinct optimization for all but the 
inner-most loop of a DISTINCT join.  Fix for ticket [ef9318757b152e3a26e9592]

FossilOrigin-Name: b7595cf2cadcba486e60b3c230ccc412a7cf449c1d56cbe65869e6d5d9f1374d
 2017-11-23 00:45:21 +00:00
drh
065b34f6e5 Fix the skip-ahead-distinct optimization on joins for cases there the table 
in the inner loop of the join does not contribute any columns to the
result set.  Proposed fix for ticket [ef9318757b152e3a2]

FossilOrigin-Name: 2dcef5a9ae7f347da65207bf6bf612fb12e18e1a6704799322f0cf2a86154cfd
 2017-11-21 23:38:48 +00:00
dan
41203c6cf1 Update the omit-table-from-left-join optimization so that it can omit tables 
from the middle of the join as well as the end.

FossilOrigin-Name: 618ca9fe53d8d2d7b4f368e6ee404d5fceeecac0d689f32ab62af8a6cbb37401
 2017-11-21 19:22:45 +00:00
dan
17f188e3cf Fix a typo in a test script on this branch. 
FossilOrigin-Name: bff5dcfd2b29ee4834258914410a5dee69ec2727dd254053e3ebaf5090937694
 2017-11-20 15:45:03 +00:00
dan
75dbf68b5b Fix a problem preventing the planner from identifying scans that visit at most 
one row in cases where that property is guaranteed by a unique, not-null,
non-IPK column that is the leftmost in its table.

FossilOrigin-Name: 299d7ca52fec32f04ffd2b8561dd4b839e891792162f8b00259368683436b02d
 2017-11-20 14:40:03 +00:00
dan
6bcabfe1a3 Add some missing "finish_test" lines to the end of test scripts. 
FossilOrigin-Name: c21406ab3281480d3eddca0cdf5aea3abc224425ee52c10eed3ff702a0ae5c26
 2017-11-17 20:07:19 +00:00
dan
6cbc5074e8 Avoid creating a master journal if all or all but one of the databases in the 
transaction is a temp file.

FossilOrigin-Name: 355d1232fd7314723afaa8d6b8b73506b09cbba1113a88b10204ba89be993508
 2017-11-17 08:20:10 +00:00
drh
3dbb4acf07 Add a missing "finish_test" to the end of the stmtvtab1.test script. 
FossilOrigin-Name: e0b5c0585e8530bd516b340093a46d8e358a731facb78da22d3208633c852804
 2017-11-16 19:04:33 +00:00
drh
65efeaca83 Add the ability to read from read-only WAL-mode database files as long as 
the -wal and -shm files are present on disk.

FossilOrigin-Name: 00ec95fcd02bb415dabd7f25fee24856d45d6916c18b2728e97e9bb9b8322ba3
 2017-11-14 19:34:22 +00:00
dan
dc32b448d3 Add further tests for the code on this branch. 
FossilOrigin-Name: f8c4e33f4813e0c909064406b5cc17e2d465d8a48a50ede1d356b39479d3d669
 2017-11-10 17:47:54 +00:00
dan
ca3e3c3f1a Fix a problem involving "DELETE/UPDATE...LIMIT" statements that use an INDEXED 
BY clause.

FossilOrigin-Name: 09f94c2c8199b0d23a45cc062ca9561f9e5ddfcba117100e41889ce199d21bdb
 2017-11-10 16:14:26 +00:00
dan
26caf5bef1 Fix a problem with (DELETE...LIMIT) statements against WITHOUT ROWID tables 
with a single column PK.

FossilOrigin-Name: 35477a3dcceadf5dade8e036d5a2ce91b9ca83c4b85d309db233bdbcf538b1cc
 2017-11-10 15:42:21 +00:00
dan
e941877806 Enhance walro2.test to better ensure that readonly_shm clients are not using 
invalid *-shm files.

FossilOrigin-Name: ff630b66714b20c09888ead0a45f344d63e0d9a5208867d6266e74f79187076c
 2017-11-09 20:34:35 +00:00
mistachkin
bcb416a9ff Get read-only SHM file tests passing on Win32. 
FossilOrigin-Name: abef05353554e72f4d08aff562b87ff8530e8537a79e58d831205ea8c46eed07
 2017-11-09 20:02:44 +00:00
dan
b3c16b899b Add SQLITE_ENABLE_UPDATE_DELETE_LIMIT for views and WITHOUT ROWID tables. 
FossilOrigin-Name: 584b88aaf89ab30cb51185396b7b50c6ecba286add023a26ab41d865b9c605ce
 2017-11-09 19:53:06 +00:00
mistachkin
4ff8431fd1 Initial work on porting the changes on this branch to Win32. 
FossilOrigin-Name: 3738bfd0c0eadb10eea58954af5052cb6ce164059f3aacfe65d7da6a400c63c7
 2017-11-09 16:30:55 +00:00
drh
2fba394c97 Disallow ORDER BY and LIMIT on UPDATE and DELETE of views and WITHOUT ROWID 
tables.  This is a temporary fix for ticket [d4beea1633f1b88f] until a better
solution can be found.

FossilOrigin-Name: 62fe56b59270d9d7372b1bb8a53788a40d20d0f111fe38c61dd6269848592c70
 2017-11-09 03:55:09 +00:00
dan
08ecefc5b1 Handle the race condition that may occur if another process connects and then 
checkpoints and truncates the wal file while a readonly-shm client is building
its heap-memory wal-index.

FossilOrigin-Name: 5a6703fc3f2174b3e9a624c7272ae013b73c42d6c97ffa62b58553efdb54e3bc
 2017-11-07 21:15:07 +00:00
dan
85e1f46eb9 Fix a problem causing an INDEXED BY specifying an unusable partial index to be 
mishandled.

FossilOrigin-Name: 292a04086a902634fc514b379a2b245eb2681c1b84d9bb950b6ecb9aab28b468
 2017-11-07 18:20:15 +00:00
dan
f12ba66cf8 On unix, if the *-shm file cannot be opened for read/write access, open it 
read-only and proceed as if the readonly_shm=1 URI option were specified.

FossilOrigin-Name: ba718754fa5ab8596cb84b751051de98afa2706fe6c5df39ad6d925d790719ee
 2017-11-07 15:43:52 +00:00
dan
d24c5b1c98 Add fault-injection tests for the code on this branch. 
FossilOrigin-Name: a7d949fb735f60c19e7257a1a7a12568a9c15be9cd980c018f3a0d6bf112c339
 2017-11-07 09:08:43 +00:00
dan
ab54838452 Add further test cases for the new code on this branch. And a couple of fixes. 
FossilOrigin-Name: 71af9acb227a91d9ad8798c9d0b12d6967e863d050f5cb1fddb45f25ee1f47db
 2017-11-06 19:49:34 +00:00
dan
cbd3321978 Add further tests for the code added on this branch. 
FossilOrigin-Name: a6716fcde38b28b8a03b40f9d16f78a57ec20f60cf391ff553692641cb7f0d3f
 2017-11-04 21:06:35 +00:00
dan
11caf4f4b7 In cases where a readonly_shm client cannot take the DMS lock on the *-shm 
file, have it parse the wal file and create a wal-index to access it in heap
memory.

FossilOrigin-Name: 18b268433d739486eac1b04947bd418655e4bc56e8dc63ffa558aa4552a32e30
 2017-11-04 18:10:03 +00:00
dan
44c8a97e01 Fix test cases in wal2.test broken by the locking change in the previous 
commit.

FossilOrigin-Name: f569c3517234881f9425075aab65a32ffd0deb8e793f421a241d8cca881da33f
 2017-11-02 18:57:46 +00:00
dan
dea5ce36f5 Avoid locking shm-lock WAL_READ_LOCK(0) during recovery. Doing this allows 
recovery to proceed while a readonly_shm connection in unlocked mode has an
ongoing read transaction.

FossilOrigin-Name: 5190d84a296b7cf716ef43bf7b6d4d351ef1a4d650de37dc01a5ab333da7c05d
 2017-11-02 11:12:03 +00:00
dan
92c02da33e If a readonly_shm connection cannot map the *-shm file because no other 
process is holding the DMS lock, have it read from the database file only,
ignoring any content in the wal file.

FossilOrigin-Name: ce5d13c2de69b73378637d4f7e109714f7cd17bf1d1ad995e0be442d517ed1b3
 2017-11-01 20:59:28 +00:00
drh
37ab9523fa Move the test scripts for checkfreelist and checkindex over into the 
ext/repair/test directory.  Run them now using the sqlite3_checker utility
with the --test option.  Some tests are currently failing due to an
incomplete port.  This is an incremental check-in.

FossilOrigin-Name: 17f8d5e111a9fe5b074f946e23936ae5a2a7a8d8018bad4212660d8eb81c04b7
 2017-11-01 18:05:32 +00:00
dan
514c4b7e5d Merge latest trunk changes into this branch. 
FossilOrigin-Name: 985bfc992950625a45a7521bf4c8438cd0170de974dff976968be158ac5922a9
 2017-11-01 07:06:41 +00:00
drh
1884d00dd0 Merge all recent enhancements from trunk. 
FossilOrigin-Name: 24adf90ffb3ce9ff3c26efef0357f3a47312e8d11dc391ef2cc7e6873ef25895
 2017-10-31 18:15:36 +00:00
dan
7eded5925b Fix a couple of issues in incremental_index_check to do with CREATE INDEX 
statements that contain embedded SQL comments.

FossilOrigin-Name: 2aef41815a9f1786ebdf09d8f6cfa59a8e7d733253eafeae24fa6e2a093bb1d8
 2017-10-31 12:01:01 +00:00
dan
e7a579d27d Add support for indexes on expressions to incremental_index_check. 
FossilOrigin-Name: 8c1c701fdbe0d56ee7f6f7d7b583aafde9fa14acc93ee8ecaddc8bb311e2bf52
 2017-10-30 19:38:41 +00:00
dan
75650d4f94 In checkindex.c, use C code instead of SQL/group_concat() to compose various 
SQL clauses. This is to make it easier to support indexes on expressions.

FossilOrigin-Name: 940606b3af059eb3f79d71fec871ea88df8bce0349f5b33b79c147a85610e269
 2017-10-30 17:05:18 +00:00
dan
6fc6617909 Fix an issue in incremental_index_check with indexes that use non-default 
collation sequences.

FossilOrigin-Name: 3ebb2351e2650d263029d2c0042683cba3529c9d3f76b5f994f2e737b84d3f67
 2017-10-30 08:04:38 +00:00
dan
19465e7380 Fix "after" parameter handling in the incremental_index_check code. 
FossilOrigin-Name: c40c3c62e996044f31ca49ffc2edb2cc0320e69956f7ee6fe3e9012200e0d9a0
 2017-10-28 20:31:25 +00:00
drh
6d6e76f75f Add test cases from OSSFuzz to prevent a regression in co-routine 
processing.

FossilOrigin-Name: 689743d8e3fa81e65dcb067bbf61bab09210b3b39586c865c00d9f1d6692daf2
 2017-10-28 12:20:09 +00:00
dan
bde13e2694 Add the start of the "incremental_index_check" virtual table in 
ext/repair/checkindex.c. For incremental verification of index contents.

FossilOrigin-Name: d5b9dada471358a2864727759648b763bf6890fc2521fac53c0d8216017d39b7
 2017-10-27 20:53:16 +00:00
drh
0503f2acfa Fix a Pager ref-count leak in the sqlite_dbpage virtual table. 
FossilOrigin-Name: c063bb04da77d6847e4e254b6bb939c860e781382e34ddff8e0454d9db7552e2
 2017-10-27 18:24:11 +00:00
drh
6e61c5f895 Additional test case demonstrating the ability to access structure elements 
using quoted names in the JSON1 extension.

FossilOrigin-Name: 8d3cc928a8f0c7b2616c5c75af9d3a50bd4f0fe8e4ccab545ab8648cbfbb4b7f
 2017-10-27 12:27:25 +00:00
drh
47d9f83982 Enhance the min/max optimization so that it works with indexes on 
expressions.

FossilOrigin-Name: 6caec9082b3ad6d3f89f6291084a8f5c80f296630e2e94bc764389ac1a47a833
 2017-10-26 20:04:28 +00:00
dan
ab04eff809 Fix an error in the previous commit on this branch. 
FossilOrigin-Name: f71dfee06ce1e0eee760cfca19482bdec7729d6c7d28f10f4cfd21e1f92a04b0
 2017-10-26 17:34:50 +00:00
drh
3cd8aaa748 Fix the sqlite3_dbpage virtual table so that it can read and write from 
any attached database.

FossilOrigin-Name: d4f893e1ae53a0445939ea2920af87d21dd36270494381028b2eaebe5c188f18
 2017-10-25 19:18:33 +00:00
dan
685bea66ce Merge trunk fixes to swarmvtabfault.test and the lsm extension into this 
branch. No changes to core SQLite code.

FossilOrigin-Name: f632b87002a7ee9be569aacb5ce85bb7e9c86b7d77bb8d1bf8b55eb5be4ecc77
 2017-10-23 20:20:42 +00:00