mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
28,757 Commits 1,487 Branches 166 Tags 416 MiB
0b453b3b33
Commit Graph

28757 Commits

Author SHA1 Message Date
dan
3c90b86372 Avoid an error in sqlite3expert if the database has existing indexes on expressions. 
FossilOrigin-Name: f1d76c8636866424fe0b57d8814b8bb1a0ed4e2ca1b75d8e308d4b962ad8dc3b
 2024-09-24 11:26:21 +00:00
drh
4e34558f1b Use _wfopen() instead of fopen() on Windows in the CLI. 
FossilOrigin-Name: 21a8cac5e9a0d5ead29ca1114be7520d182348f7e2e2e2416852b827d7e09f21
 2024-09-24 10:30:07 +00:00
drh
118ac6a7ad Always use fputws() for output to a Windows command-line prompt. 
FossilOrigin-Name: 33950a8c3f3e48e5107fe56647da05147aa84f9c3eccbe7c8671f5b502ebb70b
 2024-09-24 09:51:53 +00:00
drh
7d24e6b080 Remove an ALWAYS() that can sometimes be false, with wildly incorrect SQL 
inputs.  dbsqlfuzz 707afcf73930de2624cdeca0ad1f0deea982dfea

FossilOrigin-Name: 766cf5535b9f51decd88c1736b988def929a90f68eb6a52bcaa21bb321586a08
 2024-09-24 00:53:27 +00:00
stephan
405ae974ee Further wasm build cleanups and tweaks. No functional changes. 
FossilOrigin-Name: 3b72a143431537ec275aefae739e56330c1d445c9ea80885882a2b9aa2201179
 2024-09-24 00:31:08 +00:00
drh
415acd09d7 In the CLI, when displaying results in a columnar format, take into account 
zero-width and double-width Unicode characters.

FossilOrigin-Name: 47cfad71eddc6fc4414ff853ee172da72527620eee743721806072c6e0a80caa
 2024-09-24 00:01:47 +00:00
stephan
6ed21e8fd7 Typo fix in makefile comments. 
FossilOrigin-Name: a4a1287fe8205d7c24556ec2e7ae09cda37a36dbe405ea70cd756cf488549036
 2024-09-23 22:56:54 +00:00
stephan
69cce89425 wasm: replace much of the eval makefile spaghetti with equivalent code generated from a small C app. It turns out that's easier to read and write than doing the same thing from shell or tcl code, due entirely to C's lack of need for escaping dollar signs. 
FossilOrigin-Name: 5440de48903e94f91090e2df65702ec0c504e33dd5cbd50f684cf30988f20b02
 2024-09-23 21:22:09 +00:00
drh
1d9db01065 CLI uses only lib-c for I/O on Windows. No calls to Win32. Works on Win11, 
at least.  Reads and writes unicode to/from the console and UTF-8 to/from files.
Prototype code only - must testing and additional work required.

FossilOrigin-Name: 5c54530d5a0a4125a1ba44f22537c4f63d5e5708f347c43cbac3e1832c4335da
 2024-09-23 20:23:43 +00:00
dan
253695caf3 Fix a couple of problems with the sessions streaming interfaces. 
FossilOrigin-Name: 9a1fc8d36b5b262f9d17a4743b4b9bb54510cf257d2d9778ebc42d5224856b1e
 2024-09-23 19:32:06 +00:00
stephan
d69b4249ff Merge current trunk into this branch. 
FossilOrigin-Name: ed47d7f9a44b2af8ab7dd956495e71ea9a159cec438d1909f7022254a779e068
 2024-09-23 17:06:06 +00:00
drh
5e419c1048 Add the run-fuzzcheck target to the MSVC makefile. 
FossilOrigin-Name: 2e5194407a1b34dd0659c350ea8098bfef7b3f11aa5b2a07ecd2bce5582655a2
 2024-09-21 17:27:47 +00:00
drh
38f2c5f81c If the database filename pointer passed to sqlite3_open(), change it 
into ":memory:".

FossilOrigin-Name: 62e11a3a78edf9853b74d6495ccd8ae9ac1966c7d78eb3682cf2d5885e3740ec
 2024-09-21 15:57:06 +00:00
drh
8a894cd804 Fix comment typo in the fileio.c extension. No changes to code. 
FossilOrigin-Name: bf2c5b368ac094e048ca33a5e9175fe6a1fb5e2b1e392935eb29388e8999c40b
 2024-09-20 17:41:05 +00:00
drh
7f0e0c7dbf New assert()s to help verify union access. No logic changes. Testing and 
validation code only.

FossilOrigin-Name: b7b64c53f5d7f6b405ee3f1f1be1d84230aa79db5a502c8ad78d3e524f4384fb
 2024-09-20 12:58:15 +00:00
drh
db467f5777 Fix harmless compiler warning in the vfstrace extension. 
FossilOrigin-Name: c8b4d092a22d87f1231424c8e3fa6a02f17fb965cb2a931621e1b51f4d215de7
 2024-09-19 15:44:41 +00:00
drh
f8305e4616 Improved rebustness to malformed UTF-16 inputs to sqlite3_prepare16_v2(). 
FossilOrigin-Name: 7b3a517b3e16ea487ca77a2c88a0c11d737de366524fc911aa1bdd6bfb7ad148
 2024-09-19 13:39:06 +00:00
mistachkin
8513eb6ba8 Remove a stray newline. 
FossilOrigin-Name: 77f587dc3bbc784e8884c1b56b53fa90bbd76f4bd121bd572ab529a2b9796e57
 2024-09-19 00:05:18 +00:00
drh
0e8cbd5e78 Improvements to the scope of valueFromFunction(). 
FossilOrigin-Name: a0f39419cb5bdfa42ab2978cf3819e3d7821212996571f8251d2efbeaa26c603
 2024-09-18 16:33:07 +00:00
dan
704561f346 Fix the preupdate hook so that it works when the "old.*" row has a column with a non-NULL default value that was added by ALTER TABLE ADD COLUMN after the current record was created. 
FossilOrigin-Name: 6a8c687904e92f00c1a5f768947545d2920ab9025bf8649adb0ea8053f5aec4e
 2024-09-18 15:52:05 +00:00
drh
ae2a4acf8d Fix sqlite3-rsync so that it recognizes drive-letters on the front of pathnames 
in Windows, and does not misinterpret them as hostnames.

FossilOrigin-Name: 54a3bbd5781f76bd73f5276b632d1107312f7a789134910793262317edd8359c
 2024-09-18 15:38:05 +00:00
dan
38b31a93b3 Fix the preupdate hook so that it works when the "old.*" row has a column with a non-NULL default value that was added by ALTER TABLE ADD COLUMN after the current record was created. 
FossilOrigin-Name: 00a398cf900179aa5a8aab09fe4a671d99e7a31583282848ef39390f2ef246eb
 2024-09-18 15:02:27 +00:00
drh
eaa50b8660 Fix harmless static analyzer warning in sqlite3-rsync. 
FossilOrigin-Name: a63e412b6b2939422ecfa99d91fccb7a9c61e1533bb0db20ff12f3815ef41a2c
 2024-09-17 22:57:08 +00:00
drh
87dce45f96 Add assert() statements to some of the sqlite3_bind() APIs that help human 
readers and static analyzers, both, reason about the code and verify that it
is memory safe.

FossilOrigin-Name: 97528788145b83a1486dbaf09326ebedbc07bd0b47a57cdff773885b0b984604
 2024-09-17 21:42:04 +00:00
drh
ff60709d68 In sqlite3-rsync, do not allow the '/' character to appear anywhere in the 
USER@HOST: prefix to one of the argument databases.

FossilOrigin-Name: 6089a90463dcb3ba8e1584cfc5e2528fbc131311c6df7834fb41a5614a8ca9e8
 2024-09-17 10:36:33 +00:00
drh
3b204ec8bb Fix a typo in an error message in sqlite3-rsync. 
FossilOrigin-Name: 3f25d6c8eac25de4afff486b134a339bc06404ddaed15b46db48c6770535b1e6
 2024-09-16 20:53:52 +00:00
drh
61e3067529 Cleanup the sqlite3-rsync executable as part of "make clean" 
FossilOrigin-Name: 8c5e481b49d86d97fefa345d0c1b96c050846ef9fc51d8b9dd203ee35afd6f6d
 2024-09-16 14:11:14 +00:00
drh
d70fbffc1a In sqlite3-rsync, 
open the replica database using ATTACH since the sqlite3_dbpage virtual table
is technically a part of "main".  This avoids locking problems.

FossilOrigin-Name: 39c56c836a8ae52c5b42cc0d04b92f7c0e6889a03c4fdffd301209383b7c1f87
 2024-09-16 10:58:11 +00:00
drh
f8cafd7b11 Improved error message in sqlite3-rsync if the SQL statement for ORIGIN_TXN 
fails.

FossilOrigin-Name: 73bde71ed10f52b851e220de35519d5fb7e65a932437ab82a194faff490b7930
 2024-09-16 09:12:11 +00:00
drh
a95620c141 Provide more opportunity for the remote side in sqlite3-rsync to send error 
messages back to the local side.  Be sure to invoke pclose2() when done.

FossilOrigin-Name: 23a63505152ff995e4ce0963dc4ab9f76ed55da7e7f5e1b85a2577473642e3ad
 2024-09-15 18:37:34 +00:00
drh
d87a4f8bdd Merge subsequent changes to sqlite-rsync that were accidentally missed by 
the prior check-in.

FossilOrigin-Name: 50762ba0783a04e0dcd9456a1ae17d875b0a9272f2f09854a23d9d5253761e9f
 2024-09-14 16:52:45 +00:00
drh
dbff02abc5 Enhancements to sqlite_dbpage() so that it accepts INSERT statements that can 
extend or truncate the database.  Add the sqlite3-rsync utility program that
make a copy of a live database over SSH.

FossilOrigin-Name: b7a8ce4c8c5fc6a3b4744d412d96f99d2452eb4086ad84472511da3b4d6afec6
 2024-09-14 16:39:02 +00:00
stephan
11e1defc8f CLI arg handling robustness improvements. 
FossilOrigin-Name: 129aca54f6b791c222b51f3eb01569e1e569269860e153b005140eb65af378b9
 2024-09-14 16:30:01 +00:00
drh
3d56d59adc Add the --version option. 
FossilOrigin-Name: 9961334c8007e7cb6ae55885075b74acddc4fa701b359cf67e0f3c237d7eba4a
 2024-09-14 16:28:38 +00:00
drh
7154803d4c New debugging options: --logfile, --errorfile, --remote-errorfile. 
If page 1 changes, always send it last.

FossilOrigin-Name: 2d8cd76691554578e987ce682cf0c42c083711dd1511a178148978182ef43ba2
 2024-09-14 16:03:16 +00:00
drh
df9b488799 Always show the -v traffic message even if there are multiple -v options. 
FossilOrigin-Name: fc05a5b7f77cdbfcc659d49eb09569a64a172362cb90199e2861028085178f10
 2024-09-14 11:38:46 +00:00
drh
15e05eab32 Add the --logfile FILE option for debugging. 
FossilOrigin-Name: 30e1b92d5663e24d2f325f2bab35f81b55848ef39d15688e40b9005269626303
 2024-09-14 11:23:57 +00:00
drh
9d3047bd0d Improved error messages coming out of sqlite3-rsync. 
FossilOrigin-Name: 452fb6de3984c3cb10d30b51dcdb2574578ca128a0c519b2bd43df0bdd343083
 2024-09-14 10:59:32 +00:00
drh
2b30518804 Make the output from sqlite3-rsync with a single -v option the same as it 
is with regular rsync.  Only show the SSH command with two or more -v options,
or if there is an error in popen2().

FossilOrigin-Name: 105ec44b470318fc9ff1773027c4064343f224068c9b6e71c5618f18f7dfcc3f
 2024-09-14 10:48:05 +00:00
drh
33f0a3ed13 Merge sqlite_dbpage fixes into the sqlite3-rsync branch. 
FossilOrigin-Name: dff76b7a3436031ea5a61b8a44ddfa1d40ea20c983f3d34a8501cd7074db68b8
 2024-09-13 23:41:16 +00:00
drh
762946b236 Bug fix in the enhanced sqlite_dbpage for when truncating two or more 
ATTACH-ed databases within the same transaction.

FossilOrigin-Name: 6aa9c8e79b440c6419e65990d9ceba8f00a6f975455138cf2aa82b113daec825
 2024-09-13 21:47:57 +00:00
dan
0218424e5a Require that the contentless_unindexed=1 option be specified before storing the values of fts5 UNINDEXED column belonging to contentless tables. 
FossilOrigin-Name: c51dc2a5e75baacbd905cf314e7b1a58a81993ff05ca656739e028d7db25d5b2
 2024-09-13 16:30:18 +00:00
drh
8550e4a9f8 Fix harmless compiler warning on Windows. 
FossilOrigin-Name: 86e0219d977c493ac19d00c3ddcf560eb317d506c7cf6e4ef17e92daa91e1762
 2024-09-13 16:12:54 +00:00
larrybr
99f50dd219 Close the db as sqlite3_analyzer exits. (See [forum:af384c2315d9718a|forum post, "sqlite3_analyzer not closing WAL-mode db cleanly" ].) 
FossilOrigin-Name: 94ceac98845e31249b656dcdb8a58f456b9212dc83968ea333852a66d72a0dae
 2024-09-13 16:10:04 +00:00
dan
6e8b3d3caa Merge latest trunk changes, including the changes to the fts5 locale=1 feature, into this branch. 
FossilOrigin-Name: d2f0d19936222911bc317efecc831007d3aba81f9b32877030ffb29d1728bbdc
 2024-09-13 15:37:31 +00:00
drh
7316b6c072 Improved informational output from sqlite3-rsync. 
FossilOrigin-Name: e55e3e8ec2fe3a9190872d999cee55c85bde92667040cc166233faaa2fa34266
 2024-09-13 13:53:20 +00:00
drh
d61d934f9b Preveious check-in was actually doing an 8-round KeccakF1600. This one 
corrects that to just 6 rounds.

FossilOrigin-Name: 3c36f5814f25483586c4fd49ef2fe5c7c0ff8c59672b1622c92061ec0ba8547a
 2024-09-13 12:35:04 +00:00
drh
d0d3182fa8 Change the hash algorithm from SHA1 to a 6-round KeccakF1600 with a rate 
of 160.  This uses about 1/3rd fewer CPU cycles.

FossilOrigin-Name: 96c7f47a8f59e5078bd296979421c1b57fbcb7be261f8a7a0b1d22a4b5914db0
 2024-09-13 12:28:11 +00:00
drh
e92f8e565b Further enhancement to PTRMAP display in showdb: Show the details of invalid 
entries that are within the range of the database file.  Continue to ignore
invalid entries beyond the end of the database file.

FossilOrigin-Name: 4cad385b90eaca2d90e3375e473472145af4134160b81097a8535d06638c2e4a
 2024-09-13 11:14:10 +00:00
drh
5c6dc45a10 Better initialization of new database files in sqlite3-rsync. 
FossilOrigin-Name: 75d5a8eb3d4ece06900109ad4022ba2a3e82de2f0acb012e3a02bfb4326bfa6d
 2024-09-12 23:30:29 +00:00
drh
74c8e234cd Enhancement to the "showdb" utility such that the "ptrmap" command shows 
PTRMAP entries that extend off the end of the database, as long as they
appear to be well-formatted.

FossilOrigin-Name: a9f95fe5ce90ab9864165e603f3a34013c3c98d03f1db689996f4a32086e2ed6
 2024-09-12 21:58:31 +00:00
stephan
5735921b0f Add RSYNC_OPT to the sqlite3-rsync build flags. 
FossilOrigin-Name: b2a3497e5525dd33faf70961107a0529f476735fef756953c66e105747271c6d
 2024-09-12 21:03:11 +00:00
stephan
6677cfeda7 Port some of the shell's CLI flag-handling code into sqlite3-rsync to make the arg handling more robust. 
FossilOrigin-Name: 53fb9b11807ff7accd8cd41f9cb6516d2503f161ea976940437a1d3aae868665
 2024-09-12 18:15:28 +00:00
drh
40b831851e Replica must be in writable_schema mode. 
FossilOrigin-Name: e385525793c7d74ce8ee139c9d6cfc1248834754598f3fd45b22b9426ff106ee
 2024-09-12 17:06:02 +00:00
drh
6df1de1c73 Improved --commcheck. Add the infoMsg() function which is useful for 
debugging.

FossilOrigin-Name: b979d02ffd1370d8840328bce06c76c224f0fc1fb54b47d6c904547580a820a1
 2024-09-12 16:54:34 +00:00
drh
0b8c8c861b Pass the names of both the origin and the replica databases to the remote 
side, so that if the remote is the replica, it will have access to the
origin database name in case the replica name is really a directory.

FossilOrigin-Name: 435c30171d3c6073b7aaf5cc11cc4813f6a2d225ae6dce1b0e478f0cd5a0b532
 2024-09-12 15:51:56 +00:00
drh
f7c96ee98b Add a protocol version number to the first message, and give the two sides 
an opportunity to negotiate a suitable protocol number, for future
compatibility.  Send the page size as a power-of-two.

FossilOrigin-Name: df0623aae1154281157409f62d6d3fb3ce41829281d53bc55868ce44b3d36883
 2024-09-12 15:36:34 +00:00
drh
165daef043 Add sha1() functions to the CLI. Fix sha1b() such that it actually returns 
a BLOB.

FossilOrigin-Name: fe65821a3b912f061026e6fd7174be26897010e6b474e2780350cac60faebaad
 2024-09-12 14:43:05 +00:00
drh
f1fb5ce10f Improved debugging output. 
FossilOrigin-Name: 80461e0d724963aaf2646005298f1194c5f1c4c9ae41c1085d4d137ed485bd9f
 2024-09-12 12:04:53 +00:00
drh
dc3bec34a6 Progress on the sqlite3-rsync utility. This is an incremental check-in. It 
does compile, but it does not work.

FossilOrigin-Name: fa06977b6db7fa745720561ec0b10570cf7e71598dc7a7c5ee650640e5bdf6f5
 2024-09-11 17:02:44 +00:00
drh
2a4a4ec408 Disable the debug-use-only functions sqlite3_mutex_held() and 
sqlite3_mutex_notheld() when compiling with TSAN in as much as those
routines cause TSAN to complain.  Response to
[https://issues.chromium.org/issues/41427446].

FossilOrigin-Name: db702dd78500a0839b0b2810a580d3634df49275470787b170973a86b73826d3
 2024-09-11 12:17:26 +00:00
drh
79254dc363 Improved SSH infrastructure. The foundation is now in place to begin working 
on the actual sync protocol.  Still experimental.  Still a work in progress.

FossilOrigin-Name: 9a1a95f523a96303aad57e2422c2b51ea7e125f5490f32f7a2929d49b6c69ef8
 2024-09-10 22:14:18 +00:00
dan
0c8144ab4f Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. 
FossilOrigin-Name: 198305de92ebba7045d8ec7d2de98511f3b00924f808a3811f061dca47b01ec7
 2024-09-10 20:32:36 +00:00
dan
27119c56bd Remove a stray "breakpoint" from a test script. 
FossilOrigin-Name: 7d87a27a01311153ddee122cedecedc3bcc331618dc2ab1da397a3b257dc21cf
 2024-09-10 18:38:47 +00:00
drh
a9c8f7cf34 Initial infrastructure for the sqlite3-rsync utility. Prototype only. 
Does not work.

FossilOrigin-Name: 397b2d37b7a6619b0c1eee201065585d03496f94786b21540f613e4716d56612
 2024-09-10 17:05:12 +00:00
dan
923423c16f Fix a test in fts3corrupt4.test that would fail if SQLITE_ENABLE_FTS5 was not defined. 
FossilOrigin-Name: 437849c80851da842b5c4fd37d5c147f821abc541e9b4d6f9000c12983548844
 2024-09-10 16:40:08 +00:00
dan
7a41b48cf9 Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. 
FossilOrigin-Name: 55c5c119a0a77fac2c9f46d718ef78c0f33ed3520e10c240cf5bf1801e0586ee
 2024-09-10 16:19:31 +00:00
drh
38b26d82e6 Add the ability for sqlite_dbpage to truncate the database file by writing 
a NULL page.  Experimental.

FossilOrigin-Name: eb3c89ee2e4c5425be75deaf46a06a9cd8b210c695b918dd63a78f930c6e6b63
 2024-09-10 12:09:03 +00:00
dan
cd889c7a88 Fix an OOM-handling problem affecting locale=1 fts5 tables. 
FossilOrigin-Name: d8103684f660ff9b3186d0f89afb113ca580bd16f0bf413ed8a9434236b54426
 2024-09-09 19:12:57 +00:00
drh
882aba4090 Generalize the sqlite3_dbpage virtual table so that it is able to write 
new pages onto the end of the database file using INSERT.

FossilOrigin-Name: fe0d67e72d4228661c021f227bfc0d5ddb1b726db0f36c7221ead8dd8bd1dc73
 2024-09-09 18:45:58 +00:00
drh
9c2f068ebd Move the vfstrace extension out of src/ and into ext/misc/. Make it a 
standard part of the CLI.  Improve its output.  Also fix some unrelated
comment typos.

FossilOrigin-Name: 123cb1f579daec3ed092fe9dd1bc0d3250f2b56d4cda1efa92af139029e112e2
 2024-09-09 15:39:40 +00:00
drh
dbab768d07 Fix dependencies in makefiles to include ext/misc/vfstrace.c as necessary. 
Improved xFileControl() output from vfstrace.c.

FossilOrigin-Name: e8f2d6313075c92fdeebcdfd8b50f43e9d45225890b2ef6b77148a766a42e940
 2024-09-09 15:33:37 +00:00
drh
a40f6eb80e Fix harmless compiler warnings in the vfstrace.c extension. 
FossilOrigin-Name: f23954e604bf4da45f07194b54a4fe1c83002ab65d6c6f0ac095e88baba18547
 2024-09-09 15:19:26 +00:00
drh
a8cf79e322 Fix harmless compiler warnings in FTS5. 
FossilOrigin-Name: aa75e701de61fe63ec15c35d70e53e950ff73b0dcb0d871dd8721412f3af297a
 2024-09-09 15:12:21 +00:00
drh
5600adf1b1 Move the vfstrace extension out of src/ over into ext/misc/ where it belongs. 
Make it part of the standard build for the CLI.  Bring some of the vfstrace
output up-to-date.

FossilOrigin-Name: 055b97de8d2397987d72dbab1cde78ece2d1c066e95042b4ed6b7b36b2cf9006
 2024-09-09 14:50:23 +00:00
dan
cf25c16a54 Fix a problem with fts5 locale=1 tables and UPDATE statements that may affect more than one row. 
FossilOrigin-Name: 70e42f941c0778a04b82655409c7caf4c1039589f7e43a8ec1e736ea8f931b26
 2024-09-07 16:22:22 +00:00
drh
8755e695c5 Fix an off-by-one error in the routines that bind the special $test_TTT and 
$int_NNN parameters for fuzz testing.  Fix to testing logic only - no changes
to the SQLite core.

FossilOrigin-Name: 6206b90a4ec3f05e3bbb4844e71569bbde7df237550569e6419ff7c3146505dc
 2024-09-07 16:04:04 +00:00
dan
f1c750e4ca Add tests for an fts5 NEAR() expression with a single argument phrase. 
FossilOrigin-Name: e319d43bfd5ee4ed92b93531b239af4d1be0a8215b2a06c3532122ff2c7b6a7c
 2024-09-06 20:12:59 +00:00
stephan
6946a7fa50 Resolve the "No rule to make target '0'" error when building with --disable-tcl. 
FossilOrigin-Name: d94541ae76b5d8b69f5524f10dcccc0814283f438a03f553848ed631a1983633
 2024-09-06 15:01:00 +00:00
drh
bc97630313 Fix a harmless stray carriage-return character. 
FossilOrigin-Name: 84a6c5f975de36ba93b888e01cc5188717b5644ab8384beb8fd8906bdfc8e227
 2024-09-06 14:01:48 +00:00
drh
c43d16d69a In testrunner.tcl, correctly capture and display information about the 
system under test:  hostname, OS, pointer size, byte-order.

FossilOrigin-Name: ec75cfc5d4b69e4aed64d17748cac15cd62a759a1cbe7feaa4580ad8346b0b95
 2024-09-06 13:13:25 +00:00
drh
deb6a60a84 Fix harmless compiler warnings. 
FossilOrigin-Name: 60fb8ee153ec293b6b3a4170dafa305e4c16af575aced72daef46116d8dc2bb6
 2024-09-06 11:21:53 +00:00
drh
c4e84b7295 A testcase() macro added to help ensure that the fix to the omit-noop-join 
optimization from yesterday does not regress.

FossilOrigin-Name: 224628b1039b996499e0d806fc0215f175da6f1059eb1b9ac491ac11126971ab
 2024-09-06 10:35:36 +00:00
drh
56a0480540 Clarification and simplification to the README.md file and to the instructions 
for building on Windows.

FossilOrigin-Name: f69ef1a37b2778bdf73ee7e3b3edd74f7344ab8e5eedbedc22203c782e521f5b
 2024-09-06 09:49:13 +00:00
drh
dc181d41d5 Fix a testrunner status reporting problem introduced by [aa5f10f21dbfb24e]. 
FossilOrigin-Name: d20c65c3b4256a662ebf7ed024b7b7adaceca90358f58111dc645da322000794
 2024-09-05 23:40:13 +00:00
drh
934e796e43 Ensure that the WhereInfo.revMask bitmap is adjusted when tables are removed 
from the FROM clause by the Omit-Noop-Join optimization of
[0cd82ee9a8413cf1].  Fix for the issue described by
[forum:/forum/8a1e467e905b8d27|format post 8a1e467e905b8d27].

FossilOrigin-Name: 22ca5a2ffb89ccb5f337993b5a95e27c449c39014284156eabc33da012a8759c
 2024-09-05 23:22:55 +00:00
drh
6ffcdb1856 Update notes on build procedures in the README.md file. 
FossilOrigin-Name: 1d12744fe7cc294994e53e1ffe72799d0321dd5c1ef031213f083e200918fee5
 2024-09-05 15:55:04 +00:00
drh
4987c5c3c2 Testrunner.tcl enhancements: (1) Attempt to build the SQLite tcl extension 
if it is not already available.  (2) testrunner target "devtest" is added as
an alias for "mdevtest".  (3) Try to keep summary information at the end of
a test below 80-characters per line.  (4) Update the Makefile.in so that
the "clean" target removes the tcl extension built by item 1 above.

FossilOrigin-Name: aa5f10f21dbfb24ee54ca96bfb7b013ae29e26fec05b80681f19cc63d9face49
 2024-09-05 15:28:15 +00:00
drh
21e7816e65 Enhance testrunner.tcl to keep track of the platform and SQLite version 
as reported by individual test cases and to report that information in the
summary at the end of each test run.

FossilOrigin-Name: 80ebb7c7e686cd936ac834f2258f585a7004762593e0bc859ecd75d6fb0badfd
 2024-09-05 12:06:45 +00:00
drh
6aedd6d9fc Faster implementation of the aggregate_test_counts procedure inside of 
testrunner.tcl.

FossilOrigin-Name: a01d869520329fb9e786cdc65f359785a95d19d289e4c6b844c758d6e5385aaf
 2024-09-05 11:46:43 +00:00
drh
7bd230cf4d Make the default TCLDIR be C:\Tcl in the Makefile.msc. 
FossilOrigin-Name: c2c0a9176ae7291a0b72f3d048a2ef5716c325b9f693cdc5eada552e0c881a9d
 2024-09-04 18:51:59 +00:00
drh
bb4d2edf10 Fix a bug in the parsing of some corner-case JSON PATH strings that contain 
escaped double-quotes.

FossilOrigin-Name: 60ac55c4b76355aaf7cbde38bf1f6082ff5612bf4ffc49ab69d00fd4e3d64e64
 2024-09-04 16:01:44 +00:00
drh
109025c0a4 Put a proper shebang at the start of the testrunner.tcl script and make the 
script executable.

FossilOrigin-Name: c0c6e9abebf76358625f30a179658319b260baba6eded2a4c5ad356143e36f97
 2024-09-04 13:42:19 +00:00
drh
3c72072a6f Make extra efforts to delete the over-size directory names created by 
the win32longpath.test module.

FossilOrigin-Name: 3c8035ed3f023fb31f65f298fb9ce19d4fa7a5511bd90877b27969f5f0892472
 2024-09-04 13:09:58 +00:00
drh
c81ab76cd9 Add the "joblist" command to testrunner.tcl 
FossilOrigin-Name: f64469f4806d4d5d7103c171a37a542c7aab9db09a226bccd8411e9ccd55353d
 2024-09-04 11:22:47 +00:00
dan
de30fb5fc2 Store the values of any UNINDEXED columns of a contentless fts5 table persistently in the database. Warning: This currently creates a (technically) incompatible file-format for contentless fts5 tables that have UNINDEXED columns. 
FossilOrigin-Name: dcacb1a8ef359b4507b4733356d3150ba5dc105cc9867c103d16a0908a1a9f64
 2024-09-03 18:55:38 +00:00
drh
fd486258a0 Enhance the "errors" command in testrunner.tcl so that it accepts the 
"-s" or "--summary" argument to see a list of failed jobs, and so that
an additional argument is a GLOB pattern that restricts the output to
jobs whose names match that pattern.

FossilOrigin-Name: dcbebe30f594a99e23b5ccd8d199b92118204a3e52e75c78d98c394601252e81
 2024-09-03 16:04:34 +00:00
drh
940cdc94f3 Fix ext/consio so that it works correctly with SQLITE_USE_ONLY_WIN32. 
FossilOrigin-Name: efc6f3d7e92a25f440fb8d392daf325af5ca7dca104a5bb4bd59f7df93af53b0
 2024-09-03 14:15:57 +00:00
drh
23a16c8387 In testrunner.tcl, compile the Windows Default configuration using 
SQLITE_ENABLE_STMT_SCANSTATUS.

FossilOrigin-Name: 49e8b1635f29d9fd0dc2ef6e312fd4129f2283f68e9423d95ff9b55077688ad7
 2024-09-03 14:00:36 +00:00
drh
e6e49bfef2 Fix harmless compiler warnings in the percentile extension. 
FossilOrigin-Name: c5557f281c6294b6db6682349d245feac7c6ce7f4f61356f486afdf186c566c4
 2024-09-03 12:41:21 +00:00
drh
06638117bb In testrunner.tcl, allow setting njob to zero, which causes no new jobs 
to be launched and for the process to shut down once all current jobs are
completed.

FossilOrigin-Name: 0ef65fd4ba17def4c13986365b3af300c4024725af4bc314845d1af8be568ab4
 2024-09-03 10:53:32 +00:00
larrybr
22cd1eec5a Cause cfGets() (under SQLITE_USE_ONLY_WIN32) to better emulate fgets(). 
FossilOrigin-Name: 2d783524d1671d988ebb1b21c83de99c9f335963b6c20cf4df612f58c13da913
 2024-09-03 02:09:13 +00:00
drh
7c6f2880aa Fix possible NULL pointer dereference following OOM in the new error reporting 
logic of the percentile extension.

FossilOrigin-Name: 7891a266c4425722ae8b9231397ef9e42e2432be9e6b70632dfaf9ff15300d2c
 2024-09-02 21:59:31 +00:00
dan
70989b6f59 Fix a technically undefined signed integer overflow in fts5. 
FossilOrigin-Name: e6bec37ea1ca51e1d048941ce4c5211d8fc5c5e3556a1441f9c79b036843f9e3
 2024-09-02 18:41:59 +00:00
drh
ef7c692baf Make the percential extension easier to incorporate as a built-in on Windows 
applications.

FossilOrigin-Name: 831e2be4117dc7f5113f66d3e484ca34e4405444ac7b0def12ee9a00608d40da
 2024-09-02 17:27:10 +00:00
drh
da52f11250 Remove some debug/test code from percentile. Make the extension easier to 
statically link.

FossilOrigin-Name: 6e5f146e274b210749dd8923a2da56905eb098b5a66699ff9130e3e51b1ff662
 2024-09-02 14:46:56 +00:00
drh
7a29505e57 Enhance the percentile extension to support percentile_cont() and 
percentile_disc().  Add support for ordered-set aggregate notation in 
the parser when compiling with SQLITE_ENABLE_ORDERED_SET_AGGREGATES.  A
new function property SQLITE_SELFORDER1 must appear on any aggregate function
that wants to take advantage of the ordered-set aggregate notation.

FossilOrigin-Name: 557bd245ef24af15da1374762bbeb9b8b0241da06e604efdf00d567a9ed09216
 2024-09-02 12:07:37 +00:00
drh
d281889ac8 Improved error messages on percentile functions. More tests cases for 
percentile and for ordered-set aggregates.

FossilOrigin-Name: e1bca168e70335fa2f9537632fd16e374c566a564fab4974c0b8f61cb63d08ce
 2024-09-02 11:17:04 +00:00
drh
a955ec806a Change the name of the enabling compile-time macro to 
SQLITE_ENABLE_ORDERED_SET_AGGREGATES.

FossilOrigin-Name: 3b1cdddf8339cc339ec74cd8be2bfa42e62b500048a444eb9e5d9817bc4702ae
 2024-09-02 09:40:37 +00:00
drh
b5df31d15f More internal documentation improvements. 
FossilOrigin-Name: 8b91b74931c36e1955ef933a07d8ec40c8b54c882efe7084d179168867c5244f
 2024-09-01 23:56:14 +00:00
drh
b9a6e42a55 Improved documentation of recent enhancements to the percentile extension. 
FossilOrigin-Name: 51e7b4c9cf19a5986432a76c5fd30cef715c170a403d7b4304a8c5888c445a91
 2024-09-01 23:47:20 +00:00
drh
1c30df3598 The WITHIN GROUP (ORDER BY ...) syntax is now a compile-time option: 
SQLITE_ENABLE_ORDERED_SET_FUNCS.  There is no increment in the code size
if the option is omitted.

FossilOrigin-Name: c9367e2532d653738af27c4d92810eb648a9e12f72d7223017c87cb0dddc6804
 2024-09-01 23:27:34 +00:00
drh
ca447020ae Implement percentile_cont() and percentile_disc(). 
FossilOrigin-Name: b1a93f67d6b21df6fe3247c9333fead61dd425574f66ea3eb06b80c2b06f616a
 2024-09-01 20:24:24 +00:00
drh
7aa01a0ffc No prepare-time penality for ordered-set aggregates for applications that 
do not use them.

FossilOrigin-Name: e070c16d2183312e416ff6af770346041e4d3836c4db2c9ea6049f63fb0eaa07
 2024-09-01 19:19:26 +00:00
drh
5d5d6194c9 Merge fixes from trunk into the ordere-set-agg branch. 
FossilOrigin-Name: 7528ddcfdf155116353266e00e6408c526e29f04cb00ca2d9e84b105329b17c0
 2024-09-01 18:57:52 +00:00
drh
c97ad9b4e1 Improved sort function in the percentile extension. 
FossilOrigin-Name: 9f84e8d59bcda642e732565e840f6a880a01b2fc65af2651248f6a8a6e1cb65a
 2024-09-01 18:54:31 +00:00
drh
41155d8885 Fix to the quicksort algorithm in the percentile extension. 
FossilOrigin-Name: 54313f74b24c46f1afa1ff082ef569fa46938527095be358015e7047e17702ac
 2024-09-01 10:52:20 +00:00
drh
df2d14b86e Add error checking: Do not allow functions other than those in the 
percentile extension to use the ordered-set aggregate notation.

FossilOrigin-Name: 317d901429303340290334dbe7680a36339df0a50b586e3f71b6c5e5eba6d411
 2024-08-31 22:22:24 +00:00
drh
a239ece378 Demonstration of how ordered-set aggregates might be parsed and integrated 
into the existing parse tree, should we decide to support them.

FossilOrigin-Name: ef9777890001ba0122d3add799795e118fd87243f42731ab84d4748b67605647
 2024-08-31 20:09:37 +00:00
drh
c1042cd133 Include percentile() and merge() in the fuzzcheck test utility. 
FossilOrigin-Name: d1d0942a947803d45a1fd9068f3518cf412178b6b9bafcb82db44c52d5820c11
 2024-08-31 19:24:17 +00:00
drh
65b1244781 Omit the percentile_cont() function added by [095c22e62248f8ef] (and not yet 
released) since its usage conflicts with the PG percentile_cont() function.

FossilOrigin-Name: 3fe0a852978f3f1218e37a58f0d3b54016d4116a3301aa32efa7c4c12c767755
 2024-08-31 18:35:10 +00:00
drh
49af3dfbf4 Allow percentile() and median() to act as window functions. 
FossilOrigin-Name: 94cf96af8fee55449080655bddf81cbf5c078a02d7bb5dd7e4903b36f83a8c07
 2024-08-31 18:08:31 +00:00
drh
a5315a6ece Still more test cases. 
FossilOrigin-Name: f09904608195dac38172b0dd4dcab3190f33c116d468beff27f913a7433b400e
 2024-08-31 17:50:06 +00:00
drh
f138110dfd Add more test cases. 
FossilOrigin-Name: 0d0e5456793b4bef673ebc7fcc1c393a6d3c817363d948ddfe06d60eab56dc24
 2024-08-31 17:27:55 +00:00
drh
ad8ec9db63 Avoid unnecessary sort operations when running one of the percentile 
aggregates as a window function.

FossilOrigin-Name: 5d311536211eb1e3c887ceb7e6516d3900e6eebbccc8c445dd43cdd556182728
 2024-08-31 16:55:14 +00:00
drh
129767958a Test cases added. 
FossilOrigin-Name: 25e68229843cc84978955817285550085d1306ba4ce3b0517dd00e5d05b9ae0a
 2024-08-31 15:02:07 +00:00
drh
90fa4c7b2c Enhance the percentile() and median() extension functions so that they can be 
window functions.

FossilOrigin-Name: 4d0e3df4b9c609755977b8a462126242d2be1310c0122a8d4ba76d98d32a7230
 2024-08-31 14:31:17 +00:00
drh
3196c349d1 Do not fail the omittest if ICU libraries are not installed. 
FossilOrigin-Name: ddc55efd2d59df3f20743b0533550436da945453c069025a3f871d28d40e13d4
 2024-08-30 17:33:25 +00:00
drh
0337b9a628 New makefile target: "tidy". The "tidy" target removes all build products 
be leaves behind test results.  The "clean" target has been enhanced to do a
better job.  The tool/omittest.tcl script is rewritten to work on the
configure-generated Makefile and to require no arguments.

FossilOrigin-Name: e48add02695a41b26a04e7942b5333e2bf4dc5598e363367aea3a4690982667d
 2024-08-30 16:51:41 +00:00
drh
6cb12337b9 A couple of #defines so that the build work with SQLITE_OMIT_FLOATING_POINT. 
FossilOrigin-Name: be768f80c703ac1645251ccbac83e07b3ea4cc231c8ea7e66374a4f78361f10b
 2024-08-30 16:43:36 +00:00
drh
c589d5ab06 Rework the tool/omittest.tcl script so that it works with the 
configure-generated Makefile, and requires no arguments.
Update the configure-generated Makefile with a new "tidy" target which
is like "clean" except that is preserves test logs.  Use "make tidy" to
force everything to be recompiled from scratch without destroying logs.

FossilOrigin-Name: 99491df19d68df1f0515bd5ec9240ef3dd6e0fa38a6c837a38a16a873f8e2cbb
 2024-08-30 16:24:49 +00:00
drh
28db1a68ba Improvements to "make clean" on unix. 
FossilOrigin-Name: a1d775f07528192b09566ff1546b067ffbee0db5812e424e6b7f3cc33a67dc83
 2024-08-30 12:10:28 +00:00
drh
11397ce104 In the testrunner.tcl status report, try to provide a rough estimate of 
the time remaining.

FossilOrigin-Name: 90bc616d20e8c247691c45de2a28d41c1632b21152dc34253eefc179a90ab31f
 2024-08-30 01:11:19 +00:00
drh
494ba30c9b Sync the autoconf/Makefile.msc with the main ./Makefile.msc 
FossilOrigin-Name: 9de47c3611ca05e03a661807a06c6c5c0b5c6548ea7a8d73cb63832d2dff9d0e
 2024-08-29 23:32:16 +00:00
drh
6a18c9e06a All makefiles are responsive to OPTIONS=... command-line arguments, and add 
the RHS value of OPTIONS= to builds and to lemon and other build steps that
might respond to -D or -U options.

FossilOrigin-Name: 854b3776ee1fcaa5931e3a0ed104978ca350d218e553586d1c40c2420e1be498
 2024-08-29 18:32:56 +00:00
dan
ccd34894e1 Fix a case where the BTCF_AtLast flag was being left set incorrectly. This was causing obscure window function queries to fail. 
FossilOrigin-Name: e042eb024738a83eed92cd2dfac3d2a50d2589715a3d81b1a494564dd7d8e7fa
 2024-08-29 16:27:57 +00:00
drh
c1547d1f7a Do not allow sqlite3_blob_open() to work on a any table that contains 
generated columns, even columns of the table which are not generated themselves,
because such columns might be part of the expression of a STORED column.
This restriction could be relaxed some, but that would be a lot of code
for something that nobody ever uses.

FossilOrigin-Name: 6e84947123339f0ea2b7dabc6134a621eed09317f81647f15870ed50a0f7d1bc
 2024-08-28 19:13:16 +00:00
dan
50ca8af6f2 Fix a dropped error code in fts5. 
FossilOrigin-Name: df55502e4f412e5b1daccf82f11fa4eb932047d9972dcd16e36be00cf09f78e1
 2024-08-28 15:54:46 +00:00
drh
8db3fc5488 Update the README.md file to recommend running "devtest" instead of "mdevtest". 
FossilOrigin-Name: eb016f66ea2c7ebacf8c57495843db3414602d062e4a430f2cc603c88b10c3f9
 2024-08-28 13:55:46 +00:00
drh
ba5994b181 Maybe [7420b13238da4e6b] was not such a good idea. Restore "make test" so 
that it works as before - running a single-threaded test over the source tree
with options specified by ./configure and similar.  Instead, change the
"make devtest" target so that runs the automated multi-threaded tests on 
a standard configuration.

FossilOrigin-Name: dc9fee980d4f4b5a569628702e52cef9e5d8e6c69c2b84546dce47e3e514775e
 2024-08-28 13:51:51 +00:00
drh
3341f5ce85 Minor wording change on testrunner output. 
FossilOrigin-Name: 115e68597957a9ee80de7f554ee3768c992051687c8f07eaf3a9fcaab7efd44e
 2024-08-28 13:34:20 +00:00
drh
d6b56d65a8 Update the "make test" target so that it is really just "mdevtest" with 
"srctree-check" and "sourcetest".

FossilOrigin-Name: 7420b13238da4e6bfb1589eaf3cfd842fe3c4b0f3b6a3b49c24cd70589bf4809
 2024-08-28 12:10:51 +00:00
drh
4f2f91bf08 Further improvements to the status display in order to maximum the amount of 
information shown on the limited screen realestate available when running
via "watch" or in continuous monitoring mode.  All details are still shown
when doing a stand-alone "status".

FossilOrigin-Name: 557a2c65f5ae1d8cb1858c17da0fe64fbfba83d787cfb7f2f21582960a8b9eac
 2024-08-28 11:03:58 +00:00
drh
242e064978 Only limit the number of failures reported by testrunner status if using 
VT100 cursor movement.  For a straight-up "status" command, show everything.

FossilOrigin-Name: 791237e0f4b67f0197ae11e966554edeade0c443289d2ade00470d23bf5e8ec8
 2024-08-28 10:36:18 +00:00
drh
4a90f81a6d In the testrunner status display, limit the number of reported failed jobs 
to avoid overflowing the terminal when there are many failures.

FossilOrigin-Name: ffeaa4d5d73871cbdf1ef70b9845d921ebdb96e964d232661a5048cab7d744ed
 2024-08-28 10:25:44 +00:00
drh
a88d61824d Disable shell test cases that require virtual tables when testfixture is 
built using SQLITE_OMIT_VIRTUALTABLE.

FossilOrigin-Name: 8c73d54fd1e250fcd7f30741cfbd169af9aaecc2096c0c8a9486abaa064d69af
 2024-08-28 09:47:29 +00:00
drh
af43eddc23 Reenable SQLITE_OMIT_VIRTUALTABLE on the Device-One alignment for testrunner. 
FossilOrigin-Name: 8f2cb357634ec0b5aef14f3d967e76db236f8899f3201efc80c264f548cc1b0b
 2024-08-28 09:31:17 +00:00
drh
b5b4ca2a11 Changes to the way "release" tests were constructed in [d03d35eebaf82709] 
were incorrect.  Fixed here.  Also enhance --explain to chose permutation
configurations and so that PATTERNS on the the command line can match
against permutation configurations.

FossilOrigin-Name: 1f962ffc9e956a9d6311ed9c02fea13c0fe056283ee2c650a2312a258808b3b3
 2024-08-27 22:28:03 +00:00
drh
c3c645ef46 Improvements to --status overwrite in testrunner. 
FossilOrigin-Name: 26372762ab1451eb95d29367f5b2534bde616a37e5e757e72ba2cfe42571d180
 2024-08-27 21:44:45 +00:00
dan
f5a9b58c8b Avoid reading the structure record from within the fts5 xConnect method. 
FossilOrigin-Name: 6a6ce343b249e269229867b2c2f107a49ac8a8f24ad66801718ef01159655319
 2024-08-27 20:37:30 +00:00