mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
28,621 Commits 1,487 Branches 166 Tags 416 MiB
d70fbffc1a
Commit Graph

28621 Commits

Author SHA1 Message Date
drh
d70fbffc1a In sqlite3-rsync, 
open the replica database using ATTACH since the sqlite3_dbpage virtual table
is technically a part of "main".  This avoids locking problems.

FossilOrigin-Name: 39c56c836a8ae52c5b42cc0d04b92f7c0e6889a03c4fdffd301209383b7c1f87
 2024-09-16 10:58:11 +00:00
drh
f8cafd7b11 Improved error message in sqlite3-rsync if the SQL statement for ORIGIN_TXN 
fails.

FossilOrigin-Name: 73bde71ed10f52b851e220de35519d5fb7e65a932437ab82a194faff490b7930
 2024-09-16 09:12:11 +00:00
drh
a95620c141 Provide more opportunity for the remote side in sqlite3-rsync to send error 
messages back to the local side.  Be sure to invoke pclose2() when done.

FossilOrigin-Name: 23a63505152ff995e4ce0963dc4ab9f76ed55da7e7f5e1b85a2577473642e3ad
 2024-09-15 18:37:34 +00:00
drh
d87a4f8bdd Merge subsequent changes to sqlite-rsync that were accidentally missed by 
the prior check-in.

FossilOrigin-Name: 50762ba0783a04e0dcd9456a1ae17d875b0a9272f2f09854a23d9d5253761e9f
 2024-09-14 16:52:45 +00:00
drh
dbff02abc5 Enhancements to sqlite_dbpage() so that it accepts INSERT statements that can 
extend or truncate the database.  Add the sqlite3-rsync utility program that
make a copy of a live database over SSH.

FossilOrigin-Name: b7a8ce4c8c5fc6a3b4744d412d96f99d2452eb4086ad84472511da3b4d6afec6
 2024-09-14 16:39:02 +00:00
stephan
11e1defc8f CLI arg handling robustness improvements. 
FossilOrigin-Name: 129aca54f6b791c222b51f3eb01569e1e569269860e153b005140eb65af378b9
 2024-09-14 16:30:01 +00:00
drh
3d56d59adc Add the --version option. 
FossilOrigin-Name: 9961334c8007e7cb6ae55885075b74acddc4fa701b359cf67e0f3c237d7eba4a
 2024-09-14 16:28:38 +00:00
drh
7154803d4c New debugging options: --logfile, --errorfile, --remote-errorfile. 
If page 1 changes, always send it last.

FossilOrigin-Name: 2d8cd76691554578e987ce682cf0c42c083711dd1511a178148978182ef43ba2
 2024-09-14 16:03:16 +00:00
drh
df9b488799 Always show the -v traffic message even if there are multiple -v options. 
FossilOrigin-Name: fc05a5b7f77cdbfcc659d49eb09569a64a172362cb90199e2861028085178f10
 2024-09-14 11:38:46 +00:00
drh
15e05eab32 Add the --logfile FILE option for debugging. 
FossilOrigin-Name: 30e1b92d5663e24d2f325f2bab35f81b55848ef39d15688e40b9005269626303
 2024-09-14 11:23:57 +00:00
drh
9d3047bd0d Improved error messages coming out of sqlite3-rsync. 
FossilOrigin-Name: 452fb6de3984c3cb10d30b51dcdb2574578ca128a0c519b2bd43df0bdd343083
 2024-09-14 10:59:32 +00:00
drh
2b30518804 Make the output from sqlite3-rsync with a single -v option the same as it 
is with regular rsync.  Only show the SSH command with two or more -v options,
or if there is an error in popen2().

FossilOrigin-Name: 105ec44b470318fc9ff1773027c4064343f224068c9b6e71c5618f18f7dfcc3f
 2024-09-14 10:48:05 +00:00
drh
33f0a3ed13 Merge sqlite_dbpage fixes into the sqlite3-rsync branch. 
FossilOrigin-Name: dff76b7a3436031ea5a61b8a44ddfa1d40ea20c983f3d34a8501cd7074db68b8
 2024-09-13 23:41:16 +00:00
drh
762946b236 Bug fix in the enhanced sqlite_dbpage for when truncating two or more 
ATTACH-ed databases within the same transaction.

FossilOrigin-Name: 6aa9c8e79b440c6419e65990d9ceba8f00a6f975455138cf2aa82b113daec825
 2024-09-13 21:47:57 +00:00
drh
8550e4a9f8 Fix harmless compiler warning on Windows. 
FossilOrigin-Name: 86e0219d977c493ac19d00c3ddcf560eb317d506c7cf6e4ef17e92daa91e1762
 2024-09-13 16:12:54 +00:00
larrybr
99f50dd219 Close the db as sqlite3_analyzer exits. (See [forum:af384c2315d9718a|forum post, "sqlite3_analyzer not closing WAL-mode db cleanly" ].) 
FossilOrigin-Name: 94ceac98845e31249b656dcdb8a58f456b9212dc83968ea333852a66d72a0dae
 2024-09-13 16:10:04 +00:00
drh
7316b6c072 Improved informational output from sqlite3-rsync. 
FossilOrigin-Name: e55e3e8ec2fe3a9190872d999cee55c85bde92667040cc166233faaa2fa34266
 2024-09-13 13:53:20 +00:00
drh
d61d934f9b Preveious check-in was actually doing an 8-round KeccakF1600. This one 
corrects that to just 6 rounds.

FossilOrigin-Name: 3c36f5814f25483586c4fd49ef2fe5c7c0ff8c59672b1622c92061ec0ba8547a
 2024-09-13 12:35:04 +00:00
drh
d0d3182fa8 Change the hash algorithm from SHA1 to a 6-round KeccakF1600 with a rate 
of 160.  This uses about 1/3rd fewer CPU cycles.

FossilOrigin-Name: 96c7f47a8f59e5078bd296979421c1b57fbcb7be261f8a7a0b1d22a4b5914db0
 2024-09-13 12:28:11 +00:00
drh
e92f8e565b Further enhancement to PTRMAP display in showdb: Show the details of invalid 
entries that are within the range of the database file.  Continue to ignore
invalid entries beyond the end of the database file.

FossilOrigin-Name: 4cad385b90eaca2d90e3375e473472145af4134160b81097a8535d06638c2e4a
 2024-09-13 11:14:10 +00:00
drh
5c6dc45a10 Better initialization of new database files in sqlite3-rsync. 
FossilOrigin-Name: 75d5a8eb3d4ece06900109ad4022ba2a3e82de2f0acb012e3a02bfb4326bfa6d
 2024-09-12 23:30:29 +00:00
drh
74c8e234cd Enhancement to the "showdb" utility such that the "ptrmap" command shows 
PTRMAP entries that extend off the end of the database, as long as they
appear to be well-formatted.

FossilOrigin-Name: a9f95fe5ce90ab9864165e603f3a34013c3c98d03f1db689996f4a32086e2ed6
 2024-09-12 21:58:31 +00:00
stephan
5735921b0f Add RSYNC_OPT to the sqlite3-rsync build flags. 
FossilOrigin-Name: b2a3497e5525dd33faf70961107a0529f476735fef756953c66e105747271c6d
 2024-09-12 21:03:11 +00:00
stephan
6677cfeda7 Port some of the shell's CLI flag-handling code into sqlite3-rsync to make the arg handling more robust. 
FossilOrigin-Name: 53fb9b11807ff7accd8cd41f9cb6516d2503f161ea976940437a1d3aae868665
 2024-09-12 18:15:28 +00:00
drh
40b831851e Replica must be in writable_schema mode. 
FossilOrigin-Name: e385525793c7d74ce8ee139c9d6cfc1248834754598f3fd45b22b9426ff106ee
 2024-09-12 17:06:02 +00:00
drh
6df1de1c73 Improved --commcheck. Add the infoMsg() function which is useful for 
debugging.

FossilOrigin-Name: b979d02ffd1370d8840328bce06c76c224f0fc1fb54b47d6c904547580a820a1
 2024-09-12 16:54:34 +00:00
drh
0b8c8c861b Pass the names of both the origin and the replica databases to the remote 
side, so that if the remote is the replica, it will have access to the
origin database name in case the replica name is really a directory.

FossilOrigin-Name: 435c30171d3c6073b7aaf5cc11cc4813f6a2d225ae6dce1b0e478f0cd5a0b532
 2024-09-12 15:51:56 +00:00
drh
f7c96ee98b Add a protocol version number to the first message, and give the two sides 
an opportunity to negotiate a suitable protocol number, for future
compatibility.  Send the page size as a power-of-two.

FossilOrigin-Name: df0623aae1154281157409f62d6d3fb3ce41829281d53bc55868ce44b3d36883
 2024-09-12 15:36:34 +00:00
drh
165daef043 Add sha1() functions to the CLI. Fix sha1b() such that it actually returns 
a BLOB.

FossilOrigin-Name: fe65821a3b912f061026e6fd7174be26897010e6b474e2780350cac60faebaad
 2024-09-12 14:43:05 +00:00
drh
f1fb5ce10f Improved debugging output. 
FossilOrigin-Name: 80461e0d724963aaf2646005298f1194c5f1c4c9ae41c1085d4d137ed485bd9f
 2024-09-12 12:04:53 +00:00
drh
dc3bec34a6 Progress on the sqlite3-rsync utility. This is an incremental check-in. It 
does compile, but it does not work.

FossilOrigin-Name: fa06977b6db7fa745720561ec0b10570cf7e71598dc7a7c5ee650640e5bdf6f5
 2024-09-11 17:02:44 +00:00
drh
2a4a4ec408 Disable the debug-use-only functions sqlite3_mutex_held() and 
sqlite3_mutex_notheld() when compiling with TSAN in as much as those
routines cause TSAN to complain.  Response to
[https://issues.chromium.org/issues/41427446].

FossilOrigin-Name: db702dd78500a0839b0b2810a580d3634df49275470787b170973a86b73826d3
 2024-09-11 12:17:26 +00:00
drh
79254dc363 Improved SSH infrastructure. The foundation is now in place to begin working 
on the actual sync protocol.  Still experimental.  Still a work in progress.

FossilOrigin-Name: 9a1a95f523a96303aad57e2422c2b51ea7e125f5490f32f7a2929d49b6c69ef8
 2024-09-10 22:14:18 +00:00
dan
0c8144ab4f Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. 
FossilOrigin-Name: 198305de92ebba7045d8ec7d2de98511f3b00924f808a3811f061dca47b01ec7
 2024-09-10 20:32:36 +00:00
dan
27119c56bd Remove a stray "breakpoint" from a test script. 
FossilOrigin-Name: 7d87a27a01311153ddee122cedecedc3bcc331618dc2ab1da397a3b257dc21cf
 2024-09-10 18:38:47 +00:00
drh
a9c8f7cf34 Initial infrastructure for the sqlite3-rsync utility. Prototype only. 
Does not work.

FossilOrigin-Name: 397b2d37b7a6619b0c1eee201065585d03496f94786b21540f613e4716d56612
 2024-09-10 17:05:12 +00:00
dan
923423c16f Fix a test in fts3corrupt4.test that would fail if SQLITE_ENABLE_FTS5 was not defined. 
FossilOrigin-Name: 437849c80851da842b5c4fd37d5c147f821abc541e9b4d6f9000c12983548844
 2024-09-10 16:40:08 +00:00
dan
7a41b48cf9 Alternative implementation of fts5 locale=1 feature that allows blobs to be stored in indexed columns of fts5 locale=1 tables. 
FossilOrigin-Name: 55c5c119a0a77fac2c9f46d718ef78c0f33ed3520e10c240cf5bf1801e0586ee
 2024-09-10 16:19:31 +00:00
drh
38b26d82e6 Add the ability for sqlite_dbpage to truncate the database file by writing 
a NULL page.  Experimental.

FossilOrigin-Name: eb3c89ee2e4c5425be75deaf46a06a9cd8b210c695b918dd63a78f930c6e6b63
 2024-09-10 12:09:03 +00:00
dan
cd889c7a88 Fix an OOM-handling problem affecting locale=1 fts5 tables. 
FossilOrigin-Name: d8103684f660ff9b3186d0f89afb113ca580bd16f0bf413ed8a9434236b54426
 2024-09-09 19:12:57 +00:00
drh
882aba4090 Generalize the sqlite3_dbpage virtual table so that it is able to write 
new pages onto the end of the database file using INSERT.

FossilOrigin-Name: fe0d67e72d4228661c021f227bfc0d5ddb1b726db0f36c7221ead8dd8bd1dc73
 2024-09-09 18:45:58 +00:00
drh
9c2f068ebd Move the vfstrace extension out of src/ and into ext/misc/. Make it a 
standard part of the CLI.  Improve its output.  Also fix some unrelated
comment typos.

FossilOrigin-Name: 123cb1f579daec3ed092fe9dd1bc0d3250f2b56d4cda1efa92af139029e112e2
 2024-09-09 15:39:40 +00:00
drh
dbab768d07 Fix dependencies in makefiles to include ext/misc/vfstrace.c as necessary. 
Improved xFileControl() output from vfstrace.c.

FossilOrigin-Name: e8f2d6313075c92fdeebcdfd8b50f43e9d45225890b2ef6b77148a766a42e940
 2024-09-09 15:33:37 +00:00
drh
a40f6eb80e Fix harmless compiler warnings in the vfstrace.c extension. 
FossilOrigin-Name: f23954e604bf4da45f07194b54a4fe1c83002ab65d6c6f0ac095e88baba18547
 2024-09-09 15:19:26 +00:00
drh
a8cf79e322 Fix harmless compiler warnings in FTS5. 
FossilOrigin-Name: aa75e701de61fe63ec15c35d70e53e950ff73b0dcb0d871dd8721412f3af297a
 2024-09-09 15:12:21 +00:00
drh
5600adf1b1 Move the vfstrace extension out of src/ over into ext/misc/ where it belongs. 
Make it part of the standard build for the CLI.  Bring some of the vfstrace
output up-to-date.

FossilOrigin-Name: 055b97de8d2397987d72dbab1cde78ece2d1c066e95042b4ed6b7b36b2cf9006
 2024-09-09 14:50:23 +00:00
dan
cf25c16a54 Fix a problem with fts5 locale=1 tables and UPDATE statements that may affect more than one row. 
FossilOrigin-Name: 70e42f941c0778a04b82655409c7caf4c1039589f7e43a8ec1e736ea8f931b26
 2024-09-07 16:22:22 +00:00
drh
8755e695c5 Fix an off-by-one error in the routines that bind the special $test_TTT and 
$int_NNN parameters for fuzz testing.  Fix to testing logic only - no changes
to the SQLite core.

FossilOrigin-Name: 6206b90a4ec3f05e3bbb4844e71569bbde7df237550569e6419ff7c3146505dc
 2024-09-07 16:04:04 +00:00
dan
f1c750e4ca Add tests for an fts5 NEAR() expression with a single argument phrase. 
FossilOrigin-Name: e319d43bfd5ee4ed92b93531b239af4d1be0a8215b2a06c3532122ff2c7b6a7c
 2024-09-06 20:12:59 +00:00
stephan
6946a7fa50 Resolve the "No rule to make target '0'" error when building with --disable-tcl. 
FossilOrigin-Name: d94541ae76b5d8b69f5524f10dcccc0814283f438a03f553848ed631a1983633
 2024-09-06 15:01:00 +00:00