mirrors/sqlite
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,826 Commits 1,487 Branches 166 Tags 416 MiB
2b96b6969a
Commit Graph

107 Commits

Author SHA1 Message Date
drh
55f66b341a Add new assert() statements in an attempt to help static analyzers avoid 
false-positives.

FossilOrigin-Name: 9e66458592d40fbd96ea5f21339573110ca1cfe328238a020c9420a87d35dd72
 2019-07-16 19:44:32 +00:00
drh
cfc45b1021 Reduce the size of the parser tables generated by Lemon by splitting the 
yyRuleInfo structure into separate yyRuleInfoLhs and yyRuleInfoNRhs arrays.

FossilOrigin-Name: 70fe8ec2ae3099b8773834c7ac2e56768addbecd57956ac523e71a7dc264049c
 2018-12-03 23:57:27 +00:00
drh
60ce5d3135 Add a simple test case for Lemon. Always include assert.h in the 
Lemon-generated parser.

FossilOrigin-Name: 9c9c46dcbe92aeabe3d5675bb69681b6dfd53798bc67e6a2ceba67ed3c4fb0af
 2018-11-27 14:34:33 +00:00
drh
b8a762827c Fix to the error handling logic in the Lemon parser template. This does 
not affect SQLite since SQLite does not use that part of the Lemon parser
template.

FossilOrigin-Name: c6dfc59eb12a02d35b708b5d94239377c79f688fa572f72bad51a157b1bf599c
 2018-11-27 14:03:11 +00:00
mistachkin
709c822f5e Fix more harmless compiler warnings seen with MSVC. 
FossilOrigin-Name: edab5666f8470b37e6031dfd80e615b1aab95d1d85ccbe4ece1a813f8b3d4d95
 2018-07-22 21:23:19 +00:00
drh
c7bf57168a Fixes for various harmless compiler warnings. 
FossilOrigin-Name: 5023b1b85b883a716a5da673740b6effe214ee0490f4ca45f161bb8b04784366
 2018-07-09 22:49:01 +00:00
drh
9f607e9c23 Quick patch to the Lemon parser template to avoid an array overread reported 
by OSSFuzz.  A proper fix involves enhancements to the table generators in
Lemon to make the overread impossible.  That fix will take longer to
implement.  The current check-in is a stop-gap.

FossilOrigin-Name: 3f6730be4cb712a28401be6d96e56ccb3f2e98dd8961b477befec3f363715178
 2018-07-01 16:05:40 +00:00
dan
5001b3314d Merge all changes from the weak-fallback branch except those related to the 
weak-fallback feature itself.

FossilOrigin-Name: aad718fb1afacf1c921966796ab1e149207c31b16409c5672f0371f4fb9d6565
 2018-06-30 19:12:36 +00:00
dan
59ff42516c Instead of using a lemon %fallback directive, have the tokenizer try to figure 
out whether an instance of "WINDOW" should be TK_WINDOW or TK_ID.

FossilOrigin-Name: 022079cb0d67be5ac0a50dd9a4d41ee55ce8df681ecd0a544170d75fc8649978
 2018-06-29 17:44:52 +00:00
drh
3773c25f16 Introduce the concept of "weak fallback" in the parser. A weak fallback 
only occurs if a syntax error would result otherwise.

FossilOrigin-Name: c41d7079fb63831bd2f009b64cbf5a423e8119e6b841bfd9bd5a2d85fba3b142
 2018-06-28 03:38:49 +00:00
drh
05ef50d08a Fix an unreachable branch associated with stack overflow in the 
LEMON-generated parser.

FossilOrigin-Name: e3064ba3b68ca2a1c54561756e8c898866a19ef6e785d315171cd47827a50c85
 2018-04-23 00:25:31 +00:00
drh
fd39c5874a Performance improvements on the main loop of the LEMON-generated parser. 
FossilOrigin-Name: fec1ebadeb9d6b55b19a1c159c543fd7ae67b3307c4caee4d2541bd783630e23
 2018-04-21 22:40:08 +00:00
drh
fb32c44e41 Add the %extra_context directive to lemon, as an alternative to %extra_argument. 
Use this to improve the performance of the parser.

FossilOrigin-Name: be47a6f5262a43f477700579512fe7112a0872faedcbbe5c3383d13a08af6440
 2018-04-21 13:51:42 +00:00
drh
54cfb492b7 Fix a harmless compiler warning. 
FossilOrigin-Name: a6c3115483d597fc77ab19fdcfd1d3437cad7e467081ad8c5315fb98c115eed9
 2018-02-09 15:04:51 +00:00
drh
b968518559 Fix harmless compiler warnings, mostly unused parameters for UDFs in the CLI. 
FossilOrigin-Name: bfbeffab7735461acb3773242ba31dae15af9f8b0291c54a6734747bb1b36e66
 2018-01-17 13:15:23 +00:00
drh
cf8e0e9cb7 The previous check-in had an error in the coverage reporting logic. 
FossilOrigin-Name: ec9b19eb652e81cd3c8a5595eb39aac3aca4abe72136c4b65c9cc257594a9c92
 2017-12-27 17:36:58 +00:00
drh
7038a991b0 Change the coverage measurement logic in the lemon-generated parser so that 
it only checks for coverage of state/lookahead pairs that are valid syntax.
It turns out that some states are unreachable if the lookahead is not valid
syntax, because the states are only reachable through a shift following a
reduce, and the reduce does not happen if the lookahead is a syntax error.

FossilOrigin-Name: 9dce46508772bd0f9e940c4d44933154044bb58c1b3511dd0143287bf795dd6b
 2017-12-27 17:14:50 +00:00
drh
7e7b753158 In the lemon-generated parser, do not report the End-of-input character and 
the wildcard character as missed coverage.

FossilOrigin-Name: 3fe964873da16c0e0b1c4f1945f965d4137df7a307acd6a3eb6585ffbaa2afd1
 2017-12-27 16:13:22 +00:00
drh
22716cbb0b Change the lemon-parser coverage report format to report all state/lookahead 
pairs and indicate on each whether it is hit or missed.

FossilOrigin-Name: 86e30fc284c740b55f75884b67988fe837b28878f586f6ec8850ecf80164e700
 2017-12-26 18:32:06 +00:00
drh
0d9de99c5c Add support for measuring and reporting coverage of the parser state machine 
using the SQLITE_TESTCTRL_PARSER_COVERAGE test-control.

FossilOrigin-Name: 1253a872dbf48656d4efd588ab61223a5ac550d9b2b932249d6ba585276ba573
 2017-12-26 18:04:23 +00:00
drh
3a9d6c7156 Enhance LEMON so that it generates the action table in such a way that no 
range check is needed on the lookahead table to verify that the next input
token is valid.  This makes the lookahead table slightly larger (about 120
bytes) but helps the parser to run faster.

FossilOrigin-Name: 7eb0198d0102e97e4b7ad9e359d95985e55e09c510ea4b360265ac8feb9ed814
 2017-12-25 04:15:38 +00:00
drh
ef53a9f0af In the LEMON-generated parser, avoid unnecessary tests for the acceptance 
state.

FossilOrigin-Name: fdbb35c54f2b6cb65d04ac295f207ff3e69360e0558348c77eb5e62691807046
 2017-12-25 00:10:05 +00:00
drh
5c8241b875 In the LEMON-generated parser, rearrange the meanings of integer action codes 
so that reduce actions occur last.  This means that the most common case
(reduce actions) can be recognized with a single comparison operation, thus
speeding up the main parser loop, slightly.

FossilOrigin-Name: 7bfe7a360261ac7227840db49487c2f0fe338a2f1b868fcaada1e04a8d2b8f7a
 2017-12-24 23:38:10 +00:00
drh
e58f74f680 Improved parser tracing output. 
FossilOrigin-Name: 25be5750545b7b0ed9e1a1baca31611b354519688f875aa1590b21bb6ff42f1b
 2017-12-24 17:06:41 +00:00
drh
087316ceec In the LEMON parser generator, provide reduce actions with access to the 
lookahead token.

FossilOrigin-Name: 42af190f4f86ad60de02800054010fafd484ac86ca41e2a13799b2e583eea98c
 2017-12-15 12:22:21 +00:00
drh
de6422a609 Improvements to a comment in lempar.c. No code changes. 
FossilOrigin-Name: 8000d230171fe53599fc6a916666f60f88f789e6c9c6c2869514c02d837d6fc8
 2017-10-02 02:32:12 +00:00
drh
92395c59ff Fix a problem in the lempar.c Lemon template for YYSTACKDEPTH<=0 introduced 
by check-in [36e54cd8b1fb37]

FossilOrigin-Name: 268a40f44cea6c3f561b7f54c90d631877be44292911424bac24f72c5ee87d60
 2017-07-04 12:50:00 +00:00
drh
8b471e7e79 Faster parser stack overflow detection. 
FossilOrigin-Name: 36e54cd8b1fb374fd41e3e09b34b86e34327bf07c9e4bfec58382163c5c5d279
 2017-06-28 15:01:35 +00:00
drh
6be95366c7 In the lemon-generated parser, store the number of symbols on the RHS of each 
rule as a negative number and add it to the stack pointer, rather than storing
the value as a positive and subtracting it.  This makes the parser faster.

FossilOrigin-Name: b362f0d8ed34839bf3b29d10ed0853ab94245fba135ccd28e619caa6ee6992d5
 2017-06-28 13:47:56 +00:00
drh
bd8fcc130a In the lemon-generated parser, automatically promote SHIFTREDUCE actions on 
nonterminal systems to pure REDUCE actions, for a performance enhancement.

FossilOrigin-Name: c46d94a8cde816ca383e771721ebd4900de77950cba700e35a26f70fd5b794a4
 2017-06-28 11:56:18 +00:00
drh
d26cc54183 In the amalgamation, allocate the parser engine object from stack rather than 
from heap, for improved performance.  This only happens in the amalgamation,
since otherwise the sqlite3RunParser() routine does not know the object size.

FossilOrigin-Name: 4fe879d4b5da6ae0688a7a99004683a234966597
 2017-01-28 20:46:37 +00:00
drh
634133183c In the LEMON parser-generator, fix the stack overflow processing so that it 
correct invokes the destructor on the top-level of the parse stack.

FossilOrigin-Name: e8247065cf1d929f42d13864f8a1886ed4d329cd
 2016-12-06 17:59:05 +00:00
drh
4eda15e715 Fix a problem with the lempar.c parser template. 
FossilOrigin-Name: 3a9d802fda10585654332b314d317250dc5d894e
 2016-10-04 12:20:12 +00:00
drh
701b68879c Improved comments on the lempar.c parser template. Adjust the 
YY_SHIFT_USE_DFLT constant in the Lemon-generated parser tables so as
to guarantee that it is always out of range of the yy_lookahead[] table.

FossilOrigin-Name: 83622f3f50030e4d6abafb99d99742928aaf157c
 2016-08-10 13:30:43 +00:00
drh
c83db9e4e1 Performance optimization in the yy_find_shift_action() routine of the 
Lemon-generated parser.

FossilOrigin-Name: ba6663beefcc8060e6f3be6ab37c13fdbb08b7de
 2016-08-10 01:43:30 +00:00
drh
dd703e22a5 Fix the error counter reset in Lemon generated parsers. This has no effect 
on SQLite.

FossilOrigin-Name: 3ef93950d30b34d852d6bbc101d433a04112868a
 2016-07-12 19:54:49 +00:00
drh
d3d4b3c698 Another attempt to fix error handling in Lemon. This change is a no-op for 
SQLite's usage.

FossilOrigin-Name: e1d8ef311cabcb96495a88404991b1416655e4a8
 2016-07-08 19:54:38 +00:00
drh
e0a6e0fda0 More fixes to Fossil so that it automatically resets its error counter at the 
end of a parse.

FossilOrigin-Name: 2683b375ad1291172fdb47d94e16fcf869c78c8a
 2016-07-05 16:11:26 +00:00
drh
240c7faf8b Attempt to reset the error count in the Lemon-generated parser after 
a parse failure.

FossilOrigin-Name: 91889fa30e84760e0d4b3d429c4abdef5a3f7931
 2016-07-05 12:47:28 +00:00
drh
0efd37f28b Fix lempar.c so that the shift-reduce optimization works for error processing. 
This is a Lemon issue only and has no impact on SQLite.

FossilOrigin-Name: 3665a2f554e5b8d2717d952dbaf325a39c637c31
 2016-06-06 18:17:36 +00:00
drh
4335ad05b8 Initialize the yyerrcnt variable in the lemon parser template. This has no 
effect on SQLite itself.

FossilOrigin-Name: 45531654f7f5be3a08e9ee8598f14efe028245d8
 2016-06-06 13:24:57 +00:00
drh
8dc8247eab Fix Lemon so that it actually works with -DYYSTACKDEPTH=0. 
FossilOrigin-Name: a9be4c2d56d08fea2cd1aab20b19092a45ef7620
 2016-05-27 04:10:47 +00:00
drh
baf254aef9 Fix the Lemon-generated parser so that it compiles with -DYYSTACKDEPTH=0. 
It does compile now, but there are subtle issues still.

FossilOrigin-Name: 28d439f816d2fa5263e1c4ddecf3bf1ac2dd6549
 2016-05-27 01:07:18 +00:00
drh
756b41ebd4 Enhance Lemon and the parser template so that it can once again build parsers 
that have no unreachable branches.

FossilOrigin-Name: 41fd46e2962ba9a1e1f6867567499d1f6f5b8372
 2016-05-24 18:55:08 +00:00
drh
abecc0b883 Improvements to the initialization of the push-down automoton for the 
Lemon-generated parser.  Smaller and faster.

FossilOrigin-Name: 3b28b68e232060f8b2fe2fe6fa478280da2006ff
 2016-05-24 00:40:54 +00:00
drh
118ab65859 Use a pointer to the top of the stack rather than an index into the stack 
in the Lemon-generated parser template, for about 6.6% parser performance gain.

FossilOrigin-Name: 3c2a770549d5bb65fcd6cc684e0a0ae6d641ac68
 2016-05-23 21:56:24 +00:00
drh
4ef07708df Enhance Lemon so that it reorders the reduce rules such that rules without 
actions occur at the end and so that the first rule is number 0.  This
reduces the size of the jump table on the reduce switch, and helps the parser
to run faster.

FossilOrigin-Name: d5712f21ec758ff096a7b1bb8ed4fc5ec400ca5d
 2016-03-16 19:45:54 +00:00
drh
51381c208e Omit the unused yyzerominor constant. 
FossilOrigin-Name: 60ad68a9f569d2446d76a6453be4fa1c4ed2cd93
 2016-02-19 13:19:22 +00:00
drh
43303de97e More agressive use of /*A-overwrites-X*/ in the parser. Fix an off-by-one 
error in parser stack overflow detection.

FossilOrigin-Name: 417e777701bbf4bd67626d4ca3bc2c5d847f6cd0
 2016-02-17 12:34:03 +00:00
drh
dabd04c656 Further improvements to the Lemon-generated code for yy_reduce(). 
FossilOrigin-Name: ef95a7d6490e33a9af4bc7b4b622de7328742ca7
 2016-02-17 01:46:19 +00:00