Commit Graph

138 Commits

Author SHA1 Message Date
kre e045f926b6 Add two new sub-tests to the c_line_wrapping test case.
These should detect if the errors that caused MAKDEV to fail and
pkgsrc/pkgtools/cwrappers to fail to build (problem detected in
libnbcompat/configure) ever return.

Also fixed one of the other sub-tests so that it actually does what
it should - no idea how this one has been passing, it did not for me
when I was checking the new ones (but perhaps in the interim I have
fixed something else in sh, the problem was in the area I have been
playing, and I originally debugged the new tests using a newer version
of /bin/sh than has yet been committed.)
2017-06-09 23:49:58 +00:00
kre 9817a5b1e5 Paranoia: add a new test case testing that $(( )) results get split
by IFS just the same as any other expansion (split when they should be,
and not when they shouldn't).

Good thing I did ... this discovered a regression in the new expand
code (from an hour or three ago) where quoted arith expansions are
being split, and shouldn't be.  (on the other hand, when they should
be split, they are being split correctly, so that's good...)

No need to worry too much about this, in real life (as opposed to
torture tests) no-one ever puts digits in IFS, and a $(( )) expansion
only ever contains digits, so in practice, splitting never happens,
whether because it is quoted, or just becaue there is nothing to split.

The FreeBSD shell does it correctly (they do word splitting using a
totally different mechanism than we do) - I will find where I missed
testing for quoted expansions later tonight.  Until that happens,
expect a test failure from t_fsplit:split_arith

While here add more comments in the other test casess (one had a comment
already) that our shell parses incorrectly (this is a parsing problem,
not an expansion problem, and the bug has existed forever .. and is
shared by bash).

That is, in an expression like "${var:-word}" the whole thing (including
word) is quoted by the double quotes, and in "${var:-"word"}" the
expansion is quoted, but 'word' is not, the 2nd " (the one before 'w')
ends the opening quote, and the third (before }) turns quoting on
again (it is required that there be an even number of unquoted quotes inside
a ${} expression, so things like "${var:-"word} are simply invalid.)
Another way of saying this, is that if the { is quoted (for which the
only way is using " to get to this kind of expansion at all) the }
must also be quoted (" quoted).  There is no quote nesting here.

This also means that in "${var:-'word'}" the single quotes are just
characters, they are quoted by the "" that surround them, just as in
"a 'string' containing quotes", but "${var:-"'word'"}} is valid and
contains a single quoted word.

Note that this is different than the patetrn-match/trim expansions
( ${var%pattern} etc) where any surrounding quotes do not affect the
pattern, and all forms of quoting can be used in it - but it always
parses as a pattern, and is never subject to filename expansion, so
a '*' in it that is to mean "match any string" does not need special
quoting to avoid it expanding to file names, regardless of whether
the ${var%*} is quoted or not, but a * that is to be matched as a
character literally does need to be quoted.

I will probably file a PR about this bug sometime, but as it is
very old, and doesn't every seem to bother anyone (and is shared by
bash) there isn't any big hurry to open yet another verry messy can
of excrement to fix it...

This does mean that the FreeBSD shell "fails" some of our tests.
(The test is wrong, their shell is correct.)
2017-06-03 15:15:49 +00:00
kre a12c6cfae6 Complete the special request by quoting chapter & verse from POSIX
as to why ${011} is ${11} and not ${9} (that is, why we interpret it
that way, the "why could it not be the other way?" is just "because
that is not how it was ever implemented".
2017-06-03 14:45:59 +00:00
kre 25950655c8 By special request, add a check that ${011} is ${11} not ${9} (etc) and
that ${08} is not an error.
2017-06-03 11:23:01 +00:00
kre 3806d6f4e4 Add some extra sub-tests checking splitting of ${#var} - just for my
piece of mind (to verify I was not breaking anything here.)

Also added some commentary better explaining why one of the tests of splitting
quoted variable expansions is almost certainly incorrect (both the tests,
and what sh does) ... though bash does the same as us, so all is not lost!
2017-06-03 10:27:05 +00:00
kre f0acc68ec6 Add a new test case "nested_arith" (that is, things like $(( 1 + $(( 2 )) ))
which will currently fail (some of the sub-tests, but this one stops on
first failure, so the test simply fails.)  This will be corrected later today.
2017-06-02 01:50:48 +00:00
kre 3782bd48c9 Add 3 new subtests to the shell_params test case. These test currently
broken behaviour (so for now, 3 of 15 subtests will fail).   This will
be corrected later today.
2017-06-02 01:48:13 +00:00
kre 06627d31e7 One more weird test of parsing (and correctly understanding) words
whose meaning is defined entirely by context.

For those who read commit messages, and want a (small) challenge,
work out where (and what) to insert as punctuation/operator chars
in the following to produce 3 ines of output, and what those will be:

	for in in in do in do case in in in echo do do echo in esac done

(There are no comments, quotes of any kind, or any kind of sub-shell,
including cmd substitutions)  With correct non alpha-numeric chars added,
it works.
2017-06-02 01:45:06 +00:00
kre bdbf3d66ba Guard against EVN being set, and possibly referencing an unset
variable, when we are running tests with sh -u
2017-06-02 01:38:44 +00:00
kre 6768e34b73 Add a new test case wrap_strip based upon strip (ie: cut&paste.. to start)
but with \ newline line continuations inserted at strange places.

For the shell as it is today, since strip passes, wrap_strip should
automaticallty pass as well (and does), as the \ newline combination
is simply removed, producing identical input to that of strip.

However, for accurate line counting ($LINENO: coming soon) newlines (no
matter the context) cannot simply "go away" - we have to know where they
occur(ed) (perhaps long after the text was read)  so we know what line
number we are actually processing.   This new test case is (perhaps just
part) of future-proofing that the modified code does not break anything.
2017-05-29 22:27:47 +00:00
kre ff906b151f Skip the test of non-posix behaviour if we are deliberately trying
to be posix compatible (POSIXLY_CORRECT is set).
2017-05-27 13:11:50 +00:00
kre 79115595d5 Add a test of sh syntax & parsing (first attempt anyway.) 2017-05-20 16:35:55 +00:00
kre 22a6d2dd08 More test sub-cases for the dollar_hash ( ${#...} ) test.
Upi really (really!) don't want to know!

Also, add a comment (in another section) and avoid giving messages
to atf_fail that include newlines - AFT really doesn't like that.
Instead, convert the \n's to ;'s so at least the content is retained.
2017-05-15 19:53:40 +00:00
kre c70ddc9b88 Add a test for opening files with exec "when" in posix mode (close-on-exec
should not get set.)  While here, remove the (unused) runhelper() function.
2017-05-14 17:28:46 +00:00
kre a30f469fdd Add a test case for the various ways that ${xxx} expansions, which
contain a # character, can get parsed (which amounts to 86 extra checks,
any Australian can tell you why I decided to stop there and not add one
more...)
2017-05-14 11:28:49 +00:00
kre a787cac634 PR bin/52090 - the $* tests are no longer expected to fail. 2017-03-20 11:48:41 +00:00
kre 0c0af3f55d Add tests for the $(( )) assignment operators PR bin/50958 2017-03-20 11:32:51 +00:00
kre 86dd15a646 PR bin/52090
Add 5 new test cases to test various ways that $* can be expanded.
Currently 3 of the 5 are marked as "expected to fail" because of the
bug in this PR.
2017-03-19 20:29:30 +00:00
kre 706a2d4f09 Add new test case in to check (coming) bug fix for newly discovered
ash based shell bug
	echo ${unset_var##$(echo a)}$(echo b)
should say "b" but instead says "a" ... the first "echo a" is not
evaluated because it cannot possibly match an unset variable, but is
not removed from the list of command substitutions, when the shell
needs to execute the 2nd cmdsub, "echo b" should be at the head of
the list, but isn't, "echo a" is still there...

This test should fail (for now) - should show 4 of 40 subtests failing.
It isn't marked as atf_expect_fail as the fix for this will be coming
later today (I will just wait at least 1 b5 build cycle so the failure
can be observed).

Detecting the bug, and the fix, are from FreeBSD.
2017-03-12 00:39:47 +00:00
sevan efb5f2c4e7 PR bin/4841 was filed regarding the handling of blank lines when cat was invoked
with -be, the test case however did not utilise any blank lines, only testing
that the text was aligned.
2016-06-26 22:50:46 +00:00
sevan 17a9d10433 Add a unit test for PR bin/51250 called se_output. se_output checks the output of cat
when invoked with '-se', to ensure that a '$' is printed on blank lines.
2016-06-16 01:04:58 +00:00
kre c80063823d Use valid (standard) shell syntax, in anticipation of /bin/sh enforcing
it sometime soon (perhaps.)
2016-05-17 09:05:14 +00:00
kre b752c81378 Add a new test case to validate N>&N redirect disables close-on-exec.
OK christos@
2016-05-15 15:44:43 +00:00
kre cd13213fdd Add another test for the 48875 fix fallout... 2016-05-14 00:33:02 +00:00
kre e588572b24 Grunge. I know I fixed this typo before... must have been in a different
couy of the test.
2016-05-12 14:25:11 +00:00
kre 2f35ca415e Verify that questionable characters don't have bad associates.
ok christos@
2016-05-12 13:34:23 +00:00
kre 5ab36d6022 Add a test for fd redirections on functions in loops (the etcupdate issue)
and also fix a quoting bug which was causing a test to fail, though
ATF was ignoring (an ATF bug to be investigated later.)

OK christos@
2016-05-11 17:43:17 +00:00
kre 07e424459c PR bin/48875 PR bin/51123 This adds tests more that verify fide descriptor
redirection works correctly (including that the bugs reported in those PRs
are fixed.)  Note that the tests for 48875 are slow, so one of the new
test cases ends up running > 25 seconds (just doing sleeps) - each individual
test is just a few seconds, but there are several of them.

OK christos@
2016-05-09 22:34:37 +00:00
kre 44b3998960 Remove the trap_zero__explicit_return test case - it was testing undefined
behaviour (and failed with the NetBSD shell, and was marked as expected to
fail.)   Other shells do different things.   The test was worthless, and is
now gone.

OK christos@
2016-05-07 23:51:30 +00:00
christos 28ac500a6d More redirect tests, in particular, tests for redirects to/from
file descriptors outside the 0..9 range, and complex fd
reassignments.  Also test that the shell can cope with the
value of ulimit -n changing (downwards, up is harmless)
(Freom kre@)
2016-05-02 01:47:14 +00:00
christos c6dfc962be use "" so ${TEST_SH} is expanded. 2016-04-29 18:29:17 +00:00
christos 2e4e2294f3 Add a test case for here documents positioned outside `` with the
redirect operator inside the ``.   Move the one similar test using
$( ) into its own test case (and expand that test as well.
The `` case was omitted before, as no shells (including NetBSD) were
parsing it correctly,  Now the NetBSD shell does, so ... (from kre@)
2016-04-04 12:40:13 +00:00
christos 9f1b8a789b Avoid leaving turds in /tmp. (from kre@) 2016-03-31 16:22:54 +00:00
christos 87a25451df When embedding a command in a subshell "( ... )" avoid accidentally
producing (( (when the cmd starts with a '(' as that as a reserved
sequence (according to posix) and some shells do treat it specially.
So, force a space after the enclosing '(' to avoid the problem.
For symmetry, put a space before the concluding ')' as well, though
there is nothing special about )). (from kre@)
2016-03-31 16:22:27 +00:00
christos de3efde923 Added lots more end delimiter tests (some weird cases...). Also
use printf %s instead of echo, as there are embedded \ chars in
some of the strings, and some other (nameless) shells insist on
treating \ in the args to echo as something special... (from kre@)
2016-03-31 16:21:52 +00:00
christos 3f90444865 PR bin/51027 - tests for shell positional parameters, including
testing that $10 is correctly parsed as ${1}0 and not as ${10}.
More than that though. (from kre@)
2016-03-31 16:21:10 +00:00
christos 54d4333f65 Added tests collected by Sven Mascheck
http://www.in-ulm.de/~mascheck/various/cmd-subst/
which test cases of ')' being embedded in command substitutions.
(from kre@)
2016-03-31 16:20:39 +00:00
christos 8f7ab1d41a Don't confuse more capable shells by writing operator combinations
that could be interpreted as something different. That is, for our
shell +4++3 is just (+4)+(+3) and works fine. But others treat ++
as the increment operator.  Same for --. Sprinkle spaces to taste.
(from kre@)
2016-03-31 16:19:52 +00:00
christos 32b59da6c9 Allow for testing other than /bin/sh using TEST_SH (from kre@) 2016-03-27 14:57:50 +00:00
christos aa36454cd0 Finish these tests (or at least, fill in the place holder tests
with actual code ... tests are never really finished.)  One of these
new tests was how the bug in PR bin/50993 was discovered. (from kre@)
2016-03-27 14:53:17 +00:00
christos bb5046e57f PR bin/50993 - lots of new here document tests to validate all of
the changes made to fix that PR.   LOTS more tests...  A few general
improvements to the way the tests work and results are reported
as well. (from kre@)
2016-03-27 14:52:40 +00:00
christos e0530cd421 More tests, add protection against shells that allow wait N
to wait for the same process over and over again (forever) (???)
This test now takes slightly over 20 seconds to complete (elapsed
time) caused by all the waiting on sleep commands being run in
the background. (from kre@)
2016-03-27 14:50:40 +00:00
christos c43f84898f Finish TEST_SH - all tests should support it now.
Misc other KNF changes, minor bug fixes, and a few minor
extra tests added. (from kre@)
2016-03-27 14:50:01 +00:00
christos 8130505f80 Avoid relying on the test shell correctly implementing $(( ))
in order for some of the redirect tests to terminate. (from kre@)
2016-03-27 14:49:07 +00:00
christos bb9d40a374 new command substitution test from kre 2016-03-20 22:57:04 +00:00
christos e04f666a7e Better tests for redircloexec and add t_shift (from kre) 2016-03-16 21:13:51 +00:00
christos 487f18f8df remove binary test and other cleanups (from kre) 2016-03-16 17:39:12 +00:00
christos 96320c1795 New tests from kre 2016-03-16 15:49:19 +00:00
christos 239c335529 Add some redir-close-on-exec tests 2016-03-13 18:55:12 +00:00
christos 796504694c Implement TEST_SH for this test, add a test or two, and also some
commentary to explain some of the weirdness of shell quoting. (from kre@)
2016-03-12 14:58:03 +00:00
christos acfb0ca6d6 Set TEST_SH 2016-03-10 22:30:57 +00:00
christos 2c3c3b3c5b Added more test cases, more exhaustive testing. (from kre) 2016-03-08 14:26:54 +00:00
christos c5b16bb470 remove old test 2016-03-08 14:26:34 +00:00
christos e4619cdffb Tests for the shift builtin (from kre) 2016-03-08 14:26:26 +00:00
christos 491442e6cd This test tests nothing not tested elsewhere, and doesn't
do a very good job of that. Bang! (from kre)
2016-03-08 14:24:50 +00:00
christos c74a97456e Complete implementation of TEST_SH, use builting kill (which does
work, now anyway) rather than working around a defect by using
/bin/kill (if the shell is broken, the test should fail, not succeed)
and test more aspects of the wait builtin in the kill test. (from kre)
2016-03-08 14:24:06 +00:00
christos 764b20ba6a Cleanup left over (dead) debugging code (from kre) 2016-03-08 14:21:02 +00:00
christos e408fa7e5e Correct one test that (while OK for NetBSD) insisted on behaviour
that is not required by the standard. The test now allows either
of the two allowed responses. Also add commentary correcting
erroneous comments about what is correct, and incorrect. (from kre)
2016-03-08 14:20:22 +00:00
christos dd894f6fca Correct the way that TEST_SH is used so that the tests work as
intended when TEST_SH is specifies a shell that needs options (like
sh -F, or bash -o posix). (from kre)
2016-03-08 14:19:28 +00:00
christos 06f9bef68e Improved handling of TEST_SH so that it is possible to define it
to the name of a shell, plus options that shell needs to run it
in the correct mode to be tested: eg: TEST_SH='bash -o posix'
Also finished the implementation of tests of "set -n" now that
the NetBSD shell supports that as it should. (from kre)
2016-03-01 12:39:35 +00:00
christos 1843eb8cb0 more tests from kre 2016-02-29 23:52:53 +00:00
christos 22e9b677fe uncomment clean up 2016-02-24 14:42:50 +00:00
christos b189a00530 Test improvements from kre 2016-02-24 14:42:06 +00:00
christos c1ce7cf3ee Add t_option, from kre (with minor edits from me) 2016-02-23 16:20:42 +00:00
christos dd10ee88d0 Add new redirection test, from kre 2016-02-23 14:21:37 +00:00
christos 7b91d0e80f PR/43469 has been fixed 2016-02-22 20:02:29 +00:00
christos 449b5d003c Add new test 2016-02-22 19:52:03 +00:00
christos dd7e4e3700 undo accidental commit 2016-02-19 13:49:01 +00:00
christos 64d8e9d299 Add a test for PR/50827 2016-02-19 13:48:28 +00:00
christos 585297dcfb more robust ulimit test that works with most variants of bourne shells. 2015-12-30 22:24:44 +00:00
ozaki-r 3f3bb7d2ee Add delay to improve stability of test 2015-09-30 06:08:36 +00:00
christos 7ec9eaaab4 another wait test. 2015-08-23 07:15:16 +00:00
dholland 83a65169bb Visit the Bureau of Redundancy Department.
From Henning Petersen in PR 49191.
2014-09-11 18:25:30 +00:00
apb 91bc8fa990 Run scripts at build time via ${HOST_SH} 2014-07-27 14:24:17 +00:00
christos 9462261d53 PR/48843: Jarmo Jaakkola: Test cses for break/continue/return broken
inside dot commands:

 The test cases are named with the pattern
     dotscope_cmd_cmdscope,
 where dotscope is the scope in which the dot command is and cmdscope
 is the scope where cmd is in the sourced file.
2014-05-31 14:29:06 +00:00
mlelstv 3ca9670bad Adjust default column test to the changed ps -s output. 2014-01-16 04:16:32 +00:00
ast 83d9b54597 Fix PR bin/48202 [non-critical/low]:
sh +nounset and `for X; do` iteration fails if parameter set empty
by applying and testing FreeBSD's patch of Oct 24 2009 for this; see
  http://svnweb.freebsd.org/base/head/bin/sh/expand.c?r1=198453&r2=198454
Also created an ATF test in tests/bin/sh/t_expand.sh for this error and
corrected a space->tabs problem there as well.
2013-10-06 21:05:50 +00:00
njoly 8d31656afc New testcase to check limits flags for ulimit builtin. 2012-06-11 18:32:59 +00:00
jruoho 144c5468dc Although this does not fail, add a case for the discussion in PR bin/46327. 2012-04-13 06:12:32 +00:00
njoly bd5752189c Add sleep to the list. 2012-03-30 15:49:24 +00:00
jruoho 47dea51ec6 Add regression tests for PR bin/3914 and PR bin/27140. 2012-03-30 09:27:10 +00:00
jruoho 2e3d44b8f5 Fix another type in the metadata. 2012-03-27 17:57:02 +00:00
jruoho 651e2c6948 Add regression tests for the 1990s bugs PR bin/3538 and PR bin/4841. 2012-03-27 08:16:33 +00:00
jruoho 32204f9f4d Add a check for old PR bin/2486. 2012-03-27 07:23:06 +00:00
christos 9c65f155f8 PR/43597 was fixed 2012-03-25 18:50:19 +00:00
christos ec4d512c60 ksh trap has been fixed. 2012-03-25 17:30:59 +00:00
jruoho 2447f335ab Note PR bin/12838. 2012-03-20 06:30:02 +00:00
jruoho 28604916d4 Deprecate tests/util. 2012-03-17 16:33:10 +00:00