qemu/tests/avocado
Alex Bennée 5d25fcb702 gitlab: add optional job to run flaky avocado tests
One problem with flaky tests is they often only fail under CI
conditions which makes it hard to debug. We add an optional allow_fail
job so developers can trigger the only the flaky tests in the CI
environment if they are debugging.

Reviewed-by: Richard Henderson <richard.henderson@linaro.org>
Acked-by: Stefan Hajnoczi <stefanha@redhat.com>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20231201093633.2551497-8-alex.bennee@linaro.org>
2023-12-01 17:47:20 +00:00
..
acpi-bits tests/: spelling fixes 2023-09-08 13:08:52 +03:00
avocado_qemu tests/avocado: Make fetch_asset() unconditionally require a crypto hash 2023-11-16 07:13:41 +01:00
virtiofs_submounts.py.data
acpi-bits.py acpi/tests/avocado/bits: enable console logging from bits VM 2023-11-07 03:39:11 -05:00
boot_linux_console.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
boot_linux.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
boot_xen.py
cpu_queries.py tests/avocado: Replace assertEquals() for Python 3.12 compatibility 2023-11-16 07:13:41 +01:00
empty_cpu_model.py tests/avocado: Replace assertEquals() for Python 3.12 compatibility 2023-11-16 07:13:41 +01:00
hotplug_cpu.py python/qemu: rename command() to cmd() 2023-10-12 14:21:43 -04:00
info_usernet.py python/qemu: rename command() to cmd() 2023-10-12 14:21:43 -04:00
intel_iommu.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
kvm_xen_guest.py tests/avocado: Test Xen guest support under KVM 2023-04-04 15:56:44 +01:00
linux_initrd.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
linux_ssh_mips_malta.py tests/avocado: Make ssh_command_output_contains() globally available 2023-04-27 14:58:23 +01:00
load_bflt.py tests/avocado: Add bFLT loader linux-user test 2021-11-08 17:00:22 +01:00
machine_aarch64_sbsaref.py tests/avocado: tag sbsa tests as tcg only 2023-12-01 17:47:20 +00:00
machine_aarch64_virt.py tests/avocado: update AArch64 tests to Alpine 3.17.2 2023-03-22 15:04:52 +00:00
machine_arm_canona1100.py tests/avocado: Update the URLs of the advent calendar images 2022-11-23 10:58:48 +01:00
machine_arm_integratorcp.py python/qemu: rename command() to cmd() 2023-10-12 14:21:43 -04:00
machine_arm_n8x0.py tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest 2021-11-08 17:00:22 +01:00
machine_aspeed.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
machine_avr6.py tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest 2021-11-08 17:00:22 +01:00
machine_loongarch.py tests/avocado: Add LoongArch machine start test 2023-05-15 19:09:33 +08:00
machine_m68k_nextcube.py tests/avocado: Allow newer versions of tesseract in the nextcube test 2023-11-07 19:26:50 +01:00
machine_microblaze.py tests/avocado: Update the URLs of the advent calendar images 2022-11-23 10:58:48 +01:00
machine_mips_fuloong2e.py tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest 2021-11-08 17:00:22 +01:00
machine_mips_loongson3v.py tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest 2021-11-08 17:00:22 +01:00
machine_mips_malta.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
machine_rx_gdbsim.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
machine_s390_ccw_virtio.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
machine_sparc64_sun4u.py tests/avocado: Update the URLs of the advent calendar images 2022-11-23 10:58:48 +01:00
machine_sparc_leon3.py tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest 2021-11-08 17:00:22 +01:00
mem-addr-space-check.py tests/avocado/mem-addr-space-check: Replace assertEquals() for Python 3.12 2023-11-16 09:21:30 +01:00
migration.py python/qemu: rename command() to cmd() 2023-10-12 14:21:43 -04:00
multiprocess.py tests/avocado/multiprocess: Add asset hashes to silence warnings 2023-11-16 07:13:41 +01:00
netdev-ethtool.py igb: Notify only new interrupts 2023-05-23 15:20:15 +08:00
pc_cpu_hotplug_props.py tests/avocado: Replace assertEquals() for Python 3.12 compatibility 2023-11-16 07:13:41 +01:00
ppc_74xx.py avocado/ppc_74xx.py: check TCG accel for all tests 2022-03-14 15:57:17 +01:00
ppc_405.py avocado/ppc_405.py: check TCG accel in test_ppc_ref405ep() 2022-03-14 15:57:17 +01:00
ppc_amiga.py tests/avocado: Add test for amigaone board 2023-11-07 15:49:41 -03:00
ppc_bamboo.py tests/avocado: Add missing require_netdev('user') checks 2022-10-11 17:25:50 +02:00
ppc_mpc8544ds.py tests/avocado: Update the URLs of the advent calendar images 2022-11-23 10:58:48 +01:00
ppc_powernv.py tests/avocado: Add powernv machine test script 2023-07-07 04:47:49 -03:00
ppc_prep_40p.py avocado/ppc_prep_40p.py: check TCG accel in all tests 2022-03-14 15:57:17 +01:00
ppc_pseries.py tests/avocado: ppc test VOF bios Linux boot 2023-06-25 22:41:31 +02:00
ppc_virtex_ml507.py tests/avocado: Update the URLs of the advent calendar images 2022-11-23 10:58:48 +01:00
README.rst
replay_kernel.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
replay_linux.py tests/avocado: fix waiting for vm shutdown in replay_linux 2023-09-25 08:02:23 +02:00
reverse_debugging.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
riscv_opensbi.py tests/avocado: riscv: Enable 32-bit Spike OpenSBI boot testing 2023-07-10 22:29:14 +10:00
s390_topology.py tests/avocado: s390x cpu topology bad move 2023-10-20 07:16:53 +02:00
smmu.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
tcg_plugins.py tests/avocado: update the tcg_plugins test 2023-11-08 15:15:23 +00:00
tesseract_utils.py tests/avocado: Allow newer versions of tesseract in the nextcube test 2023-11-07 19:26:50 +01:00
tuxrun_baselines.py gitlab: add optional job to run flaky avocado tests 2023-12-01 17:47:20 +00:00
version.py tests/avocado: Replace assertRegexpMatches() for Python 3.12 compatibility 2023-11-16 07:13:41 +01:00
virtio_check_params.py tests/avocado: avoid invalid escape in Python string 2023-10-17 15:20:53 +02:00
virtio_version.py python/qemu: rename command() to cmd() 2023-10-12 14:21:43 -04:00
virtio-gpu.py tests/avocado/virtio-gpu: Fix test_vhost_user_vga_virgl for edid support 2023-11-16 07:13:41 +01:00
vnc.py python: use vm.cmd() instead of vm.qmp() where appropriate 2023-10-12 14:21:44 -04:00
x86_cpu_model_versions.py tests/avocado: Replace assertEquals() for Python 3.12 compatibility 2023-11-16 07:13:41 +01:00

=============================================
Integration tests using the Avocado Framework
=============================================

This directory contains integration tests. They're usually higher
level, and may interact with external resources and with various
guest operating systems.

For more information, please refer to ``docs/devel/testing.rst``,
section "Integration tests using the Avocado Framework".