[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[PULL 06/14] tests/functional: Prepare the meson build system for the fu
From: |
Philippe Mathieu-Daudé |
Subject: |
[PULL 06/14] tests/functional: Prepare the meson build system for the functional tests |
Date: |
Mon, 29 Jul 2024 17:27:06 +0200 |
From: Thomas Huth <thuth@redhat.com>
Provide a meson.build file for the upcoming python-based functional
tests, and add some wrapper glue targets to the tests/Makefile.include
file. We are going to use two "speed" modes for the functional tests:
The "quick" tests can be run at any time (i.e. also during "make check"),
while the "thorough" tests should only be run when running a
"make check-functional" test run (since these tests might download
additional assets from the internet).
The changes to the meson.build files are partly based on an earlier
patch by Ani Sinha.
Signed-off-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Fabiano Rosas <farosas@suse.de>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240724175248.1389201-5-thuth@redhat.com>
[PMD: Removed call to check-func target in check-functional rule]
Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
---
tests/Makefile.include | 11 ++++++
tests/functional/meson.build | 66 ++++++++++++++++++++++++++++++++++++
tests/meson.build | 1 +
3 files changed, 78 insertions(+)
create mode 100644 tests/functional/meson.build
diff --git a/tests/Makefile.include b/tests/Makefile.include
index 167d8f29a4..9077d5c6f0 100644
--- a/tests/Makefile.include
+++ b/tests/Makefile.include
@@ -9,6 +9,8 @@ check-help:
@echo "Individual test suites:"
@echo " $(MAKE) check-qtest-TARGET Run qtest tests for given
target"
@echo " $(MAKE) check-qtest Run qtest tests"
+ @echo " $(MAKE) check-functional Run python-based functional
tests"
+ @echo " $(MAKE) check-functional-TARGET Run functional tests for a
given target"
@echo " $(MAKE) check-unit Run qobject tests"
@echo " $(MAKE) check-qapi-schema Run QAPI schema tests"
@echo " $(MAKE) check-block Run block tests"
@@ -152,6 +154,15 @@ check-acceptance-deprecated-warning:
check-acceptance: check-acceptance-deprecated-warning | check-avocado
+FUNCTIONAL_TARGETS=$(patsubst %-softmmu,check-functional-%, $(filter
%-softmmu,$(TARGETS)))
+.PHONY: $(FUNCTIONAL_TARGETS)
+$(FUNCTIONAL_TARGETS):
+ @$(MAKE) SPEED=thorough $(subst -functional,-func,$@)
+
+.PHONY: check-functional
+check-functional:
+ @$(MAKE) SPEED=thorough check-func-quick
+
# Consolidated targets
.PHONY: check check-clean get-vm-images
diff --git a/tests/functional/meson.build b/tests/functional/meson.build
new file mode 100644
index 0000000000..7fc9c4e513
--- /dev/null
+++ b/tests/functional/meson.build
@@ -0,0 +1,66 @@
+# QEMU functional tests:
+# Tests that are put in the 'quick' category are run by default during
+# 'make check'. Everything that should not be run during 'make check'
+# (e.g. tests that fetch assets from the internet) should be put into
+# the 'thorough' category instead.
+
+# Most tests run too slow with TCI enabled, so skip the functional tests there
+if get_option('tcg_interpreter')
+ subdir_done()
+endif
+
+# Timeouts for individual tests that can be slow e.g. with debugging enabled
+test_timeouts = {
+}
+
+tests_generic = [
+]
+
+tests_x86_64_quick = [
+]
+
+tests_x86_64_thorough = [
+]
+
+foreach speed : ['quick', 'thorough']
+ foreach dir : target_dirs
+ if not dir.endswith('-softmmu')
+ continue
+ endif
+
+ target_base = dir.split('-')[0]
+ test_emulator = emulators['qemu-system-' + target_base]
+
+ if speed == 'quick'
+ suites = ['func-quick', 'func-' + target_base]
+ target_tests = get_variable('tests_' + target_base + '_quick', []) +
tests_generic
+ else
+ suites = ['func-' + speed, 'func-' + target_base + '-' + speed, speed]
+ target_tests = get_variable('tests_' + target_base + '_' + speed, [])
+ endif
+
+ test_deps = roms
+ test_env = environment()
+ if have_tools
+ test_env.set('QEMU_TEST_QEMU_IMG', meson.global_build_root() /
'qemu-img')
+ test_deps += [qemu_img]
+ endif
+ test_env.set('QEMU_TEST_QEMU_BINARY',
+ meson.global_build_root() / 'qemu-system-' + target_base)
+ test_env.set('QEMU_BUILD_ROOT', meson.project_build_root())
+ test_env.set('PYTHONPATH', meson.project_source_root() / 'python:' +
+ meson.current_source_dir())
+
+ foreach test : target_tests
+ test('func-@0@/@1@'.format(target_base, test),
+ python,
+ depends: [test_deps, test_emulator, emulator_modules],
+ env: test_env,
+ args: [meson.current_source_dir() / 'test_' + test + '.py'],
+ protocol: 'tap',
+ timeout: test_timeouts.get(test, 60),
+ priority: test_timeouts.get(test, 60),
+ suite: suites)
+ endforeach
+ endforeach
+endforeach
diff --git a/tests/meson.build b/tests/meson.build
index acb6807094..3345ad2098 100644
--- a/tests/meson.build
+++ b/tests/meson.build
@@ -85,3 +85,4 @@ subdir('unit')
subdir('qapi-schema')
subdir('qtest')
subdir('migration')
+subdir('functional')
--
2.45.2
- [PULL 00/14] Docs / testing patches for 2024-07-29, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 02/14] docs/sphinx/depfile.py: Handle env.doc2path() returning a Path not a str, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 01/14] docs: add test for firmware.json QAPI, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 03/14] python: Install pycotap in our venv if necessary, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 04/14] tests/functional: Add base classes for the upcoming pytest-based tests, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 05/14] tests/Makefile.include: Increase the level of indentation in the help text, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 06/14] tests/functional: Prepare the meson build system for the functional tests,
Philippe Mathieu-Daudé <=
- [PULL 08/14] tests/functional: Convert avocado tests that just need a small adjustment, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 07/14] tests/functional: Convert simple avocado tests into standalone python tests, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 09/14] tests/functional: Convert the x86_cpu_model_versions test, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 10/14] tests/functional: Convert the riscv_opensbi avocado test into a standalone test, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 11/14] gitlab-ci: Add "check-functional" to the build tests, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 12/14] tests/avocado: mips: fallback to HTTP given certificate expiration, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 13/14] tests/avocado: mips: add hint for fetchasset plugin, Philippe Mathieu-Daudé, 2024/07/29
- [PULL 14/14] tests/avocado: test_arm_emcraft_sf2: handle RW requirements for asset, Philippe Mathieu-Daudé, 2024/07/29
- Re: [PULL 00/14] Docs / testing patches for 2024-07-29, Daniel P . Berrangé, 2024/07/29