Re: [RFC PATCH] tests/avocado: move aarch64 boot_linux tcg tests and slim down

[Philippe Mathieu-Daudé]

On 17/11/22 13:19, Alex Bennée wrote:
> The boot_linux tests download and run a full cloud image boot and
> start a full distro. While the ability to test the full boot chain is
> worthwhile it is perhaps a little too heavy weight and causes issues
> in CI. Fix this by dropping the TCG tests in boot_linux and replacing
> them with a alpine linux ISO boot in machine_aarch64_virt.
>
> This boots a fully loaded -cpu max with all the bells and whistles in
> 41s on my machine. A full debug build takes around 250s on my machine
> so we set a more generous timeout to cover that.
>
> We do drop testing for lesser GIC versions although there is some
> coverage for that already in the boot_xen.py tests. If we want to
> introduce more comprehensive testing we can do it with a custom kernel
> and initrd rather than a full distro boot.
>
> Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
> ---
>   tests/avocado/boot_linux.py           | 43 +++++--------------------
>   tests/avocado/machine_aarch64_virt.py | 46 ++++++++++++++++++++++++++-
>   2 files changed, 53 insertions(+), 36 deletions(-)
I'd rather keep the current tests but:
  1/ rename them as '_cloud_image',
  2/ skip them on CI
and 3/ add the '_alpine' tests to run on CI.