Krzesimir Nowak
e1d9beaeee
ci-automation: Fix passing multiple test names to vendor scripts
2022-05-10 12:46:02 +02:00
Krzesimir Nowak
f0765e22c3
ci-automation: Let vendor scripts know if this is their first run
...
I will need it to correctly handle test reruns as we will need to
handle passed test names differently on first runs than on reruns.
2022-05-10 12:46:02 +02:00
Krzesimir Nowak
2fe896b558
ci-automation: Add retest cycle breaking functionality
2022-05-06 09:16:23 +02:00
Krzesimir Nowak
1d6f38a72e
ci-automation: Reduce boilerplate in vendor tests
...
Move the common setup to the vendor_test.sh script, which will be
sourced by the vendor scripts.
2022-05-05 12:57:14 +02:00
Krzesimir Nowak
1916936e34
ci-automation: Update test.sh script docs
...
We are not using SDK container for running the tests any more - it was
replaced with mantle container. Update the docs accordingly.
2022-04-20 16:34:07 +02:00
Kai Lueke
da0380c7e8
Run CI container pipeline kola tests with the new mantle image
...
The SDK container does not exist for arm64 and is quite heavy. We
currently also resort to a unconditional rebuilding of mantle inside
the SDK.
Use the new mantle container image to run kola tests, and pin its
version through a text file that gets updated by GitHub Actions.
2022-04-20 19:13:02 +09:00
Thilo Fromm
6dcfd9aeb6
ci-automation/test.sh: remove PARALLEL_TEST passing (move to CI)
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-04-01 13:59:47 +02:00
Thilo Fromm
1e0dc777fe
ci-automation/test.sh: export PARALLEL_TESTS
...
Export PARALLEL_TESTS in the container's .env file to ensure it is
passed to the vendor script.
2022-03-23 12:11:12 +01:00
Thilo Fromm
6286b0a442
ci-automation/test.sh: use the latest kola from coreos-overlay
2022-03-16 14:14:46 +01:00
Thilo Fromm
d266229434
ci-automation/test.sh: handle unset PARALLEL_TESTS
...
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-03-10 08:24:44 +01:00
Thilo Fromm
8ca2393eb8
automation/test.sh: pass PARALLEL_TESTS to container
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-09 17:38:15 +01:00
Thilo Fromm
e92521c166
ci-automation/test*: per-image summary, honor parallel
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 11:30:54 +01:00
Thilo Fromm
3253435d6c
ci-automation/test.sh: publish to _kola_tmp, not debug/_kola_tmp
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:27:36 +01:00
Thilo Fromm
3397167b5e
Update ci-automation/test.sh: fix typo.
...
Co-authored-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-02-22 18:13:15 +01:00
Thilo Fromm
8157bf0302
ci-automation: publish test results, add to GC
...
This change adds copying test results to the build cache server, and
adds respective deletion to the garbage collector.
Also, the patch fixes an issue with torcx publishing (manifest
publishing had arch hard-coded).
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 16:22:57 +01:00
Thilo Fromm
4f39e0112f
ci-automation/tests.sh: use http in torcx manifest
...
Use HTTP instead of https because Ignition does not recognise
letsencrypt certificates, leading to test breakage in
docker.torcx-manifest-pkgs.
Add a note in settings.env to explicitly call out HTTP requirement of
build cache server.
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-21 17:23:53 +01:00
Thilo Fromm
0fa985b872
ci-automation/test.sh: stage torcx manifest
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-21 16:30:30 +01:00
Thilo Fromm
bee5ac7f74
ci-automation/tapfile: enforce foreign keys, simplify
2022-02-21 12:56:45 +01:00
Thilo Fromm
cafa385164
ci-automation: publish torcx json and use in tests
...
This change updates the package build script to publish the torcx
manifest file to the build cache so it can be used by tests.
It also updates the generic test script to use the SDK container instead
of the packages container image, and to download and use the torcx
manifest from the build cache.
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-18 15:52:47 +01:00
Thilo Fromm
a5b958fd07
ci-automation/test.sh: fix reruns, set retry to 20
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-18 14:40:18 +01:00
Thilo Fromm
3a416fbf32
ci-automation testing: address PR review comments
...
- add cleanup script to test.sh
- remove wrapper function from qemu test
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-17 12:30:36 +01:00
Thilo Fromm
5bfe2f395c
Apply @pothos' suggestions from code review
...
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-17 10:29:05 +01:00
Thilo Fromm
f6f44e2ca8
ci-automation: first stab at adding testing
...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-16 19:59:45 +01:00