4683 Commits

Author SHA1 Message Date
Kai Lueke
2e7b4a409f jenkins/kola/aws: run tests on additional instance types
There was a regression for an instance type which could have been
prevented by testing.
Add the same extended test logic used for Equinix Metal to AWS.
2022-03-10 18:23:46 +01:00
Kai Lueke
bdfcf44b34 Merge pull request #251 from flatcar-linux/scripts
jenkins/images: print kernel config changes
2022-03-10 12:45:10 +01:00
Kai Lueke
851c50cac8 jenkins/images: print kernel config changes
Sometimes the Linux build system changes and results in unexpected
kernel config results.
Print changes in the kernel config as part of the image diff report.
2022-03-10 12:45:10 +01:00
Kai Lueke
a41fdb05d3 Merge pull request #247 from flatcar-linux/scripts
ci-automation: set images as official based on version
2022-03-10 12:43:18 +01:00
Kai Lueke
3f66fa7a82 ci-automation: set images as official based on version
The image needs to be set into official mode through a helper script
(see jenkins/images.sh) and the COREOS_OFFICIAL variable needs to be
set for prod_image_util.sh/build_image_util.sh/grub_install.sh.
2022-03-10 12:43:18 +01:00
Thilo Fromm
79fca60a03 Merge pull request #246 from flatcar-linux/scripts
automation/test.sh: pass PARALLEL_TESTS to container
2022-03-10 12:25:26 +01:00
Thilo Fromm
b6627a9fa1 ci-automation/test.sh: handle unset PARALLEL_TESTS
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-03-10 12:25:26 +01:00
Thilo Fromm
888bc0467d automation/test.sh: pass PARALLEL_TESTS to container
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 12:25:26 +01:00
Kai Lueke
c1617cbcb9 Merge pull request #245 from flatcar-linux/scripts
ci-automation: print kola command line
2022-03-10 12:07:03 +01:00
Kai Lueke
22242da2b3 ci-automation: print kola command line
For running kola manually and knowing which parameters where set, it
helps to print the kola command line in the job.
2022-03-10 12:07:03 +01:00
Thilo Fromm
62fdd7013e Merge pull request #249 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: only ASCII chars
2022-03-10 11:34:49 +01:00
Thilo Fromm
d654e49917 ci-automation/tapfile_helper_lib.sh: only ASCII chars
This change removes all non-ASCII characters from test debug / error
output when ingesting the output for inclusion in the TAP report.
Jenkins TAP parser does not handle some unicode chars, leading to tap
parser errors with e.g. Cilium output (which uses unicode).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 11:34:49 +01:00
Jeremi Piotrowski
2ea5bd096f Merge pull request #248 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib: fix commiting last transaction
2022-03-10 10:38:50 +01:00
Jeremi Piotrowski
a1626424ca ci-automation/tapfile_helper_lib: fix commiting last transaction
Move the final db commit to inside the subshell. Since the while loop
runs inside a subshell, the SQL variable outside of the subshell is not
modified, and so the last contents of the SQL variable are dropped. This
shows up when the last couple test cases don't have an error message,
and simply append the transaction to 'SQL'. They are never written to
the db.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-03-10 10:38:50 +01:00
Thilo Fromm
991000a24d Merge pull request #243 from flatcar-linux/scripts
ci-automation: fix tap parser errors
2022-03-08 16:49:07 +01:00
Thilo Fromm
ac773e12e9 ci-automation/tapfile_helper_lib.sh: fix CI TAP parse errors
This change fixes and adds more string chars escaping in the test error
debug output ("\" are removed and a bug in removing '"' is fixed),
addressing a parser errof the CI encountered when ingesting TAP output.

Furthermore, line numbering is shortened, and test names have a spurious
"-" prefix removed.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-08 16:49:07 +01:00
Kai Lueke
57ea7afdb5 Merge pull request #244 from flatcar-linux/scripts
Fix and improve channel handling
2022-03-04 14:27:05 +01:00
Kai Lueke
830b421020 ci-automation: set the channel from the git tag
For now we had only "developer" images in the new pipeline.
Based on the git tag like "alpha-1234.0.0" set the channel (group) for
the image and also use this logic when finding the channel in the QEMU
update test.
2022-03-04 14:27:05 +01:00
Kai Lueke
9c199813f4 jenkins/images: find channel from base channel variable
Using the tags on the branch is not enough to find the channel we want
to be the dev build be related to.
Use the base channel variable which was introduced for this.
2022-03-04 14:27:05 +01:00
Thilo Fromm
6b3ce83c8e Merge pull request #242 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: read test output from file
2022-03-03 09:28:45 +01:00
Thilo Fromm
6c2a121917 ci-automation/tapfile_helper_lib.sh: use subshell, break lines after 200
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:28:45 +01:00
Thilo Fromm
c5858891a6 ci-automation/tapfile_helper_lib.sh: read test output from file
This change updates the tapfile helper to read test output from a file
instead of passig it inline in the SQL INSERT statement.
This fixes an issue with large error output from tests, which breaks
tap_ingest_tapfile():
    ci-automation/tapfile_helper_lib.sh: line 31: /usr/bin/sqlite3: Argument list too long
Error observed with the cl.toolbox.dnf-install test, which can generate
8000 lines of output. Fix tested with the same output.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:28:45 +01:00
Dongsu Park
5ba48dc190 New version: beta-3139.1.0 beta-3139.1.0 2022-03-02 18:17:52 +01:00
Kai Lueke
cb29edd520 Merge pull request #235 from flatcar-linux/scripts
ci-automation: add update test
2022-03-02 11:30:02 +01:00
Kai Lueke
0756ef0287 ci-automation: add missing update test
The kola update test was missing. It is performed as update from the
old image to the newly built payload to ensure that the new image is
compatible for old clients.
2022-03-02 11:30:02 +01:00
Dongsu Park
ddc7ff6fd9 New version: beta-3139.1.0 2022-03-02 08:19:24 +01:00
Dongsu Park
008c557889 New version: beta-3139.1.0 2022-03-01 18:03:35 +01:00
Thilo Fromm
f52e14a04f ci-automation/vendor-testing: add qemu_uefi
This change adds the qemu_uefi.sh vendor test. It reuses most of the
implementation in qemu.sh (qemu_uefi.sh is a soft-link to qemu.sh).

This also enables qemu testing for ARM64.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-25 14:37:08 +01:00
Thilo Fromm
0c70bd87ec Merge pull request #238 from flatcar-linux/scripts
ci-automation: fix test_update_reruns typo
2022-02-24 12:38:41 +01:00
Thilo Fromm
7e7847dcfd ci-automation: fix test_update_reruns typo
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 12:38:41 +01:00
Thilo Fromm
3420518ffa Merge pull request #234 from flatcar-linux/scripts
ci-automation/test*: per-image summary report, honour pre-set PARALLEL_TESTS
2022-02-24 11:13:17 +01:00
Thilo Fromm
eba2b1c259 ci-automation/test*: per-image summary, honor parallel
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 11:13:17 +01:00
Thilo Fromm
b5f894ad69 Merge pull request #232 from flatcar-linux/scripts
ci-automation: publish test results, add to GC
2022-02-23 10:25:32 +01:00
Thilo Fromm
789249bc86 ci-automation/test.sh: publish to _kola_tmp, not debug/_kola_tmp
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:32 +01:00
Thilo Fromm
02c5cc1a21 Update ci-automation/test.sh: fix typo.
Co-authored-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-02-23 10:25:32 +01:00
Thilo Fromm
32eede0808 ci-automation: publish test results, add to GC
This change adds copying test results to the build cache server, and
adds respective deletion to the garbage collector.

Also, the patch fixes an issue with torcx publishing (manifest
publishing had arch hard-coded).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:32 +01:00
Thilo Fromm
2eb76d7cfe Merge pull request #230 from flatcar-linux/scripts
update_sdk_container_image: New SDK container from existing image (minor / patch updates)
2022-02-22 18:38:16 +01:00
Thilo Fromm
2d4b8142e3 update_sdk_container_image: update SDK container image
This change introduces update_sdk_container_image, a script to generate
a new SDK container image based on an existing SDK container. The
script is meant to be used for minor / patch level SDK changes (like
test suite updates).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:38:16 +01:00
Thilo Fromm
366eb2687c Merge pull request #228 from flatcar-linux/scripts
ci-automation: Add foundational testing primitives
2022-02-22 18:36:45 +01:00
Thilo Fromm
b9d497c3a6 ci-automtion/packages.sh: fix torcx URL, add manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
b9a7f4cc19 ci-automation/tests.sh: use http in torcx manifest
Use HTTP instead of https because Ignition does not recognise
letsencrypt certificates, leading to test breakage in
docker.torcx-manifest-pkgs.

Add a note in settings.env to explicitly call out HTTP requirement of
build cache server.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
40c140b4b7 ci-automation/test.sh: stage torcx manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
4269e61a18 ci-automation/README.md: add docs for qemu test 2022-02-22 18:36:45 +01:00
Thilo Fromm
b105019448 ci-automation/tapfile: enforce foreign keys, simplify 2022-02-22 18:36:45 +01:00
Thilo Fromm
cfe1fef430 ci-automation: publish torcx json and use in tests
This change updates the package build script to publish the torcx
manifest file to the build cache so it can be used by tests.
It also updates the generic test script to use the SDK container instead
of the packages container image, and to download and use the torcx
manifest from the build cache.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
74c2cd0dae ci-automation/test.sh: fix reruns, set retry to 20
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
d6dd2249e4 ci-automation: git author and curl verboseness
- Git author configuration moves to tagging function and put under a
  condition so as to not pollute peoples' workspaces.
- curl now less verbose since it was spamming logs with TLS debug
  information.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
60d199224e ci-automation testing: address PR review comments
- add cleanup script to test.sh
- remove wrapper function from qemu test

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
69584ae9b0 ci-automation/tapfile_helper_lib.sh: add @pothos' retcode fix
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:45 +01:00
Thilo Fromm
7dc9ae2a73 Apply @pothos' suggestions from code review
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:45 +01:00