4626 Commits

Author SHA1 Message Date
Kai Lueke
92b6ffbf0d Merge pull request #251 from flatcar-linux/scripts
jenkins/images: print kernel config changes
2022-03-10 12:45:21 +01:00
Kai Lueke
29631bae7b jenkins/images: print kernel config changes
Sometimes the Linux build system changes and results in unexpected
kernel config results.
Print changes in the kernel config as part of the image diff report.
2022-03-10 12:45:21 +01:00
Kai Lueke
566db73f06 Merge pull request #247 from flatcar-linux/scripts
ci-automation: set images as official based on version
2022-03-10 12:43:03 +01:00
Kai Lueke
2061d25158 ci-automation: set images as official based on version
The image needs to be set into official mode through a helper script
(see jenkins/images.sh) and the COREOS_OFFICIAL variable needs to be
set for prod_image_util.sh/build_image_util.sh/grub_install.sh.
2022-03-10 12:43:03 +01:00
Thilo Fromm
1000cf0c79 Merge pull request #246 from flatcar-linux/scripts
automation/test.sh: pass PARALLEL_TESTS to container
2022-03-10 12:25:35 +01:00
Thilo Fromm
723f3d18c5 ci-automation/test.sh: handle unset PARALLEL_TESTS
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-03-10 12:25:35 +01:00
Thilo Fromm
a64a1f140c automation/test.sh: pass PARALLEL_TESTS to container
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 12:25:35 +01:00
Kai Lueke
3468f22755 Merge pull request #245 from flatcar-linux/scripts
ci-automation: print kola command line
2022-03-10 12:06:44 +01:00
Kai Lueke
d0bc42149a ci-automation: print kola command line
For running kola manually and knowing which parameters where set, it
helps to print the kola command line in the job.
2022-03-10 12:06:44 +01:00
Thilo Fromm
e0ca9138d1 Merge pull request #249 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: only ASCII chars
2022-03-10 11:35:20 +01:00
Thilo Fromm
0f829be4b7 ci-automation/tapfile_helper_lib.sh: only ASCII chars
This change removes all non-ASCII characters from test debug / error
output when ingesting the output for inclusion in the TAP report.
Jenkins TAP parser does not handle some unicode chars, leading to tap
parser errors with e.g. Cilium output (which uses unicode).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 11:35:20 +01:00
Jeremi Piotrowski
9c9e9ec3b4 Merge pull request #248 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib: fix commiting last transaction
2022-03-10 10:39:07 +01:00
Jeremi Piotrowski
55c2610ca8 ci-automation/tapfile_helper_lib: fix commiting last transaction
Move the final db commit to inside the subshell. Since the while loop
runs inside a subshell, the SQL variable outside of the subshell is not
modified, and so the last contents of the SQL variable are dropped. This
shows up when the last couple test cases don't have an error message,
and simply append the transaction to 'SQL'. They are never written to
the db.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-03-10 10:39:07 +01:00
Thilo Fromm
c426084440 Merge pull request #243 from flatcar-linux/scripts
ci-automation: fix tap parser errors
2022-03-08 16:48:52 +01:00
Thilo Fromm
16632a681b ci-automation/tapfile_helper_lib.sh: fix CI TAP parse errors
This change fixes and adds more string chars escaping in the test error
debug output ("\" are removed and a bug in removing '"' is fixed),
addressing a parser errof the CI encountered when ingesting TAP output.

Furthermore, line numbering is shortened, and test names have a spurious
"-" prefix removed.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-08 16:48:52 +01:00
Kai Lueke
435d53e216 Merge pull request #244 from flatcar-linux/scripts
Fix and improve channel handling
2022-03-04 14:27:27 +01:00
Kai Lueke
672722d73c ci-automation: set the channel from the git tag
For now we had only "developer" images in the new pipeline.
Based on the git tag like "alpha-1234.0.0" set the channel (group) for
the image and also use this logic when finding the channel in the QEMU
update test.
2022-03-04 14:27:27 +01:00
Kai Lueke
250be82cd8 jenkins/images: find channel from base channel variable
Using the tags on the branch is not enough to find the channel we want
to be the dev build be related to.
Use the base channel variable which was introduced for this.
2022-03-04 14:27:27 +01:00
Thilo Fromm
9eefa2682f Merge pull request #242 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: read test output from file
2022-03-03 09:30:03 +01:00
Thilo Fromm
d9fe3333d1 ci-automation/tapfile_helper_lib.sh: use subshell, break lines after 200
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:30:03 +01:00
Thilo Fromm
9c8e39b6fe ci-automation/tapfile_helper_lib.sh: read test output from file
This change updates the tapfile helper to read test output from a file
instead of passig it inline in the SQL INSERT statement.
This fixes an issue with large error output from tests, which breaks
tap_ingest_tapfile():
    ci-automation/tapfile_helper_lib.sh: line 31: /usr/bin/sqlite3: Argument list too long
Error observed with the cl.toolbox.dnf-install test, which can generate
8000 lines of output. Fix tested with the same output.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:30:03 +01:00
Dongsu Park
9d49c657d7 New version: stable-3033.2.3 stable-3033.2.3 2022-03-02 18:15:36 +01:00
Kai Lueke
a104e1041e Merge pull request #235 from flatcar-linux/scripts
ci-automation: add update test
2022-03-02 11:30:22 +01:00
Kai Lueke
0adf376148 ci-automation: add missing update test
The kola update test was missing. It is performed as update from the
old image to the newly built payload to ensure that the new image is
compatible for old clients.
2022-03-02 11:30:22 +01:00
Dongsu Park
148421a5ea New version: stable-3033.2.3 2022-03-01 17:53:24 +01:00
Thilo Fromm
44456e1042 ci-automation/vendor-testing: add qemu_uefi
This change adds the qemu_uefi.sh vendor test. It reuses most of the
implementation in qemu.sh (qemu_uefi.sh is a soft-link to qemu.sh).

This also enables qemu testing for ARM64.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-25 14:36:52 +01:00
Thilo Fromm
cd0c4703d6 Merge pull request #238 from flatcar-linux/scripts
ci-automation: fix test_update_reruns typo
2022-02-24 12:38:58 +01:00
Thilo Fromm
a5885d1d3e ci-automation: fix test_update_reruns typo
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 12:38:58 +01:00
Thilo Fromm
d38d43ad76 Merge pull request #234 from flatcar-linux/scripts
ci-automation/test*: per-image summary report, honour pre-set PARALLEL_TESTS
2022-02-24 11:12:58 +01:00
Thilo Fromm
c6c077a14e ci-automation/test*: per-image summary, honor parallel
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 11:12:58 +01:00
Thilo Fromm
fd13368989 Merge pull request #232 from flatcar-linux/scripts
ci-automation: publish test results, add to GC
2022-02-23 10:25:13 +01:00
Thilo Fromm
92dd6b086c ci-automation/test.sh: publish to _kola_tmp, not debug/_kola_tmp
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:13 +01:00
Thilo Fromm
2e9f5c79e1 Update ci-automation/test.sh: fix typo.
Co-authored-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-02-23 10:25:13 +01:00
Thilo Fromm
c0a9b616ef ci-automation: publish test results, add to GC
This change adds copying test results to the build cache server, and
adds respective deletion to the garbage collector.

Also, the patch fixes an issue with torcx publishing (manifest
publishing had arch hard-coded).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:13 +01:00
Thilo Fromm
9f883f9313 Merge pull request #230 from flatcar-linux/scripts
update_sdk_container_image: New SDK container from existing image (minor / patch updates)
2022-02-22 18:37:40 +01:00
Thilo Fromm
368bacafc3 update_sdk_container_image: update SDK container image
This change introduces update_sdk_container_image, a script to generate
a new SDK container image based on an existing SDK container. The
script is meant to be used for minor / patch level SDK changes (like
test suite updates).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:37:40 +01:00
Thilo Fromm
da5ed87a21 Merge pull request #228 from flatcar-linux/scripts
ci-automation: Add foundational testing primitives
2022-02-22 18:36:22 +01:00
Thilo Fromm
70af6a9a19 ci-automtion/packages.sh: fix torcx URL, add manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
65e39c2868 ci-automation/tests.sh: use http in torcx manifest
Use HTTP instead of https because Ignition does not recognise
letsencrypt certificates, leading to test breakage in
docker.torcx-manifest-pkgs.

Add a note in settings.env to explicitly call out HTTP requirement of
build cache server.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
bd000b68b1 ci-automation/test.sh: stage torcx manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
c264fd4b51 ci-automation/README.md: add docs for qemu test 2022-02-22 18:36:21 +01:00
Thilo Fromm
bbc7a3c542 ci-automation/tapfile: enforce foreign keys, simplify 2022-02-22 18:36:21 +01:00
Thilo Fromm
b7b224eb43 ci-automation: publish torcx json and use in tests
This change updates the package build script to publish the torcx
manifest file to the build cache so it can be used by tests.
It also updates the generic test script to use the SDK container instead
of the packages container image, and to download and use the torcx
manifest from the build cache.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
c4afa20435 ci-automation/test.sh: fix reruns, set retry to 20
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
b66f42abfd ci-automation: git author and curl verboseness
- Git author configuration moves to tagging function and put under a
  condition so as to not pollute peoples' workspaces.
- curl now less verbose since it was spamming logs with TLS debug
  information.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
1fa12b8d0c ci-automation testing: address PR review comments
- add cleanup script to test.sh
- remove wrapper function from qemu test

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Thilo Fromm
5ce1413e12 ci-automation/tapfile_helper_lib.sh: add @pothos' retcode fix
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:21 +01:00
Thilo Fromm
dd735792af Apply @pothos' suggestions from code review
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:21 +01:00
Thilo Fromm
457d8972da ci-automation: first stab at adding testing
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:21 +01:00
Kai Lueke
9c8579b109 Merge pull request #226 from flatcar-linux/scripts
jenkins/images: print out image diff report
2022-02-16 12:11:24 +01:00