4728 Commits

Author SHA1 Message Date
Thilo Fromm
0b957d1404 Merge pull request #261 from flatcar-linux/scripts
ci-automation/test.sh: export PARALLEL_TESTS
2022-03-23 12:25:25 +01:00
Thilo Fromm
433db48605 ci-automation/test.sh: export PARALLEL_TESTS
Export PARALLEL_TESTS in the container's .env file to ensure it is
passed to the vendor script.
2022-03-23 12:25:25 +01:00
Jeremi Piotrowski
82d6a4971a Merge pull request #260 from flatcar-linux/scripts
run_sdk_container: skip fetching image if custom_image is requested
2022-03-18 09:16:13 +01:00
Jeremi Piotrowski
65da6b8e79 run_sdk_container: skip fetching image if custom_image is requested
In our CI most uses of run_sdk_container pass the '-C image' flag, which broke
with the last change, due to unbound docker_sdk_vernum variable. Skip fetching
the image when custom_image is passed.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-03-18 09:16:13 +01:00
Kai Lueke
ad6f2a4757 jenkins/images.sh: use correct board for comparison
The output always was about amd64 because the board was not set.
Pass the board along.
2022-03-17 17:07:59 +01:00
Thilo Fromm
46177af5cf Merge pull request #258 from flatcar-linux/scripts
ci-automation/test.sh: use the latest kola from coreos-overlay
2022-03-16 17:05:14 +01:00
Thilo Fromm
75bbf121a4 ci-automation/test.sh: use the latest kola from coreos-overlay 2022-03-16 17:05:14 +01:00
Kai Lueke
6dd2bd1384 Merge pull request #259 from flatcar-linux/scripts
run_sdk_container: Fall back to tar ball download for SDK image and other improvements
2022-03-16 17:00:07 +01:00
Kai Lueke
04421f70f9 run_sdk_container: add remove flag
At the moment one must remove the leftover containers manually.
Add a flag to do so when stopping the container.
2022-03-16 17:00:07 +01:00
Kai Lueke
9f42f3bbe1 run_sdk_container: recognize --help flag
When the user passes --help we should not start a container and throw a
late error message afterwards but show the help directly.
2022-03-16 17:00:07 +01:00
Kai Lueke
c6c3cc152a run_sdk_container: Fall back to tar ball download for SDK image
The nightly SDK image is not pushed to a registry but has to be
downloaded from the build server as tar ball.
Fall back to the tar ball import for a better user experience.
To reuse the ci logic it had to support the "docker" env variable.
The use of the pigz container is not always needed if the user has
pigz available.
2022-03-16 17:00:07 +01:00
Thilo Fromm
2d04bd90bc Merge pull request #257 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: remove non-printable ASCII
2022-03-16 11:00:29 +01:00
Thilo Fromm
076e016937 ci-automation/tapfile_helper_lib.sh: remove non-printable ASCII
Jenkins TAP file parser does not process non-printable ASCII characters
but bails out. This change removes all ASCII < 0x1F, so non-printable
characters are not included in the TAP report.

Fixes
    Caused by: unacceptable character '' (0x1B) special characters are not allowed
2022-03-16 11:00:29 +01:00
Thilo Fromm
0a6f198f48 Merge pull request #256 from flatcar-linux/scripts
ci-automation/vendor-testing/qemu_update.sh: fix unbound variable
2022-03-15 17:55:01 +01:00
Thilo Fromm
0dce426e04 ci-automation/vendor-testing/qemu_update.sh: fix unbound
One-line fix to resolve
    ci-automation/vendor-testing/qemu_update.sh: line 64: testscript: unbound variable
error.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-15 17:55:01 +01:00
Jeremi Piotrowski
8981d2a4ae Merge pull request #254 from flatcar-linux/scripts
jenkins/kola/azure: forward azure private networking parameters to kola
2022-03-14 20:40:00 +01:00
Jeremi Piotrowski
171b872626 jenkins/kola/azure: forward azure private networking parameters to kola
These allow the configuration of virtual network for the created
instances to join, and tell kola to use the private instance IP for
connectivity.
2022-03-14 20:40:00 +01:00
Thilo Fromm
7b51c6113d
Merge pull request #253 from flatcar-linux/t-lo/ci-automation-fix-alpha-3165-sdk-version
version.txt: Fix SDK version (to 3165.0.0)
2022-03-14 12:19:05 +01:00
Thilo Fromm
fbd5bb745d version.txt: Fix SDK version (to 3165.0.0)
Release automation does not yet update the SDK version on release. It
remains stuck on the last nightly version of the main branch when a new
Alpha is released. This change updates the SDK version manually; the
root cause needs to be addressed in the release script helpers.

The change also updates coreos-overlay to the commit published with
alpha-3165.0.0.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-14 11:46:19 +01:00
Kai Lueke
e04583f5b5 Merge pull request #250 from flatcar-linux/scripts
jenkins/kola/aws: run tests on additional instance types
2022-03-10 18:23:56 +01:00
Kai Lueke
9050cfaf3f jenkins/kola/packet|aws: silence debug output of concurrent test
The concurrent tests' debug output is not helping and causes confusion.
2022-03-10 18:23:56 +01:00
Kai Lueke
24e5277edd jenkins/kola/aws: run tests on additional instance types
There was a regression for an instance type which could have been
prevented by testing.
Add the same extended test logic used for Equinix Metal to AWS.
2022-03-10 18:23:56 +01:00
Kai Lueke
b8ab30c828 Merge pull request #251 from flatcar-linux/scripts
jenkins/images: print kernel config changes
2022-03-10 12:44:59 +01:00
Kai Lueke
795b22f834 jenkins/images: print kernel config changes
Sometimes the Linux build system changes and results in unexpected
kernel config results.
Print changes in the kernel config as part of the image diff report.
2022-03-10 12:44:59 +01:00
Kai Lueke
3877be9a15 Merge pull request #247 from flatcar-linux/scripts
ci-automation: set images as official based on version
2022-03-10 12:43:31 +01:00
Kai Lueke
6e73f66182 ci-automation: set images as official based on version
The image needs to be set into official mode through a helper script
(see jenkins/images.sh) and the COREOS_OFFICIAL variable needs to be
set for prod_image_util.sh/build_image_util.sh/grub_install.sh.
2022-03-10 12:43:31 +01:00
Thilo Fromm
e651769446 Merge pull request #246 from flatcar-linux/scripts
automation/test.sh: pass PARALLEL_TESTS to container
2022-03-10 12:25:18 +01:00
Thilo Fromm
af3b6d8041 ci-automation/test.sh: handle unset PARALLEL_TESTS
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-03-10 12:25:18 +01:00
Thilo Fromm
7e1c5b4333 automation/test.sh: pass PARALLEL_TESTS to container
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 12:25:18 +01:00
Kai Lueke
565833da31 Merge pull request #245 from flatcar-linux/scripts
ci-automation: print kola command line
2022-03-10 12:07:14 +01:00
Kai Lueke
ebb62d3274 ci-automation: print kola command line
For running kola manually and knowing which parameters where set, it
helps to print the kola command line in the job.
2022-03-10 12:07:13 +01:00
Thilo Fromm
d647dfd3a5 Merge pull request #249 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: only ASCII chars
2022-03-10 11:34:41 +01:00
Thilo Fromm
81085451f4 ci-automation/tapfile_helper_lib.sh: only ASCII chars
This change removes all non-ASCII characters from test debug / error
output when ingesting the output for inclusion in the TAP report.
Jenkins TAP parser does not handle some unicode chars, leading to tap
parser errors with e.g. Cilium output (which uses unicode).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-10 11:34:41 +01:00
Jeremi Piotrowski
780b0f4368 Merge pull request #248 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib: fix commiting last transaction
2022-03-10 10:38:23 +01:00
Jeremi Piotrowski
9cc5c6c361 ci-automation/tapfile_helper_lib: fix commiting last transaction
Move the final db commit to inside the subshell. Since the while loop
runs inside a subshell, the SQL variable outside of the subshell is not
modified, and so the last contents of the SQL variable are dropped. This
shows up when the last couple test cases don't have an error message,
and simply append the transaction to 'SQL'. They are never written to
the db.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-03-10 10:38:23 +01:00
Thilo Fromm
13dabce4f5 Merge pull request #243 from flatcar-linux/scripts
ci-automation: fix tap parser errors
2022-03-08 16:49:25 +01:00
Thilo Fromm
4c72caf192 ci-automation/tapfile_helper_lib.sh: fix CI TAP parse errors
This change fixes and adds more string chars escaping in the test error
debug output ("\" are removed and a bug in removing '"' is fixed),
addressing a parser errof the CI encountered when ingesting TAP output.

Furthermore, line numbering is shortened, and test names have a spurious
"-" prefix removed.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-08 16:49:25 +01:00
Kai Lueke
47cb0fc8da Merge pull request #244 from flatcar-linux/scripts
Fix and improve channel handling
2022-03-04 14:26:52 +01:00
Kai Lueke
43b4656ff2 ci-automation: set the channel from the git tag
For now we had only "developer" images in the new pipeline.
Based on the git tag like "alpha-1234.0.0" set the channel (group) for
the image and also use this logic when finding the channel in the QEMU
update test.
2022-03-04 14:26:52 +01:00
Kai Lueke
22d2f5b794 jenkins/images: find channel from base channel variable
Using the tags on the branch is not enough to find the channel we want
to be the dev build be related to.
Use the base channel variable which was introduced for this.
2022-03-04 14:26:52 +01:00
Thilo Fromm
f32b992154 Merge pull request #242 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: read test output from file
2022-03-03 09:30:13 +01:00
Thilo Fromm
66d3583e62 ci-automation/tapfile_helper_lib.sh: use subshell, break lines after 200
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:30:13 +01:00
Thilo Fromm
35808f757f ci-automation/tapfile_helper_lib.sh: read test output from file
This change updates the tapfile helper to read test output from a file
instead of passig it inline in the SQL INSERT statement.
This fixes an issue with large error output from tests, which breaks
tap_ingest_tapfile():
    ci-automation/tapfile_helper_lib.sh: line 31: /usr/bin/sqlite3: Argument list too long
Error observed with the cl.toolbox.dnf-install test, which can generate
8000 lines of output. Fix tested with the same output.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-03-03 09:30:13 +01:00
Kai Lueke
19ca1ea7d4 Merge pull request #235 from flatcar-linux/scripts
ci-automation: add update test
2022-03-02 11:29:47 +01:00
Kai Lueke
46329ac6a5 ci-automation: add missing update test
The kola update test was missing. It is performed as update from the
old image to the newly built payload to ensure that the new image is
compatible for old clients.
2022-03-02 11:29:47 +01:00
flatcar-ci
16bd244b62 New version: sdk-3165.0.0-nightly-20220301-0139 2022-03-01 04:47:20 +00:00
flatcar-ci
eb2394b9ac New version: sdk-3164.0.0-nightly-20220228-0139 2022-02-28 04:51:57 +00:00
flatcar-ci
be6145f8e1 New version: sdk-3163.0.0-nightly-20220227-0139 2022-02-27 04:45:02 +00:00
flatcar-ci
f688a206bd New version: sdk-3162.0.0-nightly-20220226-0139 2022-02-26 04:50:56 +00:00
Thilo Fromm
88a4df98b1
Merge pull request #239 from flatcar-linux/t-lo/ci-automation-add-qemu-uefi-test
ci-automation/vendor-testing: add qemu_uefi
2022-02-25 12:15:01 +01:00