4682 Commits

Author SHA1 Message Date
Kai Lueke
fa0107d155 Merge pull request #312 from flatcar-linux/scripts
jenkins/kola/packet: try to reduce test time by increasing parallelism
2022-05-04 16:55:19 +09:00
Kai Lueke
bb5b7d541e jenkins/kola/packet: try to reduce test time by increasing parallelism
With the limit of 2 parallel tests, meaning 6 machines, the test time
is ~10 hours which is longer than the GC time. It seems that the
regional capacity is not so limited at the moment and we can try to
increase the number of machines.
Adjust the timeout to reflect the GC time and increase the parallel
tests to 3, meaning 9 machines.
2022-05-04 16:55:19 +09:00
Kai Lueke
5570606417 Merge pull request #222 from flatcar-linux/scripts
kola/em: increase timeout
2022-05-04 16:54:53 +09:00
Mathieu Tortuyaux
66213edb01 kola/em: increase timeout
number of test increased. While we don't have yet a way to reduce
testing time, let's increase the timeout.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-05-04 16:54:52 +09:00
Kai Lueke
e15b7b2354 New version: lts-3033.3.0 2022-05-03 20:54:14 +09:00
Kai Lueke
e1526fab6b Merge pull request #307 from flatcar-linux/scripts
Remove unused image variants
2022-05-03 20:43:14 +09:00
Kai Lueke
434fe19bd3 Remove unused image variants
There is no difference anymore between the regular and Pro images.
Remove the definitions and stop building extra images.
2022-05-03 20:42:49 +09:00
Sayan Chowdhury
2d02853511 build_library/vm_image_util.sh: Pro image to use non-pro package & use flag 2022-05-03 20:36:07 +09:00
Kai Lueke
f8d0bfb921 New version: lts-3033.3.0 2022-05-02 19:24:27 +09:00
Kai Lueke
1c5bc897d3 set_lsb_release: Set LTS 2022 codename
While the codename is not really used for Flatcar in general, it serves
as place to set the LTS edition information.
2022-05-02 14:22:52 +09:00
Kai Lueke
eab6b0a1a7 ci-automation/vms: handle platform names and generate the image formats
The kola test scripts are named by the platforms. The image naming is
also quite difficult to know and remember, e.g., whether "ami" or
"ami_vmdk" is needed for AWS tests and whether it's "vmware" or
"vmware_ova".

To address these problems the vms build stage now accepts the platform
names as format input, and for each platform it will automatically
generate the needed image types to run the tests.
2022-04-29 21:19:42 +09:00
Mathieu Tortuyaux
e1a9f6c3a4 ci-automation/vms: rename equinix_metal to packet
this is required to keep "packet" in the SDK linguo while the user can
use "equinix_metal" term.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
Co-authored-by: Krzesimir Nowak <knowak@microsoft.com>
2022-04-29 21:19:38 +09:00
Mathieu Tortuyaux
7991c74025 ci-automation/vm: build PXE if Equinix Metal is built
Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-04-29 21:16:42 +09:00
Kai Lueke
4ceb133524 Merge pull request #298 from flatcar-linux/scripts
CI: Support comparing to current LTS and updating from it
2022-04-29 16:35:31 +09:00
Kai Lueke
366c777caf CI: Support comparing to current LTS and updating from it
When the restriction that the CI can't access the LTS release is gone
we can support to run the image comparison and the kola update test.
2022-04-29 16:35:31 +09:00
Kai Lueke
74576ca2d8 Use gangue compiled from Jenkins
These scripts happened to use the copy of gangue in the SDK which isn't
expected because it should use the binaries complied by Jenkins.
2022-04-26 15:34:31 +09:00
Mathieu Tortuyaux
76002c1452 kola/gce: shrink hostname to be lower than 63 char
GCP Pro is failing because hostname is > 63 char:
```
Apr  5 19:52:27.522820 kubelet[1762]: E0405 19:52:27.522513    1762 kubelet_node_status.go:93] "Unable to register node with API server" err="Node \"jenkins-gce-pro-5-91a967ef5450cb932bc5.c.flatcar-212911.internal\" is invalid: metadata.labels: Invalid value: \"jenkins-gce-pro-5-91a967ef5450cb932bc5.c.flatcar-212911.internal\": must be no more than 63 characters" node="jenkins-gce-pro-5-91a967ef5450cb932bc5.c.flatcar-212911.internal"
```

Let's remove `jenkins` and `gce` from the hostname, these
information are not critical for debugging purposes.

Hostname should now looks like
"basic-5-91a967ef5450cb932bc5.c.flatcar-212911.internal" or
"pro-5-91a967ef5450cb932bc5.c.flatcar-212911.internal"

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-04-26 13:02:19 +09:00
Kai Lueke
9c5b0d03c7 Merge pull request #275 from flatcar-linux/scripts
Run CI container pipeline kola tests with the new mantle image
2022-04-26 12:58:57 +09:00
Kai Lueke
3ba9897a6a ci-automation: silence rsync
The rsync copy logs made it hard to navigate the job output.
Remove the --progress and -v flags.
2022-04-26 12:58:57 +09:00
Kai Lueke
a8727cebf2 Run CI container pipeline kola tests with the new mantle image
The SDK container does not exist for arm64 and is quite heavy. We
currently also resort to a unconditional rebuilding of mantle inside
the SDK.
Use the new mantle container image to run kola tests, and pin its
version through a text file that gets updated by GitHub Actions.
2022-04-26 12:58:57 +09:00
Kai Lueke
733bc62af6 changelog/README.md: specify current security fix section format
The entries added in changelog/security/ do not follow our existing
security section in the release notes:
  https://www.flatcar.org/releases/#release-3033.2.0

Document the structure and an example to use the right format that we
need for release note generation.
2022-04-26 12:55:33 +09:00
Kai Lueke
de9d0c24d5 Merge pull request #195 from flatcar-linux/scripts
changelog/README.md: describe purpose of the changelog entries
2022-04-26 12:55:25 +09:00
Kai Lueke
69d9bcd4ee changelog/README.md: describe purpose of the changelog entries
The changelog entries should be directly used for the release notes,
thus they need to be short and hold only information relevant to the
end user, and should be in the markdown bullet point format.
2022-04-26 12:55:25 +09:00
Dongsu Park
46251b496d changelog: use date format of YYYY-MM-DD
If we use date format of DD-MM-YYYY in changelog file names, the files
will not sorted by date. e.g. 01-12-2021 will come before 25-11-2021.
Use date format of YYYY-MM-DD to make the files sorted by date.
2022-04-26 12:54:53 +09:00
Kai Lueke
9f788e71a1 Merge pull request #184 from flatcar-linux/scripts
changelog: Update the update changelog format
2022-04-26 12:45:10 +09:00
Krzesimir Nowak
f2235ba5d7 changelog: Update the update changelog format
Mention that it should be written as a bullet list. Also, match the
format to the example (put the version link inside parentheses).
2022-04-26 12:45:10 +09:00
Kai Lueke
f8bc87d7eb Merge pull request #180 from flatcar-linux/scripts
changelog: Add placeholder directory to add the changelogs
2022-04-26 12:44:17 +09:00
Sayan Chowdhury
7a19c7ad4d changelog: Add placeholder directory to add the changelogs
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2022-04-26 12:44:17 +09:00
flatcar-ci
0039f9ca0f New version: stable-3033.2.4-nightly-20220405-0155 2022-04-05 04:00:15 +00:00
Kai Lueke
2aa7baf862 Merge pull request #266 from flatcar-linux/scripts
ci-automation: use a single git tag and skip nightlies with no changes
2022-04-04 17:19:25 +02:00
Kai Lueke
c372dfd496 ci-automation: use a single git tag and skip nightlies with no changes
The pipeline created two tags if an SDK was built, one for the SDK and
one for the OS build (which was a free-standing tag or a local state
that was equivalent to the existing tag of the same name). The
nightlies created update commits on the main branch, even if no change
was done, and on the release branches we lacked these commits.

Create the release tag in the nightly SDK bootstrap already and reuse
it for the nightly OS build. Instead of local state, checkout the
existing tags explicitly. Extend the nightly update commit logic to
cover release branches and detect if we can skip building because no
changes were done.
2022-04-04 17:19:24 +02:00
Thilo Fromm
40a1921166 ci-automation/sdk_bootstrap: check submodules for nightly branch push
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-04-04 17:19:03 +02:00
Thilo Fromm
92ebf93483 ci-automation/sdk_bootstrap: Only push to main in nightlies
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-04-04 17:19:03 +02:00
Thilo Fromm
c1f4dcc4a4 ci-automation: SDK build updates version.txt in main branch
This change has sdk_bootstrap update the origin branch when run from the
main branch, updating the SDK and OS version in 'main' for each SDK
bootstrap build.

Release / maintenance branches have the SDK version set in the
versionfile at release time. But main is never updated.

Updating the versionfile in main when a new SDK is built ensures that
dev branches based on main will also use the correct SDK version (e.g.
in subsequent CI builds).
2022-04-04 17:19:03 +02:00
Thilo Fromm
75b7fd1038 Merge pull request #268 from flatcar-linux/scripts
ci-automation/test.sh: remove PARALLEL_TESTS passing (move to CI)
2022-04-01 15:19:04 +02:00
Thilo Fromm
12c0506301 ci-automation/test.sh: remove PARALLEL_TEST passing (move to CI)
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-04-01 15:19:04 +02:00
Thilo Fromm
b3257c1fc5 Merge pull request #261 from flatcar-linux/scripts
ci-automation/test.sh: export PARALLEL_TESTS
2022-03-23 12:25:05 +01:00
Thilo Fromm
7079c379d5 ci-automation/test.sh: export PARALLEL_TESTS
Export PARALLEL_TESTS in the container's .env file to ensure it is
passed to the vendor script.
2022-03-23 12:25:05 +01:00
Jeremi Piotrowski
caf02ae107 Merge pull request #260 from flatcar-linux/scripts
run_sdk_container: skip fetching image if custom_image is requested
2022-03-18 09:16:29 +01:00
Jeremi Piotrowski
43eaeebca5 run_sdk_container: skip fetching image if custom_image is requested
In our CI most uses of run_sdk_container pass the '-C image' flag, which broke
with the last change, due to unbound docker_sdk_vernum variable. Skip fetching
the image when custom_image is passed.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-03-18 09:16:29 +01:00
Kai Lueke
b625a4e1fd jenkins/images.sh: use correct board for comparison
The output always was about amd64 because the board was not set.
Pass the board along.
2022-03-17 17:07:15 +01:00
Thilo Fromm
532d5fb2c5 Merge pull request #258 from flatcar-linux/scripts
ci-automation/test.sh: use the latest kola from coreos-overlay
2022-03-16 17:05:32 +01:00
Thilo Fromm
8e0ed06954 ci-automation/test.sh: use the latest kola from coreos-overlay 2022-03-16 17:05:32 +01:00
Kai Lueke
036eccb736 Merge pull request #259 from flatcar-linux/scripts
run_sdk_container: Fall back to tar ball download for SDK image and other improvements
2022-03-16 16:59:01 +01:00
Kai Lueke
817d50ae30 run_sdk_container: add remove flag
At the moment one must remove the leftover containers manually.
Add a flag to do so when stopping the container.
2022-03-16 16:59:01 +01:00
Kai Lueke
5d359ac193 run_sdk_container: recognize --help flag
When the user passes --help we should not start a container and throw a
late error message afterwards but show the help directly.
2022-03-16 16:59:01 +01:00
Kai Lueke
0697abb206 run_sdk_container: Fall back to tar ball download for SDK image
The nightly SDK image is not pushed to a registry but has to be
downloaded from the build server as tar ball.
Fall back to the tar ball import for a better user experience.
To reuse the ci logic it had to support the "docker" env variable.
The use of the pigz container is not always needed if the user has
pigz available.
2022-03-16 16:59:01 +01:00
Thilo Fromm
3c4f2d04d9 Merge pull request #257 from flatcar-linux/scripts
ci-automation/tapfile_helper_lib.sh: remove non-printable ASCII
2022-03-16 11:00:07 +01:00
Thilo Fromm
772f1e4678 ci-automation/tapfile_helper_lib.sh: remove non-printable ASCII
Jenkins TAP file parser does not process non-printable ASCII characters
but bails out. This change removes all ASCII < 0x1F, so non-printable
characters are not included in the TAP report.

Fixes
    Caused by: unacceptable character '' (0x1B) special characters are not allowed
2022-03-16 11:00:07 +01:00
Thilo Fromm
b2767869af Merge pull request #256 from flatcar-linux/scripts
ci-automation/vendor-testing/qemu_update.sh: fix unbound variable
2022-03-15 17:55:19 +01:00