4881 Commits

Author SHA1 Message Date
Kai Lueke
ef040ae67d Merge pull request #374 from flatcar-linux/scripts
Make the kola test workflow reusable
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
d036e39cde Update kola test workflow
* arm64 tests now run in LXD containers instead of VMs
  * parallelism increased for arm64
  * some setup steps are skipped on arm64

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
7d83d89385 Disable image mangle in qemu tests
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
66d02a69a3 Make QEMU_UEFI_BIOS configurable
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
292874bb52 Remove customizations for now
Remove arch and parallel options. Hardcode them for now.
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
674f11b213 Make the kola test workflow reusable
* Adds a reusable workflow that can run tests
  * Adapts the ci.yaml to use reusable workflow
  * Creates a new workflow that helps trigger tests using an arbitrary
    workflow run.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:15:44 +02:00
Gabriel Adrian Samfira
29d7d843af Add configuration options to test functions
* Add SKIP_COPY_TO_BINCACHE environment variable that will skip
    uploading test results to bincache. This is useful if we want to
    upload test results as artifacts on github.
  * make QEMU_IMAGE_NAME configurable

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:15:44 +02:00
Mathieu Tortuyaux
c740d57711 .github/ci: add kola qemu test
this initial attempt runs right after the "packages" jobs and downloads
the resulting artifacts.

The QEMU image is unzipped then the kola test is running using the
ci-automation scripts.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-07-13 18:15:44 +02:00
Kai Lueke
9878fe0590 Merge pull request #366 from flatcar-linux/scripts
Add concurency setting to CI workflow
2022-07-13 18:13:56 +02:00
Gabriel Adrian Samfira
7e1c4145e7 Add concurency setting to CI workflow
This change will prompt the CI workflow to cancel a currently running
job, if a new push is sent in a PR. This should prevent duplicate jobs
running for the same PR simultaneously.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 18:13:56 +02:00
Kai Lueke
d61132121d Merge pull request #354 from flatcar-linux/scripts
Add CI workflow
2022-07-13 18:11:58 +02:00
Gabriel Adrian Samfira
65c214d937 Add CI workflow 2022-07-13 18:11:58 +02:00
flatcar-ci
874911137e New version: stable-3139.2.3-nightly-20220711-2100 2022-07-11 21:02:26 +00:00
Kai Lüke
4afe6f6975
Merge pull request #373 from flatcar-linux/mantle-update-flatcar-3139
Upgrade mantle container image to latest HEAD in flatcar-3139
2022-07-11 12:10:53 +02:00
Flatcar Buildbot
429e3ca843 Update mantle container image to latest HEAD 2022-07-11 07:10:36 +00:00
flatcar-ci
1905e8bdb3 New version: stable-3139.2.3-nightly-20220706-2100 2022-07-06 21:01:54 +00:00
Kai Lueke
de2ab6fa5a Merge pull request #365 from flatcar-linux/scripts
ci-automation: Only store compressed images
2022-07-06 15:56:07 +02:00
Kai Lueke
d465a1c280 ci-automation: Only store compressed images
The new build pipeline compresses images already but uploaded both the
compressed and uncompressed files because the whole build folder gets
uploaded.
Add a new flag "--only_store_compressed" to the image generation which
deletes the uncompressed file after compression is done. Uncompressed
images are still supported if specified in the flag
"image_compression_formats".

Closes https://github.com/flatcar-linux/Flatcar/issues/793
2022-07-06 15:56:06 +02:00
flatcar-ci
fdf4887d0e New version: stable-3139.2.3-nightly-20220701-2100 2022-07-01 21:02:36 +00:00
Kai Lueke
f2ab8abb17 Merge pull request #332 from flatcar-linux/scripts
ci-automation: Do not rerun tests on unrelated instances
2022-07-01 14:46:26 +02:00
Krzesimir Nowak
b1d307c3c7 ci-automation: Fix potential use of unbound variable error
`local -a stuff` does not make `stuff` a bound array variable, so
checking length of the array will trigger an error about unbound
variable. Fortunately, `local stuff=()` does the trick.
2022-07-01 14:46:26 +02:00
Krzesimir Nowak
35fd78ad7e ci-automation: Do not rerun tests on unrelated instances
We forgot to clear the array with instance tests to rerun, so the list
grew from one iteration to another when going over all the instance
types. I did not spot it before, because I tested it with only one
extra instance.
2022-07-01 14:46:26 +02:00
Kai Lueke
c17157ca7a Merge pull request #233 from flatcar-linux/scripts
Make image compression format configurable
2022-07-01 14:42:32 +02:00
Gabriel
27bbafba2b Update changelog/changes/2022-02-22-configurable-image-compression.md
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-07-01 14:42:32 +02:00
Gabriel
3cb41f9303 Update jenkins/vms.sh
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-07-01 14:42:32 +02:00
Gabriel Adrian Samfira
a63a18dee6 Rename zstd to zst
Rename sztd to zst and amend the changelog. The zstd binary generates a
compressed file with the .zst extension by default.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-01 14:42:32 +02:00
Gabriel Adrian Samfira
599bca55c4 Remove commented code 2022-07-01 14:42:32 +02:00
Gabriel Adrian Samfira
466e4cb5d7 Allow specifying multiple compression formats
Add the ability to specify a comma separated list of compression formats.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-01 14:42:32 +02:00
Gabriel Adrian Samfira
9620d458de Use gzip compression for OpenStack images
This change makes the Jenkins job output openstack images using gzip
compression format. This allows OpenStack users to directly consume images
by simply specifying the URL to the image. Glance will then download the
image, unarchive it and add it to it's catalogue.

Fixes #575

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-01 14:42:32 +02:00
Gabriel Adrian Samfira
f23bda11c8 Make image compression format configurable
This change adds a new flag called --image_compression_format which
allows us to output the final VM image as one of the supported formats:

bz2 (default), gz, zip or none

if the compression format is "none" or "", the image will not be compressed.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-01 14:42:32 +02:00
Kai Lüke
c3a5b87bb2
Merge pull request #363 from flatcar-linux/mantle-update-flatcar-3139
Upgrade mantle container image to latest HEAD in flatcar-3139
2022-06-30 23:28:50 +02:00
flatcar-ci
9d31a29803 New version: stable-3139.2.3-nightly-20220630-2100 2022-06-30 21:01:56 +00:00
Flatcar Buildbot
fd9f118d10 Update mantle container image to latest HEAD 2022-06-30 21:00:47 +00:00
flatcar-ci
401198d8e6 New version: stable-3139.2.3-nightly-20220629-2100 2022-06-29 21:01:57 +00:00
Kai Lueke
1d0a1f71c6 Merge pull request #355 from flatcar-linux/scripts
ci-automation: Use the package container for VM image building
2022-06-29 15:37:55 +02:00
Kai Lueke
3762f88b56 ci-automation: Run package-diff to report image changes
The original pipeline has package-diff commands to print out image
differences compared to the last release. This is used for the release
Go/No-Go QA checks.
Add the same logic to the new pipeline.
2022-06-29 15:37:55 +02:00
Kai Lueke
cab904de89 ci-automation: Use the package container for VM image building
The image job builds an image container that is multiple GBs big and
takes >10 mins to be loaded in the vms job. The vms job can also do its
work by running from the packages container from the packages job when
it fetchs the built image from bincache first and assuming the images
job copies it there.
Skip generating the image container and instead use the packages
container for VM image building by copying the image folder first to
bincache and then retrieving it from there. While reworking this we
also address the issue that the VMs container had used the same name
for both architectures, causing a race when both run in parallel on
the same worker.
2022-06-29 15:37:55 +02:00
Kai Lueke
f88691adff Merge pull request #359 from flatcar-linux/scripts
Add retag-for-jenkins helper
2022-06-29 15:30:53 +02:00
Kai Lueke
96e649f4cf Add retag-for-jenkins helper
When testing "scripts" changes with Jenkins and a leaf job fails, we
currently would have to restart the whole build or update the git tag
manually. Since dealing with the git tag is not straightforward, add
a helper to update it.
2022-06-29 15:30:53 +02:00
Kai Lueke
2f964898c8 Merge pull request #358 from flatcar-linux/scripts
ci-automation: align VM image compression with existing pipeline
2022-06-29 11:40:22 +02:00
Kai Lueke
d4ceaddf46 ci-automation: align VM image compression with existing pipeline
In jenkins/vms.sh the Digital Ocean and OpenStack images get also
compressed as gzip.
Do so for the new pipeline, too.
2022-06-29 11:40:22 +02:00
Kai Lüke
06a736b009
Merge pull request #350 from flatcar-linux/mantle-update-flatcar-3139
Upgrade mantle container image to latest HEAD in flatcar-3139
2022-06-29 11:37:21 +02:00
Flatcar Buildbot
15974521ef Update mantle container image to latest HEAD 2022-06-29 09:35:38 +00:00
flatcar-ci
454bb7c879 New version: stable-3139.2.3-nightly-20220628-2100 2022-06-28 21:01:55 +00:00
flatcar-ci
6f02fdb515 New version: stable-3139.2.3-nightly-20220624-2100 2022-06-24 21:02:01 +00:00
Sayan Chowdhury
9ec512c5be
New version: stable-3139.2.3 stable-3139.2.3 2022-06-21 09:54:49 +05:30
Sayan Chowdhury
52f92e7d41
New version: stable-3139.2.3 2022-06-21 04:03:40 +05:30
flatcar-ci
1143267693 New version: stable-3139.2.2-nightly-20220617-2100 2022-06-17 21:02:04 +00:00
flatcar-ci
2d659a90fb New version: stable-3139.2.2-nightly-20220615-2100 2022-06-15 21:01:53 +00:00
flatcar-ci
90bb7bfa55 New version: stable-3139.2.2-nightly-20220613-2100 2022-06-13 21:02:05 +00:00