Commit Graph

5075 Commits

Author SHA1 Message Date
Krzesimir Nowak
412e11d908
Merge pull request #377 from flatcar-linux/krnowak/cleanup-dirs
build_library: Try to clean up unused stuff
2022-07-14 16:53:26 +02:00
Krzesimir Nowak
e65072910d build_library: Try to clean up unused stuff
There is some cruft left after grub hashes generation. After the
contents are zipped into archive, they don't need to be around any
more.

Try to remove the rootfs directory after unmounting the
image. disk_util can recreate it again if there is a need for it.

Remove the build directory used for generating ACI images - it's not
needed after successful installation.
2022-07-14 15:08:12 +02:00
Krzesimir Nowak
a96a66d222
Merge pull request #376 from flatcar-linux/krnowak/digests
ci-automation: Generate digests for artifacts
2022-07-14 14:42:49 +02:00
Kai Lüke
f83ee4f9a1
Merge pull request #375 from flatcar-linux/kai/print-changelog
ci-automation: Show changes by finding the previous channel
2022-07-14 13:44:22 +02:00
flatcar-ci
873eac6f5d New version: main-3299.0.0-nightly-20220713-2100 2022-07-13 21:00:29 +00:00
Kai Lueke
da370b54c1 ci-automation: Show changes by finding the previous channel
The image comparison was done against the old release in the channel
we release to instead of the previous release with the same major
version. This means when a channel transition happens we see a large
diff instead of the diff against the previous release. While not bad
for finding problems, this is normally not needed. However, we want
to have two changelogs generated, one against the old release in the
channel we relese to and one against the previous release with the same
major version when a transition happens. There was no changelog
printing yet, and this is added now.
2022-07-13 19:11:50 +02:00
Kai Lüke
d6ab2eccc6
Merge pull request #381 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-07-13 18:26:23 +02:00
Flatcar Buildbot
8cf32dfc56 Update mantle container image to latest HEAD 2022-07-13 16:10:03 +00:00
Kai Lüke
76b47a00b2
Merge pull request #374 from gabriel-samfira/make-workflow-pluggable
Make the kola test workflow reusable
2022-07-13 18:09:43 +02:00
Gabriel Adrian Samfira
340fd39a9f
Update kola test workflow
* arm64 tests now run in LXD containers instead of VMs
  * parallelism increased for arm64
  * some setup steps are skipped on arm64

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 14:20:12 +03:00
Gabriel Adrian Samfira
b518c3cdb8
Disable image mangle in qemu tests
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 14:19:50 +03:00
Gabriel Adrian Samfira
7dc45a4a1f
Make QEMU_UEFI_BIOS configurable
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-12 19:46:27 +03:00
Krzesimir Nowak
4e6f44e7b8 ci-automation: Generate digests files for the built artifacts 2022-07-12 16:59:14 +02:00
Krzesimir Nowak
d475d36766 ci-automation: Add a function for generating digests
It works in a similar way to sign_artifacts - it takes a signer, a
list of files and directories, and generates digests next to the
respective files.
2022-07-12 16:59:14 +02:00
Krzesimir Nowak
133cb6b52f ci-automation: Factor out listing files into a separate function
This will come in handy when listing files for creating digests files.
2022-07-12 16:59:14 +02:00
Gabriel Adrian Samfira
6eabd91a04
Remove customizations for now
Remove arch and parallel options. Hardcode them for now.
2022-07-12 02:48:42 +03:00
flatcar-ci
056752222e New version: main-3297.0.0-nightly-20220711-2100 2022-07-11 21:00:28 +00:00
Gabriel Adrian Samfira
879e5a2b30
Make the kola test workflow reusable
* Adds a reusable workflow that can run tests
  * Adapts the ci.yaml to use reusable workflow
  * Creates a new workflow that helps trigger tests using an arbitrary
    workflow run.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-11 16:23:35 +03:00
Gabriel Adrian Samfira
dc8cf9c18d
Add configuration options to test functions
* Add SKIP_COPY_TO_BINCACHE environment variable that will skip
    uploading test results to bincache. This is useful if we want to
    upload test results as artifacts on github.
  * make QEMU_IMAGE_NAME configurable

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-11 13:32:25 +03:00
Kai Lüke
a04e7b39c1
Merge pull request #369 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-07-11 12:01:30 +02:00
Flatcar Buildbot
c6ac1100d6 Update mantle container image to latest HEAD 2022-07-11 07:10:34 +00:00
Mathieu Tortuyaux
f9b13baeb5
.github/ci: add kola qemu test
this initial attempt runs right after the "packages" jobs and downloads
the resulting artifacts.

The QEMU image is unzipped then the kola test is running using the
ci-automation scripts.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-07-07 10:01:49 +02:00
flatcar-ci
392ce4089b New version: main-3292.0.0-nightly-20220706-2100 2022-07-06 21:00:36 +00:00
Kai Lüke
7eacd85c2e
Merge pull request #365 from flatcar-linux/kai/store-compressed
ci-automation: Only store compressed images
2022-07-06 15:54:55 +02:00
Kai Lüke
a5a7c60784
Merge pull request #366 from gabriel-samfira/add-concurency-to-workflow
Add concurency setting to CI workflow
2022-07-06 10:53:23 +02:00
flatcar-ci
4e1909afc2 New version: main-3291.0.0-nightly-20220705-2100 2022-07-05 21:00:30 +00:00
Kai Lueke
ef9b0ff820 ci-automation: Only store compressed images
The new build pipeline compresses images already but uploaded both the
compressed and uncompressed files because the whole build folder gets
uploaded.
Add a new flag "--only_store_compressed" to the image generation which
deletes the uncompressed file after compression is done. Uncompressed
images are still supported if specified in the flag
"image_compression_formats".

Closes https://github.com/flatcar-linux/Flatcar/issues/793
2022-07-05 16:13:22 +02:00
Gabriel Adrian Samfira
59e7b31778
Add concurency setting to CI workflow
This change will prompt the CI workflow to cancel a currently running
job, if a new push is sent in a PR. This should prevent duplicate jobs
running for the same PR simultaneously.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-04 21:18:31 +03:00
flatcar-ci
9ba0c27cb2 New version: main-3286.0.0-nightly-20220630-2100 2022-07-01 15:37:28 +00:00
Kai Lüke
5516e4948d
Merge pull request #364 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-06-30 23:29:02 +02:00
Flatcar Buildbot
610686c022 Update mantle container image to latest HEAD 2022-06-30 21:00:54 +00:00
flatcar-ci
99e9460f0f New version: main-3286.0.0-nightly-20220630-2100 2022-06-30 21:00:27 +00:00
flatcar-ci
89db53401a New version: main-3285.0.0-nightly-20220629-2100 2022-06-29 21:00:27 +00:00
Kai Lüke
eb02ef6788
Merge pull request #355 from flatcar-linux/kai/image-package-diff
ci-automation: Use the package container for VM image building
2022-06-29 15:37:02 +02:00
Kai Lüke
4473e5feaa
Merge pull request #359 from flatcar-linux/kai/retag-for-jenkins
Add retag-for-jenkins helper
2022-06-29 15:29:54 +02:00
Kai Lueke
c1f1404df8 ci-automation: Run package-diff to report image changes
The original pipeline has package-diff commands to print out image
differences compared to the last release. This is used for the release
Go/No-Go QA checks.
Add the same logic to the new pipeline.
2022-06-29 15:23:16 +02:00
Kai Lueke
1b3e9ef188 ci-automation: Use the package container for VM image building
The image job builds an image container that is multiple GBs big and
takes >10 mins to be loaded in the vms job. The vms job can also do its
work by running from the packages container from the packages job when
it fetchs the built image from bincache first and assuming the images
job copies it there.
Skip generating the image container and instead use the packages
container for VM image building by copying the image folder first to
bincache and then retrieving it from there. While reworking this we
also address the issue that the VMs container had used the same name
for both architectures, causing a race when both run in parallel on
the same worker.
2022-06-29 15:23:16 +02:00
Kai Lueke
b5bd067bdd Add retag-for-jenkins helper
When testing "scripts" changes with Jenkins and a leaf job fails, we
currently would have to restart the whole build or update the git tag
manually. Since dealing with the git tag is not straightforward, add
a helper to update it.
2022-06-29 11:46:06 +02:00
Kai Lüke
1426c16a55
Merge pull request #358 from flatcar-linux/kai/compression-formats
ci-automation: align VM image compression with existing pipeline
2022-06-29 11:39:27 +02:00
Kai Lüke
cb93568114
Merge pull request #353 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-06-29 11:35:19 +02:00
Flatcar Buildbot
d02975f832 Update mantle container image to latest HEAD 2022-06-28 21:01:04 +00:00
flatcar-ci
55ddaf4d16 New version: main-3284.0.0-nightly-20220628-2100 2022-06-28 21:00:45 +00:00
Kai Lueke
aae09eef4b ci-automation: align VM image compression with existing pipeline
In jenkins/vms.sh the Digital Ocean and OpenStack images get also
compressed as gzip.
Do so for the new pipeline, too.
2022-06-28 18:08:53 +02:00
Kai Lüke
e7e9ae8044
Merge pull request #356 from flatcar-linux/kai/ci-on-pr
.github: Run CI workflow only for PR events
2022-06-28 11:53:13 +02:00
Kai Lueke
37253cd499 .github: Run CI workflow only for PR events
Building for the branch push event causes two builds per PR and is not
needed anyway (we have nightly builds for the main branch).
Only consider PR events to trigger the CI build.
2022-06-28 11:19:13 +02:00
flatcar-ci
0aaf36555f New version: main-3283.0.0-nightly-20220627-2100 2022-06-27 21:00:28 +00:00
Kai Lüke
afdd13412c
Merge pull request #354 from gabriel-samfira/add-ci-workflow
Add CI workflow
2022-06-27 11:20:13 +02:00
Gabriel Adrian Samfira
6e03ea1821 Add CI workflow 2022-06-24 15:35:23 +00:00
flatcar-ci
737debfdeb New version: main-3279.0.0-nightly-20220623-2100 2022-06-23 21:00:28 +00:00
Kai Lüke
bbe1fba82a
Merge pull request #348 from martinborgman/patch-1
Make qemu_template.sh work on macOS
2022-06-23 19:52:34 +02:00