Commit Graph

5244 Commits

Author SHA1 Message Date
Jeremi Piotrowski
a66bded4ce install_cross_libs: fix toolchain dependency installation
`./setup_board --nousepkg --nogetbinpkg` currently fails with a
circular dependency due to pulling in the whole systemd-cryptsetup-udev
dependency chain. This is due to several issue:

* `emerge --root=$ROOT --emptytree` considers ROOT=/ to also be empty,
  so it pulls in all host packages. This must've not always been the case.
  So we need to pipe the dependency package list through `egrep $ROOT`
  to filter only those that would get installed into the desired ROOT
* if SYSROOT=/ and not SYSROOT=ROOT, then virtual/os-headers is missing
  from $ROOT package list
* the final filter expression tries to previously looked like this:
  (=sys-devel/gcc|sys-devel/binutils-0.9) which also matches
  sys-devel/gcc-config and sys-devel/binutils-config, which are
  necessary dependencies. Rework the match expression to not filter
  those out.
2022-07-27 12:59:49 +02:00
Jeremi Piotrowski
13889874e3
Merge pull request #391 from flatcar-linux/jepio/libgcc-fix
prod_image_util: extract gcc libs to /usr/lib64
2022-07-27 11:26:02 +02:00
flatcar-ci
99bb586c3a New version: main-3312.0.0-nightly-20220726-2100 2022-07-26 21:00:24 +00:00
flatcar-ci
a64011137b New version: main-3311.0.0-nightly-20220725-2100 2022-07-25 21:00:35 +00:00
Jeremi Piotrowski
6735a6d5c0
prod_image_util: extract gcc libs to /usr/lib64
This made no difference back when lib was a symlink to lib64, but now that they are separate,
libs belongs in /usr/lib64. This  mostly doesn't show up because ldconfig configures the ld.so cache
to include both locations, but when updating from an older release ld.so.cache is out of date.
Unfortunately ld.so.cache does not get updated until after multipathd, which causes
multipathd to dump core. This may also affect other packages that need access to
libgcc early.

See also: https://github.com/flatcar-linux/Flatcar/issues/809
2022-07-25 17:33:08 +02:00
flatcar-ci
1d47a32cc3 New version: main-3306.0.0-nightly-20220720-2100 2022-07-20 21:00:27 +00:00
Dongsu Park
39dc428bc1
Merge pull request #389 from flatcar-linux/dongsu/equinix-metal-arm64-dc
jenkins: fix PACKET_REGION to DC for more servers available
2022-07-20 15:21:56 +02:00
Dongsu Park
cb7b53188d jenkins: fix PACKET_REGION to DC for more servers available
`c3.large.arm64` instances of Equinix Metal are available in metro
either `DA` or `DC`. However, recently arm64 CI builds started to fail
due to too few servers available in the DA metro. As the DC metro has
more servers available, let's change metro to DC.

How to check how many servers are available in a specific metro:

```
curl -X POST \
  -H "Content-Type: application/json" -H "X-Auth-Token: ..." \
  https://api.equinix.com/metal/v1/capacity/metros \
  -d '{"servers": [ { \
    "metro": "dc", \
    "plan": "c3.large.arm64", \
     "quantity": 34 \
  } ] }'
curl -X POST \
  -H "Content-Type: application/json" -H "X-Auth-Token: ..." \
  https://api.equinix.com/metal/v1/capacity/metros \
  -d '{"servers": [ { \
    "metro": "da", \
    "plan": "c3.large.arm64", \
    "quantity": 17 \
  } ] }'
```
2022-07-20 14:58:59 +02:00
flatcar-ci
cc4a96ed6d New version: main-3305.0.0-nightly-20220719-2100 2022-07-19 21:00:25 +00:00
Kai Lüke
a2e0b7b233
Merge pull request #386 from flatcar-linux/kai/new-packages-top-job
ci-automation: Move git tagging into own script
2022-07-19 19:35:13 +02:00
flatcar-ci
7e796bf561 New version: main-3304.0.0-nightly-20220718-2100 2022-07-18 21:00:27 +00:00
Kai Lüke
a21daa36c0
Merge pull request #387 from flatcar-linux/kai/checkout-test
.github: Specify remote when checking out c-o/p-s ref in workflow
2022-07-18 20:33:51 +02:00
Kai Lueke
71510fb117 .github: Specify remote when checking out c-o/p-s ref in workflow
When the specified remote contains a same-named branch as origin,
the checkout fails with "fatal: 'X' matched multiple (Y) remote
tracking branches".
Add the remote name as prefix to make the reference unambiguous.
2022-07-18 20:12:06 +02:00
Kai Lueke
5e0dc0a85d ci-automation: Move git tagging into own script
When the build system runs the packages jobs for both architectures in
parallel and has to create a new tag, tagging fails due to the race in
the tagging.
Move the git tagging to its own script that is run from a new top-level
job that starts the packages jobs for both architectures.
2022-07-18 19:20:44 +02:00
flatcar-ci
51f740a2a8 New version: main-3301.0.0-nightly-20220715-2100 2022-07-15 21:00:30 +00:00
Jeremi Piotrowski
d3edc97063 build_image: use syft to generate SBOM for prod image
Since v0.51.0 syft supports generating parsing the gentoo package
database. This is a first go at integrating that into our image build
process. This doesn't yet include packages inside torcx packages, or the
kernel, or initramfs-only packages.
2022-07-15 11:52:33 +00:00
Kai Lüke
256885527c
Merge pull request #384 from flatcar-linux/kai/ga-runner-amd64-lxc
.github: Use lxc containers for amd64 kola tests, too
2022-07-15 12:30:47 +02:00
Kai Lueke
58927811b1 .github: Use lxc containers for amd64 kola tests, too
While we moved the arm64 tests to lxc containers, amd64 stayed on VMs
which were not easy to scale up.
Now the GitHub Action runner is running on lxc containers and we can
spawn more VMs in parallel because it has no memory limit.
2022-07-15 12:19:16 +02:00
flatcar-ci
60dc5f5065 New version: main-3300.0.0-nightly-20220714-2100 2022-07-14 21:00:27 +00:00
Krzesimir Nowak
412e11d908
Merge pull request #377 from flatcar-linux/krnowak/cleanup-dirs
build_library: Try to clean up unused stuff
2022-07-14 16:53:26 +02:00
Krzesimir Nowak
e65072910d build_library: Try to clean up unused stuff
There is some cruft left after grub hashes generation. After the
contents are zipped into archive, they don't need to be around any
more.

Try to remove the rootfs directory after unmounting the
image. disk_util can recreate it again if there is a need for it.

Remove the build directory used for generating ACI images - it's not
needed after successful installation.
2022-07-14 15:08:12 +02:00
Krzesimir Nowak
a96a66d222
Merge pull request #376 from flatcar-linux/krnowak/digests
ci-automation: Generate digests for artifacts
2022-07-14 14:42:49 +02:00
Kai Lüke
f83ee4f9a1
Merge pull request #375 from flatcar-linux/kai/print-changelog
ci-automation: Show changes by finding the previous channel
2022-07-14 13:44:22 +02:00
flatcar-ci
873eac6f5d New version: main-3299.0.0-nightly-20220713-2100 2022-07-13 21:00:29 +00:00
Kai Lueke
da370b54c1 ci-automation: Show changes by finding the previous channel
The image comparison was done against the old release in the channel
we release to instead of the previous release with the same major
version. This means when a channel transition happens we see a large
diff instead of the diff against the previous release. While not bad
for finding problems, this is normally not needed. However, we want
to have two changelogs generated, one against the old release in the
channel we relese to and one against the previous release with the same
major version when a transition happens. There was no changelog
printing yet, and this is added now.
2022-07-13 19:11:50 +02:00
Kai Lüke
d6ab2eccc6
Merge pull request #381 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-07-13 18:26:23 +02:00
Flatcar Buildbot
8cf32dfc56 Update mantle container image to latest HEAD 2022-07-13 16:10:03 +00:00
Kai Lüke
76b47a00b2
Merge pull request #374 from gabriel-samfira/make-workflow-pluggable
Make the kola test workflow reusable
2022-07-13 18:09:43 +02:00
Gabriel Adrian Samfira
340fd39a9f
Update kola test workflow
* arm64 tests now run in LXD containers instead of VMs
  * parallelism increased for arm64
  * some setup steps are skipped on arm64

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 14:20:12 +03:00
Gabriel Adrian Samfira
b518c3cdb8
Disable image mangle in qemu tests
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-13 14:19:50 +03:00
Gabriel Adrian Samfira
7dc45a4a1f
Make QEMU_UEFI_BIOS configurable
Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-12 19:46:27 +03:00
Krzesimir Nowak
4e6f44e7b8 ci-automation: Generate digests files for the built artifacts 2022-07-12 16:59:14 +02:00
Krzesimir Nowak
d475d36766 ci-automation: Add a function for generating digests
It works in a similar way to sign_artifacts - it takes a signer, a
list of files and directories, and generates digests next to the
respective files.
2022-07-12 16:59:14 +02:00
Krzesimir Nowak
133cb6b52f ci-automation: Factor out listing files into a separate function
This will come in handy when listing files for creating digests files.
2022-07-12 16:59:14 +02:00
Gabriel Adrian Samfira
6eabd91a04
Remove customizations for now
Remove arch and parallel options. Hardcode them for now.
2022-07-12 02:48:42 +03:00
flatcar-ci
056752222e New version: main-3297.0.0-nightly-20220711-2100 2022-07-11 21:00:28 +00:00
Gabriel Adrian Samfira
879e5a2b30
Make the kola test workflow reusable
* Adds a reusable workflow that can run tests
  * Adapts the ci.yaml to use reusable workflow
  * Creates a new workflow that helps trigger tests using an arbitrary
    workflow run.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-11 16:23:35 +03:00
Gabriel Adrian Samfira
dc8cf9c18d
Add configuration options to test functions
* Add SKIP_COPY_TO_BINCACHE environment variable that will skip
    uploading test results to bincache. This is useful if we want to
    upload test results as artifacts on github.
  * make QEMU_IMAGE_NAME configurable

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-11 13:32:25 +03:00
Kai Lüke
a04e7b39c1
Merge pull request #369 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-07-11 12:01:30 +02:00
Flatcar Buildbot
c6ac1100d6 Update mantle container image to latest HEAD 2022-07-11 07:10:34 +00:00
Mathieu Tortuyaux
f9b13baeb5
.github/ci: add kola qemu test
this initial attempt runs right after the "packages" jobs and downloads
the resulting artifacts.

The QEMU image is unzipped then the kola test is running using the
ci-automation scripts.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-07-07 10:01:49 +02:00
flatcar-ci
392ce4089b New version: main-3292.0.0-nightly-20220706-2100 2022-07-06 21:00:36 +00:00
Kai Lüke
7eacd85c2e
Merge pull request #365 from flatcar-linux/kai/store-compressed
ci-automation: Only store compressed images
2022-07-06 15:54:55 +02:00
Kai Lüke
a5a7c60784
Merge pull request #366 from gabriel-samfira/add-concurency-to-workflow
Add concurency setting to CI workflow
2022-07-06 10:53:23 +02:00
flatcar-ci
4e1909afc2 New version: main-3291.0.0-nightly-20220705-2100 2022-07-05 21:00:30 +00:00
Kai Lueke
ef9b0ff820 ci-automation: Only store compressed images
The new build pipeline compresses images already but uploaded both the
compressed and uncompressed files because the whole build folder gets
uploaded.
Add a new flag "--only_store_compressed" to the image generation which
deletes the uncompressed file after compression is done. Uncompressed
images are still supported if specified in the flag
"image_compression_formats".

Closes https://github.com/flatcar-linux/Flatcar/issues/793
2022-07-05 16:13:22 +02:00
Gabriel Adrian Samfira
59e7b31778
Add concurency setting to CI workflow
This change will prompt the CI workflow to cancel a currently running
job, if a new push is sent in a PR. This should prevent duplicate jobs
running for the same PR simultaneously.

Signed-off-by: Gabriel Adrian Samfira <gsamfira@cloudbasesolutions.com>
2022-07-04 21:18:31 +03:00
flatcar-ci
9ba0c27cb2 New version: main-3286.0.0-nightly-20220630-2100 2022-07-01 15:37:28 +00:00
Kai Lüke
5516e4948d
Merge pull request #364 from flatcar-linux/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2022-06-30 23:29:02 +02:00
Flatcar Buildbot
610686c022 Update mantle container image to latest HEAD 2022-06-30 21:00:54 +00:00