4661 Commits

Author SHA1 Message Date
Dongsu Park
5ba48dc190 New version: beta-3139.1.0 beta-3139.1.0 2022-03-02 18:17:52 +01:00
Kai Lueke
cb29edd520 Merge pull request #235 from flatcar-linux/scripts
ci-automation: add update test
2022-03-02 11:30:02 +01:00
Kai Lueke
0756ef0287 ci-automation: add missing update test
The kola update test was missing. It is performed as update from the
old image to the newly built payload to ensure that the new image is
compatible for old clients.
2022-03-02 11:30:02 +01:00
Dongsu Park
ddc7ff6fd9 New version: beta-3139.1.0 2022-03-02 08:19:24 +01:00
Dongsu Park
008c557889 New version: beta-3139.1.0 2022-03-01 18:03:35 +01:00
Thilo Fromm
f52e14a04f ci-automation/vendor-testing: add qemu_uefi
This change adds the qemu_uefi.sh vendor test. It reuses most of the
implementation in qemu.sh (qemu_uefi.sh is a soft-link to qemu.sh).

This also enables qemu testing for ARM64.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-25 14:37:08 +01:00
Thilo Fromm
0c70bd87ec Merge pull request #238 from flatcar-linux/scripts
ci-automation: fix test_update_reruns typo
2022-02-24 12:38:41 +01:00
Thilo Fromm
7e7847dcfd ci-automation: fix test_update_reruns typo
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 12:38:41 +01:00
Thilo Fromm
3420518ffa Merge pull request #234 from flatcar-linux/scripts
ci-automation/test*: per-image summary report, honour pre-set PARALLEL_TESTS
2022-02-24 11:13:17 +01:00
Thilo Fromm
eba2b1c259 ci-automation/test*: per-image summary, honor parallel
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-24 11:13:17 +01:00
Thilo Fromm
b5f894ad69 Merge pull request #232 from flatcar-linux/scripts
ci-automation: publish test results, add to GC
2022-02-23 10:25:32 +01:00
Thilo Fromm
789249bc86 ci-automation/test.sh: publish to _kola_tmp, not debug/_kola_tmp
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:32 +01:00
Thilo Fromm
02c5cc1a21 Update ci-automation/test.sh: fix typo.
Co-authored-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-02-23 10:25:32 +01:00
Thilo Fromm
32eede0808 ci-automation: publish test results, add to GC
This change adds copying test results to the build cache server, and
adds respective deletion to the garbage collector.

Also, the patch fixes an issue with torcx publishing (manifest
publishing had arch hard-coded).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-23 10:25:32 +01:00
Thilo Fromm
2eb76d7cfe Merge pull request #230 from flatcar-linux/scripts
update_sdk_container_image: New SDK container from existing image (minor / patch updates)
2022-02-22 18:38:16 +01:00
Thilo Fromm
2d4b8142e3 update_sdk_container_image: update SDK container image
This change introduces update_sdk_container_image, a script to generate
a new SDK container image based on an existing SDK container. The
script is meant to be used for minor / patch level SDK changes (like
test suite updates).

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:38:16 +01:00
Thilo Fromm
366eb2687c Merge pull request #228 from flatcar-linux/scripts
ci-automation: Add foundational testing primitives
2022-02-22 18:36:45 +01:00
Thilo Fromm
b9d497c3a6 ci-automtion/packages.sh: fix torcx URL, add manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
b9a7f4cc19 ci-automation/tests.sh: use http in torcx manifest
Use HTTP instead of https because Ignition does not recognise
letsencrypt certificates, leading to test breakage in
docker.torcx-manifest-pkgs.

Add a note in settings.env to explicitly call out HTTP requirement of
build cache server.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
40c140b4b7 ci-automation/test.sh: stage torcx manifest
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
4269e61a18 ci-automation/README.md: add docs for qemu test 2022-02-22 18:36:45 +01:00
Thilo Fromm
b105019448 ci-automation/tapfile: enforce foreign keys, simplify 2022-02-22 18:36:45 +01:00
Thilo Fromm
cfe1fef430 ci-automation: publish torcx json and use in tests
This change updates the package build script to publish the torcx
manifest file to the build cache so it can be used by tests.
It also updates the generic test script to use the SDK container instead
of the packages container image, and to download and use the torcx
manifest from the build cache.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
74c2cd0dae ci-automation/test.sh: fix reruns, set retry to 20
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
d6dd2249e4 ci-automation: git author and curl verboseness
- Git author configuration moves to tagging function and put under a
  condition so as to not pollute peoples' workspaces.
- curl now less verbose since it was spamming logs with TLS debug
  information.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
60d199224e ci-automation testing: address PR review comments
- add cleanup script to test.sh
- remove wrapper function from qemu test

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Thilo Fromm
69584ae9b0 ci-automation/tapfile_helper_lib.sh: add @pothos' retcode fix
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:45 +01:00
Thilo Fromm
7dc9ae2a73 Apply @pothos' suggestions from code review
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2022-02-22 18:36:45 +01:00
Thilo Fromm
c61861f585 ci-automation: first stab at adding testing
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-02-22 18:36:45 +01:00
Kai Lueke
89e004f7c7 Merge pull request #226 from flatcar-linux/scripts
jenkins/images: print out image diff report
2022-02-16 12:12:14 +01:00
Kai Lueke
f86fbc2815 jenkins/images: print out image diff report
Often a change results in unexpected effects on the image, e.g., when
a wrong package version gets chosen or the package installs files under
/etc, or binaries of library dependencies get pulled in. Besides
inspecting the image manually, the package-diff tool also gives
valuable insights.
Run the package-diff tool in a comparison to the last release and print
the image URL alongside for convenience.
2022-02-16 12:12:14 +01:00
flatcar-ci
89becd3a2e
New version: alpha-3139.0.0 alpha-3139.0.0 2022-02-03 23:29:47 +05:30
Mathieu Tortuyaux
98d964d689
Merge pull request #220 from flatcar-linux/tormath1/em-metro
equinixmetal: use metro instead of facility
2022-01-26 16:27:09 +01:00
Mathieu Tortuyaux
373976b1eb
jenkins/kola/packet: use metro instead of facility
Follow up of: https://github.com/flatcar-linux/mantle/pull/281

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2022-01-26 15:49:30 +01:00
Mathieu Tortuyaux
7ddf2121a7
Merge pull request #219 from flatcar-linux/sayan/update-sdk-3127.0.0
New major release: 3127.0.0
2022-01-26 11:35:18 +01:00
flatcar-ci
153a347999
New major release: 3127.0.0 2022-01-26 14:11:59 +05:30
Jeremi Piotrowski
45be4de050
Merge pull request #217 from flatcar-linux/jepio/pkg-list-torcx-components
list torcx components in package list.
2022-01-17 15:05:56 +01:00
Jeremi Piotrowski
3af02e323c build_library/torcx_manifest.sh: list all component pkgs in sources_on_disk()
source_on_disk() so far relied on the 'sourcePackage' field, which contains the
primary dependency of a torcx packge (app-torcx/docker ->
app-emulation/docker). Now the 'metaPackage' field (app-torcx/docker) is used,
which lets us look at RDEPENDS and figure out all packages that are indirectly
installed when installing a torcx package. torcx_dependencies() does just that,
so move it's definition to torcx_manifest.sh.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-01-14 16:00:51 +00:00
Jeremi Piotrowski
499fade8d3 build_torcx_store: store additional 'metaPackage' field in torcx manifest
The torcx_manifest.json file currently has a 'sourcePackage' field which is
extracted from the first runtime dependency of the torcx package ebuild. This
is a convention, and causes sourcePackage to hold 'app-emulation/docker' for
the 'app-torcx/docker' package. This does not carry enough information to be
able to figure out what other packages are part of the torcx package.

Store an additional field, 'metaPackage', in the manifest which contains the
name of the torcx package. With the right ebuild it is then possible to figure
out what other packages are part of a given torcx package. This can then be
used to add that information to the image packages list.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-01-14 15:46:08 +00:00
Jeremi Piotrowski
78254a18eb build_torcx_store: build torcx components in parallel
Instead of looping over the package list, pass all the packages to a single
emerge call and specify num jobs. This lets emerge build/install all of them in
parallel, shaving some time off the torcx build.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-01-14 15:37:12 +00:00
Sayan Chowdhury
7d36fedee6
Merge pull request #216 from flatcar-linux/sayan/update-sdk-3115.0.0
New major release: 3115.0.0
2022-01-13 20:07:38 +05:30
flatcar-ci
6deacd7839
New major release: 3115.0.0 2022-01-13 19:50:37 +05:30
Kai Lueke
e188557195 changelog/README.md: specify current security fix section format
The entries added in changelog/security/ do not follow our existing
security section in the release notes:
  https://www.flatcar.org/releases/#release-3033.2.0

Document the structure and an example to use the right format that we
need for release note generation.
2022-01-12 17:29:54 +01:00
Thilo Fromm
0bc166c560
Merge pull request #215 from flatcar-linux/t-lo/enable-nightly-build-binpkgs
SDK container: enable binpkg cache for nightly builds
2022-01-12 16:05:04 +01:00
Thilo Fromm
719689992c SDK container: enable binpkg cache for nightly builds
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2022-01-12 15:44:30 +01:00
Kai Lüke
f9b51461ab
Merge pull request #212 from flatcar-linux/kai/set-group-only-in-usr
set_lsb_release: only set update-engine GROUP in /usr, not /etc
2022-01-11 15:01:34 +01:00
Kai Lueke
0c9804a9a4 set_lsb_release: only set update-engine GROUP in /usr, not /etc
The default image group is already encoded in
/usr/share/flatcar/update.conf but it was written to
/etc/flatcar/update.conf as well. This can cause problems when the user
switches channels by forcing an update to a specific release from the
different channel (e.g., through the flatcar-update tool) as it leaves
the file under /etc/flatcar/update.conf out of sync with the new
channel version in /usr/share/flatcar/update.conf.

Since we don't really need to write a specific channel to /etc on new
images as we can rely on the value from /usr, we now leave any possible
overwriting of the value in /etc entirely to the user.
2022-01-11 15:00:43 +01:00
Thilo Fromm
e84e90e625
Merge pull request #213 from flatcar-linux/t-lo/ci-fix-nightly-binpkg-url
settings / ci-automation: remove "binpkg" prefix
2022-01-11 11:25:53 +01:00
Jeremi Piotrowski
43687783af
Merge pull request #214 from flatcar-linux/jepio/ignore-egg-info-symlink
build_library/check_root: ignore dangling '*egg-info' symlink
2022-01-11 11:25:21 +01:00
Jeremi Piotrowski
7caafa6cd6 build_library/check_root: ignore dangling '*egg-info' symlink
Since the update of dev-python/certifi, running the command
`./image_to_vm.sh --format gce --board=amd64-usr` fails due to a
dangling symlink. This symlink is located in
/usr/lib64/python3.9/site-packages and is not supposed to be installed
in the first place because of this INSTALL_MASK entry in
coreos-overlay/profiles/coreos/targets/generic/oem-aci/make.defaults:

  INSTALL_MASK="${INSTALL_MASK}
    /usr/*/python3*
  "

There is an open upstream bug that INSTALL_MASK doesn't work correctly on
symlinks (https://bugs.gentoo.org/678462).
The best we can do at this time is to ignore the dangling symlink.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2022-01-11 10:02:53 +00:00