Commit Graph

24587 Commits

Author SHA1 Message Date
Thilo Fromm
bd54e3a0ce .github: removed torcx artifact handling from github CI
Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
35779f1ca3 run_local_tests.sh: script for running tests on local builds
This change adds run_local_tests.sh, a script to run tests on local
builds. It's a comfort wrapper around ci-automation scripts and uses
the latest local build.

Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
6f651a298c build scripts: separate txt inventory; official naming for sysexts
Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
e85ca4984c ci-automation: remove torcx artifact handling and tests 2023-10-23 16:05:45 +02:00
Thilo Fromm
89555ed2bd base OS sysexts: separate build script, inventory generation
This change refactors base OS sysext builds to use a separate build
script `build_library/sysext_prod_builder`, which is called from
`build_library/prod_image_util.sh` when `build_image` runs.

This allows for better separation of cleanup traps: prod image sysext
builds need its own trap / cleanup function for temporary build
directories and loopback mounts.

Prod sysext builds properly generate lincense and SBOM information, and
provide detailed file listings and disk space usage stats.

- SBOM / licenses JSON now include all packages of the
  final image, i.e. a combined list of base image and all base OS
  sysexts.
- Packages lists, files list and detailed files list include the sysext
  squashfs files for the base image, and separate sections with files /
  packages lists for each sysext.
- Disk usage contains both final disk image usage as well as usage of
  each individual sysext squashfs.
2023-10-23 16:05:45 +02:00
Thilo Fromm
c589fb8e56 coreos-overlay: removed all remaining app-torcx artifacts
Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
8e01a2c8f9 build_image: add sysext command line option
This change refactors sysext builds during build_image and generalises
the code (no hard-coded containerd and docker anymore).

A command line option is added to build_image for sysexts to include in
the OS image. It defaults to containerd and docker but may be set to
arbitrary packages. The command line supports simple depenencies, i.e.
the "docker" sysext will re-use package information from the
"containerd" sysext and not include another containerd.

Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
8f8f262f19 torcx: remove from scripts, use docker+containerd sysexts
This change removes torcx libraries, references, and commandline options
from build automation scripts and from build_library/.

Containerd and docker are shipped via sysexts which are included in the
base image.

Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
aae3fd8260 prod_image_util.sh: remove pkgdb tarball (replaced by sysext)
Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
9837c35ec4 build_sysext: add sysext dependency handling
This change adds 2 optional command line parameters to build_sysext to
handle dependencies in stacked sysexts. The command line parameters
allow exporting portage package db information into a separate squashfs
image as well as using package db information exported by a previous
sysext build.

--generate_pkginfo will generate a separate squashfs
   <sysextname>_pkginfo.raw which contains the sysext's /var/db/pkgs.

--base_pkginfo=<pkginfo>[:<pkginfo>[:...]] will use the supplied paths
   to pkginfo squashfses as additional lowerdirs when creating a sysext.

Useage example:
./build_sysext --generate_pkginfo containerd app-containers/containerd
./build_sysext --base_pkginfo=containerd_pkginfo.raw docker app-containers/docker

will create a containerd.raw sysext and a dependent docker.raw sysext
that does not have the containerd dependency installed. Both sysexts
must be merged together in order for docker to work.

Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Thilo Fromm
9cede02f86 dev_container_util.sh: remove spurious DEVCONTAINER=1
Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-23 16:05:45 +02:00
Krish Jain
cc029bb5ca use DEVCONTAINER=1 2023-10-23 16:05:45 +02:00
Krish Jain
3c4639b0ce use sudo_clobber function 2023-10-23 16:05:45 +02:00
Krish Jain
298e283944 fix permissions issue 2023-10-23 16:05:45 +02:00
Krish Jain
4633cc3e7c Fix syntax errors, quoting 2023-10-23 16:05:45 +02:00
Krish Jain
f6f5c32417 add information about the packages contained in the built sysext 2023-10-23 16:05:45 +02:00
Krish Jain
fe949f5900 Make sure binary packages are built in build_packages already 2023-10-23 16:05:45 +02:00
Krish Jain
4e8b276319 Remove duplicate making directory root_fs_dir/etc/extensions 2023-10-23 16:05:45 +02:00
Krish Jain
abe8bf683a Use helper function query_available_package() 2023-10-23 16:05:45 +02:00
Krish Jain
4b00bc14a4 tail, not head 2023-10-23 16:05:45 +02:00
Krish Jain
9709a64239 incorporate suggestions from Jeremi 2023-10-23 16:05:45 +02:00
Krish Jain
e6bb5470c4 Add mangle script for containerd 2023-10-23 16:05:45 +02:00
Krish Jain
e5f1ecbae3 Only keep docker stuff in manglefs_docker 2023-10-23 16:05:45 +02:00
Krish Jain
2be2e884b3 Add manglefs script for containerd 2023-10-23 16:05:45 +02:00
Krish Jain
3d17f65088 Create seperate docker and containerd sysext 2023-10-23 16:05:45 +02:00
krishjainx
c026d9ed53 Remove app-arch/torcx from coreos-overlay 2023-10-23 16:05:45 +02:00
krishjainx
851009c6cc Install docker as a system extension, use manglefs script ( convert the unit dependencies from wants to upholds); one sysext for all docker for now 2023-10-23 16:05:45 +02:00
Mathieu Tortuyaux
7b0d9bde7e
Merge pull request #1289 from flatcar/linux-6.1.59-main
Upgrade Linux Kernel for main from 6.1.58 to 6.1.59
2023-10-23 15:26:43 +02:00
flatcar-ci
ed16d78876 New version: main-3763.0.0-nightly-20231020-2100 2023-10-21 02:09:26 +00:00
flatcar-ci
418e418c29 New version: main-3763.0.0-nightly-20231020-2100-INTERMEDIATE 2023-10-20 21:00:29 +00:00
Kai Lüke
a85e51b03d
Merge pull request #1170 from flatcar/kai/usr-btrfs
disk_layout: use btrfs for the /usr partition
2023-10-20 13:26:21 +02:00
Kai Lüke
736259812a
Merge pull request #1282 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-10-20 13:22:50 +02:00
Flatcar Buildbot
9c8e8b8f10 sys-kernel/coreos-sources: Update from 6.1.58 to 6.1.59 2023-10-20 07:11:41 +00:00
Flatcar Buildbot
c3b366f872 Update mantle container image to latest HEAD 2023-10-19 21:00:42 +00:00
flatcar-ci
18adacfa57 New version: main-3762.0.0-nightly-20231019-2100 2023-10-19 21:00:23 +00:00
Dongsu Park
291ec131e3
Merge pull request #1281 from flatcar/dongsu/rust-1.73.0
overlay dev-lang/rust: Update to 1.73.0
2023-10-19 12:27:20 +02:00
Thilo Fromm
e8187981fb
Merge pull request #1288 from flatcar/t-lo/fix-systemd-curl-cyclic-dep
build_packages: fix systemd cyclic deps resolver
2023-10-19 11:31:28 +02:00
Thilo Fromm
a6d8a89399 build_packages: fix systemd cyclic deps resolver
This change removes "curl" from the USE flags to be removed to build
systemd in the cyclic deps resolver step of build_packages. Excluding
curl from systemd's USE flags leads to build breakage:

09:06:25  !!! The ebuild selected to satisfy "sys-apps/systemd" for /build/amd64-usr/ has unmet requirements.
09:06:25  - sys-apps/systemd-252.11-r1::coreos USE="audit dns-over-tls elfutils gcrypt gnuefi http idn importd iptables kmod lz4 lzma openssl pam pcre policykit resolvconf seccomp selinux (sysv-utils) (vanilla) zstd -acl -apparmor -cgroup-hybrid -cryptsetup -curl -fido2 -gnutls -homed -pkcs11 -pwquality -qrcode (-split-usr) -test -tpm -xkb"
09:06:25
09:06:25    The following REQUIRED_USE flag constraints are unsatisfied:
09:06:25      importd? ( curl )
09:06:25
09:06:25    The above constraints are a subset of the following complete expression:
09:06:25      dns-over-tls? ( any-of ( gnutls openssl ) ) homed? ( cryptsetup pam openssl ) importd? ( curl lzma any-of ( gcrypt openssl ) ) pwquality? ( homed )

Signed-off-by: Thilo Fromm <thilofromm@microsoft.com>
2023-10-19 11:09:45 +02:00
Krzesimir Nowak
9bd49b722e
Merge pull request #1280 from dosomder/cloudsigma-set-tty-raw
overlay cloudsigma: Set tty to RAW
2023-10-19 10:55:56 +02:00
dosomder
efd822f993
overlay cloudsigma: bump ebuild revision 2023-10-19 07:44:07 +02:00
flatcar-ci
27384f9a4a New version: main-3761.0.0-nightly-20231018-2100 2023-10-18 21:00:38 +00:00
Krzesimir Nowak
a56e7b52c7
Merge pull request #1276 from flatcar/buildbot/weekly-portage-stable-package-updates-2023-10-16
Weekly portage-stable package updates 2023-10-16
2023-10-18 16:07:31 +02:00
dosomder
cf20383edc
changelog: rephrase bugfix for cloudsigma cloudinit
Co-authored-by: Krzesimir Nowak <qdlacz@gmail.com>
2023-10-18 14:41:47 +02:00
Dongsu Park
7c7dd79184 changelog: add changelog for Rust 1.73.0 2023-10-18 09:17:04 +02:00
Dongsu Park
934009e25e overlay virtual/rust: update to 1.73.0 2023-10-18 09:17:04 +02:00
Dongsu Park
ec8e7e8f87 overlay dev-lang/rust: Apply Flatcar modifications
- Apply cross-compiling changes.
- Remove dependency on sys-apps/lsb-release, which conflicts with
  sys-apps/baselayout of Flatcar.
- Remove rust-src to keep the SDK size minimal.
- Add a comment about keeping the patchlevel 0 of stage0.
- Update Rust version from 1.72.1 to 1.73.0 in profiles.

Based on commit 82f9e1b8db
2023-10-18 09:17:04 +02:00
Dongsu Park
5d12e8e118 overlay dev-lang/rust: Update to 1.73.0
Sync with Gentoo to update dev-lang/rust to 1.73.0.

Gentoo ref: a36588cc963e0ecf32b38465c02039b20ecd7ea6
2023-10-18 09:17:04 +02:00
Dongsu Park
c3d19db937 portage eclass: sync rust-toolchain.eclass
Get rust-toolchain.eclass in sync with Gentoo to be able to build
Rust 1.73+.

Otherwise build will fail due to a missing file from the upstream repo
rust-1.72.0-mips-unknown-linux-gnu.tar.xz.

Gentoo ref: f66c64d25bc04fc2ef3bd3cba6a8fbc48f42be9f
2023-10-18 09:17:04 +02:00
flatcar-ci
115505b86e New version: main-3760.0.0-nightly-20231017-2100 2023-10-17 21:00:27 +00:00
Krzesimir Nowak
b2b42d9341 build_packages: Break another dep loop
It came up with net-libs/nghttp2 adding some integration with systemd.
2023-10-17 18:23:40 +02:00