5391 Commits

Author SHA1 Message Date
Krzesimir Nowak
a0208a706a build_library/dev_container_util.sh: Fix setting up portage
With PORTDIR and PORTDIR_OVERLAY environment variables being gone as
overrides, setting up a profile for the developer container broke. The
overrides were a hack already, as eselect does not seem to have
support for setting a profile based on repos.conf with repo locations
that are valid only after chrooting into the root directory. So
instead of invoking eselect, we set up the symlink ourselves.
2023-02-21 08:43:14 +01:00
flatcar-ci
3d82186f90 New version: main-3521.0.0-nightly-20230220-2100 2023-02-20 21:00:25 +00:00
Krzesimir Nowak
a76292c7d5 *: Drop the use of deprecated PORTDIR and PORTDIR_OVERLAY env vars
These were mostly replaced by relevant config in repos.conf directory.
2023-02-20 17:10:26 +01:00
Kai Lüke
809401262f
Merge pull request #662 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-02-20 08:09:21 +01:00
Flatcar Buildbot
f88c6cd4fa Update mantle container image to latest HEAD 2023-02-17 13:33:09 +00:00
Krzesimir Nowak
fb805ee866
Merge pull request #654 from flatcar/krnowak/verbose-emerge
Make emerge and catalyst verbose by default
2023-02-17 14:32:52 +01:00
flatcar-ci
81b609b751 New version: main-3517.0.0-nightly-20230216-2100 2023-02-16 21:00:25 +00:00
Krzesimir Nowak
fa48f70a37 *: Make catalyst and emerge verbose by default
That way we can see a report of what emerge is going to do and the
status of the use flags for the installed packages. The downside is
that we are going to have reports about using deprecated and
unsupported profile in even more places.
2023-02-16 13:57:05 +01:00
Krzesimir Nowak
520b92ad7e *: Expand short emerge flags and use bash arrays
Emerge flags are cryptic in general, but short flags even more so, so
expand them. While at it, I noticed some places where bash arrays
could be used, so convert those places too.
2023-02-16 13:57:05 +01:00
Krzesimir Nowak
1d132574ac build_library/catalyst.sh: Do not use "which"
There's a bash built-in named command that could be used instead.
2023-02-16 13:57:05 +01:00
flatcar-ci
0e0dbb924c New version: main-3517.0.0-nightly-20230216-0606 2023-02-16 06:06:45 +00:00
Kai Lüke
2654552f2b
Merge pull request #655 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-02-16 06:30:14 +01:00
Flatcar Buildbot
974eebde26 Update mantle container image to latest HEAD 2023-02-15 21:00:41 +00:00
flatcar-ci
db33cb9c4e New version: main-3516.0.0-nightly-20230215-2100 2023-02-15 21:00:26 +00:00
flatcar-ci
f5333d48ba New version: main-3515.0.0-nightly-20230214-2100 2023-02-14 21:00:28 +00:00
Kai Lüke
f7f1405a89
Merge pull request #652 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-02-14 11:59:35 +01:00
Flatcar Buildbot
a3f425e7ec Update mantle container image to latest HEAD 2023-02-14 10:49:53 +00:00
Kai Lüke
1103c83d2c
Merge pull request #648 from flatcar/kai/git-config-safe-dir
ci-automation: Allow git to work on directory owned by other user
2023-02-14 11:49:38 +01:00
Kai Lueke
87e13eb3de ci-automation: Allow git to work on directory owned by other user
The get_git_channel function failed to work which resulted in the
Alpha release job skipping the AWS publishing for the Alpha channel
because it defaulted to the developer channel as fallback when git
rejected to work on the directory owned by the build user while running
as root user. A new version of git caused this behavior change and also
prints an error message that explains to have to set safe.directory.

Set the git config entry safe.directory for the /work path when
entering the mantle container where git runs as root while working on
the directory owned by the build user.
2023-02-14 11:39:33 +09:00
flatcar-ci
414987596d New version: main-3514.0.0-nightly-20230213-2100 2023-02-13 21:00:31 +00:00
flatcar-ci
d9840913e4 New version: main-3510.0.0-nightly-20230209-2100 2023-02-09 21:00:25 +00:00
Krzesimir Nowak
0a89347747
Merge pull request #647 from flatcar/krnowak/vms-fix
ci-automation: Get two files to build vms instead of a whole directory
2023-02-09 11:45:25 +01:00
Krzesimir Nowak
50183b48b8 ci-automation: Get two files to build vms instead of a whole directory
Getting the contents of the directory in the buildcache involves using
rsync with some ssh invocation to log in as a bincache user. It's not
a thing that will work locally unless the user gets ahold of the SSH
key allowing the user to log in to buildcache as a bincache user.

Replace it by downloading two files that are actually needed for
building vms: an image file and the version file. This just uses curl
and is accessible for everyone.
2023-02-08 14:50:36 +01:00
flatcar-ci
67699c9121 New version: main-3508.0.0-nightly-20230207-2100 2023-02-07 21:00:26 +00:00
Krzesimir Nowak
e99a025508
Merge pull request #636 from flatcar/krnowak/matching-cross-toolchain-versions
build_library/toolchain_util.sh: Install matching versions of toolchain packages
2023-02-07 15:12:18 +01:00
Krzesimir Nowak
ac9adacf90
Merge pull request #642 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-02-07 08:47:54 +01:00
Flatcar Buildbot
8784d6dc6d Update mantle container image to latest HEAD 2023-02-07 07:12:28 +00:00
flatcar-ci
c066dc7117 New version: main-3507.0.0-nightly-20230206-2100 2023-02-06 21:00:29 +00:00
Kai Lüke
10886b0bc5
Merge pull request #638 from flatcar/mantle-update-main
Upgrade mantle container image to latest HEAD in main
2023-02-06 14:42:12 +01:00
Krzesimir Nowak
2161efba6f build_library/toolchain_util.sh: Install matching versions of toolchain packages
When adding a mask or accept keywords entry for some version of a
toolchain package (gcc, libc, gdb, binutils or kernel headers), it
can't be done by just doing it, for example, for sys-devel/gcc. Both
cross-{x86_64,aarch64}-cros-linux-gnu/gcc needs to be
masked/keyworded, otherwise crossdev will pick up the latest stable
version for cross-{x86_64,aarch64}-cros-linux-gnu/gcc and this choice
is not affected by masks or accept keywords of sys-devel/gcc.

This situation does not happen all that often, but when it happens,
it's usually hard to remember to handle also the cross toolchain
packages. Forgetting to do so leads to weird issues. So instead of
telling crossdev to use the latest stable versions of cross toolchain
packages, we will tell it to use specific versions that match the
version of plain packages.
2023-02-06 11:57:40 +01:00
Flatcar Buildbot
016bb9f738 Update mantle container image to latest HEAD 2023-02-06 07:09:41 +00:00
flatcar-ci
d933e45647 New version: main-3503.0.0-nightly-20230202-2100 2023-02-02 21:00:23 +00:00
Krzesimir Nowak
b0e889b36b
Merge pull request #635 from flatcar/krnowak/size-reporting
Report file and file size changes in production image and initrd
2023-02-02 17:34:30 +01:00
Krzesimir Nowak
46a250bf33 ci-automation: Report file size changes
This uses the new size-change-report.sh script to print out some
information about largest files being added/removed and files with
greatest increase/decrease in file size between two versions of the
image.
2023-02-02 10:05:02 +01:00
Krzesimir Nowak
219326392c ci-automation: Try reporting the changes in initrd too
This relies on flatcar_production_image_initrd_contents.txt being
uploaded to the server. It also exports the WITHWTD environment
variable with a value 1, which will make the package-diff script to
try out the wtd contents file variant first.
2023-02-02 10:04:40 +01:00
Krzesimir Nowak
e979082b17
Merge pull request #634 from flatcar/krnowak/report-generation
Update report generation
2023-02-02 09:44:43 +01:00
flatcar-ci
fd686f1da4 New version: main-3502.0.0-nightly-20230201-2100 2023-02-01 21:00:26 +00:00
Krzesimir Nowak
edc90b4e59 build_library: Add generation of disk space usage
This could replace an ad-hoc calculations we do in package-diff.
2023-02-01 14:43:24 +01:00
Krzesimir Nowak
1c1c0099c7 build_library: Generate content files for initrd too 2023-02-01 14:43:24 +01:00
Krzesimir Nowak
f4829fd860 build_library: Add generation of image contents with different details
Timestamp and user/group information are out, in are device ID and
inode number. That way, the file can be used for accounting size
differences of files/image.
2023-02-01 14:43:24 +01:00
flatcar-ci
7b772f596e New version: main-3501.0.0-nightly-20230131-2100 2023-01-31 21:00:27 +00:00
Krzesimir Nowak
9aeab641fd
Merge pull request #633 from flatcar/krnowak/user-patches-setup-fix
*: Fix user-patches setup
2023-01-31 15:41:15 +01:00
Krzesimir Nowak
fbbec12cc1
Merge pull request #632 from flatcar/krnowak/weekly
build_library/toolchain_util: Set up symlink for user patches
2023-01-31 12:20:20 +01:00
Krzesimir Nowak
57f849239f build_library/toolchain_util: Set up symlink for user patches
This was a place I missed where /etc/portage is set up. Because of it,
user patches for sys-devel/gcc were not picked up.

Also stop using deprecated PORTDIR and PORTDIR_OVERLAY getters. We
still set those variables, but we will drop them eventually.
2023-01-31 12:19:50 +01:00
Krzesimir Nowak
409b47a932 *: Fix user-patches setup
Normally `ln -sf path/to/target at/name` will create a symlink at
`at/name` that points to `path/to/target`. But if `at/name` already
exists and is a directory or a symlink to some other directory, then
this command will create a symlink at `at/name/target` pointing to
`path/to/target`. There is an ambiguity between 1st and 3rd form of
`ln` (please refer to `man ln` for the available invocation forms). It
can be disambiguated by using the `-T` flag to force the 1st form.

In our case, if `/etc/portage/patches` symlink already existed and was
pointing to `<coreos-overlay>/coreos/user-patches`, we ended up with a
useless symlink at `<coreos-overlay>/coreos/user-patches/user-patches`
pointing to `<coreos-overlay>/coreos/user-patches`.
2023-01-31 12:00:22 +01:00
flatcar-ci
e5b8570062 New version: main-3500.0.0-nightly-20230130-2100 2023-01-30 21:00:28 +00:00
flatcar-ci
ffa5527012 New version: main-3495.0.0-nightly-20230125-2100 2023-01-25 21:00:27 +00:00
Krzesimir Nowak
e1e9975f53
Merge pull request #608 from flatcar/krnowak/bincache-for-dev-builds
common: Split binpkg and SDK tarball URLs
2023-01-25 16:12:29 +01:00
flatcar-ci
1200f55550 New version: main-3493.0.0-nightly-20230123-2100 2023-01-23 21:00:25 +00:00
flatcar-ci
8a939513ff New version: main-3490.0.0-nightly-20230120-2100 2023-01-20 21:00:33 +00:00