Commit Graph

4611 Commits

Author SHA1 Message Date
Dongsu Park
3960ce8036 jenkins: make release.sh publish arm64 for Stable
From flatcar-3033 on, arm64 images are available for Stable channel, we
need to also add arm64 to Stable boards.
2021-12-10 11:31:34 +01:00
Dongsu Park
635471c9a6
Merge pull request #188 from flatcar-linux/dongsu/jenkins-arm64-beta
jenkins: make release.sh publish arm64 for Beta
2021-12-10 09:51:13 +01:00
Dongsu Park
0b0f91385a changelog: add bugfix for publishing arm64 Beta images 2021-12-09 17:44:54 +01:00
Dongsu Park
1b323ae6f9 jenkins: make release.sh publish arm64 for Beta
Now that arm64 images are available for Beta channel, we need to also
add arm64 to Beta boards.
2021-12-09 17:42:30 +01:00
Thilo Fromm
f996c974fe
Merge pull request #147 from flatcar-linux/t-lo/sdk-container
SDK container: Add support for SDK containers.
2021-12-07 18:56:03 +01:00
Krzesimir Nowak
c9ad87ca76
Merge pull request #184 from flatcar-linux/krnowak/changelog-update
changelog: Update the update changelog format
2021-11-30 17:10:35 +01:00
Krzesimir Nowak
ea46f327fa changelog: Update the update changelog format
Mention that it should be written as a bullet list. Also, match the
format to the example (put the version link inside parentheses).
2021-11-30 14:57:29 +01:00
flatcar-ci
8c877b7bb9 sdk_container: rebase on latest main (all 3 repos)
Signed-off-by: flatcar-ci <infra+ci@flatcar-linux.org>
2021-11-26 17:55:49 +01:00
flatcar-ci
b780fd4b19 ci-automation/garbage_collect: remove spurious line number 2021-11-26 17:54:43 +01:00
flatcar-ci
cfc007be17 alpha-3046.0.0
Signed-off-by: flatcar-ci <infra+ci@flatcar-linux.org>
2021-11-26 17:54:43 +01:00
Thilo Fromm
b227a4dc23 README.md: one more Scripts => scripts
Co-authored-by: Krzesimir Nowak <knowak@microsoft.com>
2021-11-26 17:54:43 +01:00
Thilo Fromm
1d1c6048d4 sdk-container: add @krnowak's suggestions from code review
Co-authored-by: Krzesimir Nowak <knowak@microsoft.com>
2021-11-26 17:54:43 +01:00
flatcar-ci
7f874e491e sdk-container: address feedback from @krnowak review
Signed-off-by: flatcar-ci <infra+ci@flatcar-linux.org>
2021-11-26 17:54:43 +01:00
Thilo Fromm
90af105e9f ci/garbage_collect: pick version, fix images + vms
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Thilo Fromm
2324c5eeff sdk_container: fix submodules parent path in container
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Thilo Fromm
5ed28497ba ci-autmation: support main- alongside alpha-, beta-...
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Thilo Fromm
10dc85b099 README: add documentation on submodules and on tags
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Thilo Fromm
877120d96c SDK container README.md: better bullet points
Co-authored-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-11-26 17:54:43 +01:00
Thilo Fromm
337e0d7c3c SDK container: spelling + cp optimisation from code review
Add suggestions by @pothos from code review
- use `cp --reflink=auto`
- spelling error fixes

Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2021-11-26 17:54:43 +01:00
Thilo Fromm
9fba5789f9 ci-automation: simplified CI automation unsing containers
ci-automation builds on the SDK container and simplifies CI automation
build tasks (SDK bootstrap, SDK container, packages, image, VMs).

See ci-automation/README.md for a brief introduction.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Thilo Fromm
b567344234 sdk-container: add scripts for containerised SDK
This change introduces a containerised SDK as a replacement for cork SDK
operations. It also simplifies versioning by removing the need for
manifest repos as well as usage of the "repo" tool by use of git
submodules for coreos-overlay and portage-stable.

The following feature scripts are added:
- run_sdk_container: Run a command in an SDK container, using the
        current scripts repo + ebuild submodules.
        current scripts repo + ebuild submodules.
- bootstrap_sdk_container / build_sdk_container_image: Bootstrap a new
        SDK and create an SDK container from the resulting SDK tarball.

The following additions have been made to SDK scripts:
- setup_board: add --pkgdir parameter to use a custom binary packge
  directory.

Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-11-26 17:54:43 +01:00
Dongsu Park
7a0c0028b5
Merge pull request #183 from flatcar-linux/dongsu/em-arm-parallel-tests
jenkins: override PARALLEL_TESTS for ARM servers in da11
2021-11-26 15:49:51 +01:00
Dongsu Park
16efbc99c0 changelog: use date format of YYYY-MM-DD
If we use date format of DD-MM-YYYY in changelog file names, the files
will not sorted by date. e.g. 01-12-2021 will come before 25-11-2021.
Use date format of YYYY-MM-DD to make the files sorted by date.
2021-11-26 15:29:11 +01:00
Dongsu Park
5c391e9008 jenkins: override PARALLEL_TESTS for ARM servers in da11
We override `PARALLEL_TESTS`, because kola run with PARALLEL_TESTS >= 4
causes the tests to provision >= 12 ARM servers at the same time. As the
da11 region does not have that many free ARM servers, the whole tests
will fail. With PARALLEL_TESTS=2 the total number of servers stays < 10.
In addition, we override `timeout` to 10 hours, because it takes more
than 8 hours to run all tests only with 2 tests in parallel.
2021-11-25 16:55:10 +01:00
Sayan Chowdhury
38b1b51b46
Merge pull request #180 from flatcar-linux/sayan/mandate-changelog-entry
changelog: Add placeholder directory to add the changelogs
2021-11-24 22:53:26 +05:30
Sayan Chowdhury
663fee4c68
changelog: Add placeholder directory to add the changelogs
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-11-24 22:50:02 +05:30
Vincent Batts
5c21980ff3
Merge pull request #182 from flatcar-linux/tormath1/cpe
build_library/set_release: add CPE_NAME - v2.3
2021-11-24 09:51:44 -05:00
Mathieu Tortuyaux
dc0f93015b
build_library/set_release: add CPE_NAME - v2.3
Flatcar is in the NIST CPE dictionary. Let's programmatically build the
`CPE_NAME` in the build process in order to be scanned.

`CPE_NAME` is part of `/etc/os-release` with the following manual entry:

```
CPE_NAME=
  A CPE name for the operating system, in URI binding syntax, following the Common Platform Enumeration Specification[2] as proposed by the NIST.
  This field is optional. Example: "CPE_NAME="cpe:/o:fedoraproject:fedora:17""
...
[^2]: Common Platform Enumeration Specification
           http://scap.nist.gov/specifications/cpe/
```

Which indicates that the current version of CPE is 2.3.

Closes: https://github.com/flatcar-linux/Flatcar/issues/536

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-11-23 18:22:16 +01:00
Mathieu Tortuyaux
e86eadcdeb
Merge pull request #181 from flatcar-linux/tormath1/arm-em-server
kola/packet: override EM region for ARM64 server
2021-11-22 19:59:30 +01:00
Mathieu Tortuyaux
c746ab2333
kola/packet: override EM region for ARM64 server
Equinix Metal ARM server are not yet hourly available in the default `sv15` region
so we override the `PACKET_REGION` to `Dallas` since it's available in this region.
We do not override `PACKET_REGION` for both board on top level because we need to keep proximity
for PXE booting.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-11-22 19:43:27 +01:00
Kai Lüke
e5d3c03b00
Merge pull request #171 from flatcar-linux/kai/bucket-packages
set_version: Document the bucket cache for packages
2021-10-28 18:07:19 +02:00
Kai Lueke
af8daf7dc8 set_version: Document the bucket cache for packages
Dev builds need to use the bucket cache instead of the release
binary package mirror.
Document how the user can select the bucket cache.
2021-10-28 17:45:48 +02:00
Jeremi Piotrowski
50ed7f3007
Merge pull request #178 from flatcar-linux/jepio/update-chroot-setuponly
update_chroot: introduce '--setuponly' flag
2021-10-26 13:53:41 +02:00
Jeremi Piotrowski
385f5779b7
Merge pull request #177 from flatcar-linux/jepio/github-status
jenkins: publish github status 'pending' at beginning of manifest job
2021-10-25 16:46:55 +02:00
Jeremi Piotrowski
2213e9beea update_chroot: introduce '--setuponly' flag
Currently the os/sdk and os/toolchains job perform a chroot update whose
results are immediately discarded because the rest of the build uses a fresh
chroot and catalyst. Towards the end of a release period this can extend the
build time by about an hour (longer if rust is involved).

Introduce a `--setuponly` flag that bails after the chroot configuration, and
the skips chroot update.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2021-10-25 14:14:26 +02:00
Jeremi Piotrowski
abf849ce57 jenkins: publish github status 'pending' at beginning of manifest job
and add script used for that purpose. This requires access to a github PAT
with 'repo.status' permissions.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2021-10-25 13:44:15 +02:00
Sayan Chowdhury
9b5918f70f
Merge pull request #176 from flatcar-linux/sayan/remove-c3-small-packet
jenkins/kola/packet: Remove c3.small.x86 to try running cl.internet
2021-10-22 21:25:08 +05:30
Sayan Chowdhury
2fe1e979c0
jenkins/kola/packet: Remove c3.small.x86 to try running cl.internet
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-22 21:21:39 +05:30
Kai Lüke
bf4e013ac7
Merge pull request #175 from flatcar-linux/kai/aws-arm
jenkins/kola/aws.sh: use larger arm64 instance type for kubeadm
2021-10-21 14:11:19 +02:00
Kai Lueke
0bd6d1aae5 jenkins/kola/aws.sh: use larger arm64 instance type for kubeadm
Currently the kubeadm tests fail on arm64 because the instance type
only offers 1 vCPU:
cluster.go:117: error execution phase preflight: [preflight] Some fatal errors occurred:
cluster.go:117: [ERROR NumCPU]: the number of available CPUs 1 is less than the required 2

Switch to the next larger instance type which has 2 vCPUS.
2021-10-21 14:03:39 +02:00
Sayan Chowdhury
f426fe1996
Merge pull request #174 from flatcar-linux/sayan/update-packet-base-url
packet: Update the base URL to point to bucket.release.f-ln
2021-10-21 17:25:59 +05:30
Sayan Chowdhury
0028f95a26
packet: Update the base URL to point to bucket.release.f-ln
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-21 14:01:09 +05:30
Sayan Chowdhury
d8762c831f
Merge pull request #173 from flatcar-linux/sayan/update-do-base-url
do: Update the base URL to point to bucket.release.f-ln
2021-10-21 12:15:43 +05:30
Sayan Chowdhury
e04af554fa
do: Update the base URL to point to bucket.release.f-ln
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-21 12:03:54 +05:30
Mathieu Tortuyaux
2a44ca59f3
Merge pull request #172 from flatcar-linux/tormath1/fix-qemu-common-arm
jenkins/kola: fix qemu test execution
2021-10-19 12:08:40 +02:00
Mathieu Tortuyaux
5c304ffac9
jenkins/kola/qemu: run update_chroot only for amd
if the test is ran for ARM64, there is no need to run `update_chroot`
since there is no SDK.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-19 11:29:56 +02:00
Kai Lüke
df63e60b94
Merge pull request #170 from flatcar-linux/kai/use-supplied-sdk-path
jenkins: use the SDK_URL_PATH path for DOWNLOAD_ROOT_SDK
2021-10-15 16:06:24 +02:00
Kai Lueke
a668d961a9 jenkins: use the SDK_URL_PATH path for DOWNLOAD_ROOT_SDK
The SDK can either be a release SDK or a dev build SDK which are stored
in different paths. DOWNLOAD_ROOT_SDK should be based on the
SDK_URL_PATH value which indicates whether it's a release or dev build
path.
2021-10-15 14:35:08 +02:00
Mathieu Tortuyaux
97de2c4301
Merge pull request #169 from flatcar-linux/tormath1/fix-sdk-download
jenkins/sdk: download SDK Digest to prevent twice downloading
2021-10-14 17:40:45 +02:00
Mathieu Tortuyaux
46a03d3940
jenkins/sdk: download SDK Digest to prevent twice downloading
bootstrap_sdk runs catalyst.sh which will try to download the SDK if the
verify digest fails.
Importing the DIGEST allows to skip this step and to continue with the
previously downloaded SDK.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-14 17:39:59 +02:00