Commit Graph

4524 Commits

Author SHA1 Message Date
Sayan Chowdhury
2fe1e979c0
jenkins/kola/packet: Remove c3.small.x86 to try running cl.internet
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-22 21:21:39 +05:30
Kai Lüke
bf4e013ac7
Merge pull request #175 from flatcar-linux/kai/aws-arm
jenkins/kola/aws.sh: use larger arm64 instance type for kubeadm
2021-10-21 14:11:19 +02:00
Kai Lueke
0bd6d1aae5 jenkins/kola/aws.sh: use larger arm64 instance type for kubeadm
Currently the kubeadm tests fail on arm64 because the instance type
only offers 1 vCPU:
cluster.go:117: error execution phase preflight: [preflight] Some fatal errors occurred:
cluster.go:117: [ERROR NumCPU]: the number of available CPUs 1 is less than the required 2

Switch to the next larger instance type which has 2 vCPUS.
2021-10-21 14:03:39 +02:00
Sayan Chowdhury
f426fe1996
Merge pull request #174 from flatcar-linux/sayan/update-packet-base-url
packet: Update the base URL to point to bucket.release.f-ln
2021-10-21 17:25:59 +05:30
Sayan Chowdhury
0028f95a26
packet: Update the base URL to point to bucket.release.f-ln
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-21 14:01:09 +05:30
Sayan Chowdhury
d8762c831f
Merge pull request #173 from flatcar-linux/sayan/update-do-base-url
do: Update the base URL to point to bucket.release.f-ln
2021-10-21 12:15:43 +05:30
Sayan Chowdhury
e04af554fa
do: Update the base URL to point to bucket.release.f-ln
Signed-off-by: Sayan Chowdhury <schowdhury@microsoft.com>
2021-10-21 12:03:54 +05:30
Mathieu Tortuyaux
2a44ca59f3
Merge pull request #172 from flatcar-linux/tormath1/fix-qemu-common-arm
jenkins/kola: fix qemu test execution
2021-10-19 12:08:40 +02:00
Mathieu Tortuyaux
5c304ffac9
jenkins/kola/qemu: run update_chroot only for amd
if the test is ran for ARM64, there is no need to run `update_chroot`
since there is no SDK.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-19 11:29:56 +02:00
Kai Lüke
df63e60b94
Merge pull request #170 from flatcar-linux/kai/use-supplied-sdk-path
jenkins: use the SDK_URL_PATH path for DOWNLOAD_ROOT_SDK
2021-10-15 16:06:24 +02:00
Kai Lueke
a668d961a9 jenkins: use the SDK_URL_PATH path for DOWNLOAD_ROOT_SDK
The SDK can either be a release SDK or a dev build SDK which are stored
in different paths. DOWNLOAD_ROOT_SDK should be based on the
SDK_URL_PATH value which indicates whether it's a release or dev build
path.
2021-10-15 14:35:08 +02:00
Mathieu Tortuyaux
97de2c4301
Merge pull request #169 from flatcar-linux/tormath1/fix-sdk-download
jenkins/sdk: download SDK Digest to prevent twice downloading
2021-10-14 17:40:45 +02:00
Mathieu Tortuyaux
46a03d3940
jenkins/sdk: download SDK Digest to prevent twice downloading
bootstrap_sdk runs catalyst.sh which will try to download the SDK if the
verify digest fails.
Importing the DIGEST allows to skip this step and to continue with the
previously downloaded SDK.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-14 17:39:59 +02:00
Jeremi Piotrowski
aae8bdf74b
Merge pull request #167 from flatcar-linux/jepio/simplify-pr-builds
jenkins/manifest: support PR numbers in PORTAGE_REF/OVERLAY_REF variables
2021-10-14 17:36:14 +02:00
Jeremi Piotrowski
824199efea jenkins/manifest: accept PR numbers in PORTAGE_REF/OVERLAY_REF
When PORTAGE_REF or OVERLAY_REF are numbers, we can change the way the refspec
is constructed to allow fetching a PR instead instead of a branch. Checking for
equality using '[' works to detect numbers, bash's '[[' doesn't.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2021-10-14 11:16:11 +02:00
Mathieu Tortuyaux
d8b36d5415
Merge pull request #168 from flatcar-linux/tormath1/fix-verify
jenkins/toolchain: do not use the mantle embedded key to verify
2021-10-13 18:42:23 +02:00
Mathieu Tortuyaux
dcfe4cfa09
jenkins/toolchain: do not use the mantle embedded key to verify
Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-13 18:23:54 +02:00
Mathieu Tortuyaux
af647340c6
Merge pull request #166 from flatcar-linux/tormath1/fix-dev-container
jenkins/kola/container: pass PORTAGE_BINHOST to container
2021-10-13 13:42:13 +02:00
Mathieu Tortuyaux
4e1e707628
jenkins/kola/container: pass PORTAGE_BINHOST to container
Otherwise, it was failing since we check for unbound variable:
```
/bin/bash: line 1: PORTAGE_BINHOST: unbound variable
```

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-13 10:57:35 +02:00
Dongsu Park
62707ca204
Merge pull request #157 from flatcar-linux/krnowak/break-new-util-linux-cycle
build_packages: Add another cycle to break
2021-10-13 08:15:10 +02:00
Mathieu Tortuyaux
b88177f1b0
Merge pull request #165 from flatcar-linux/tormath1/fix-sdk
jenkins/sdk: add default `DOWNLOAD_ROOT`
2021-10-12 19:00:42 +02:00
Mathieu Tortuyaux
982a26c835
jenkins/sdk: add default DOWNLOAD_ROOT
Otherwise, the variable is empty and it creates errors later. Default
value is `gs://flatcar-jenkins`. Not `GS_DEVEL_ROOT` because if we check
the previous behavior, `DOWNLOAD_ROOT` was hardcoded with:
```shell
DOWNLOAD_ROOT_SDK=https://storage.googleapis.com/flatcar-jenkins/sdk
```

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-12 17:17:01 +02:00
Mathieu Tortuyaux
b0dd9324fc
Merge pull request #164 from flatcar-linux/tormath1/fix-dev-container
jenkins/kola/container: fix verify-key sharing in systemd container
2021-10-12 16:38:31 +02:00
Mathieu Tortuyaux
47f5feff68
jenkins/kola/container: fix verify-key sharing in systemd container
`$verify_key` actually holds `--verify-key=verify.asc` so of course
`systemd-nspawn` fails since it does not expect `--verify-key` value.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-12 16:27:29 +02:00
Krzesimir Nowak
8e8cedcbf7 build_packages: Add another cycle to break
With the update of the sys-apps/util-linux package, another cycle has
reared its ugly head. Looks like the package got an optional
dependency on sys-fs/cryptsetup, so break it.
2021-10-12 14:39:07 +02:00
Jeremi Piotrowski
24128594e0
Merge pull request #163 from flatcar-linux/tormath1-jepio/ci-authenticated
jenkins: use private bucket with authentication for fetching binaries.
2021-10-12 13:33:22 +02:00
Jeremi Piotrowski
d9542cec7d jenkins/toolchains: fetch DIGESTS file to allow reusing downloaded SDK as seed
The catalyst build uses the same SDK version as seed as the current SDK, but
will only reuse the cached tarball if a DIGESTS file exists and is correct.
Prefetch this file to prevent the build from trying to access google storage
anonymously.

Signed-off-by: Jeremi Piotrowski <jpiotrowski@microsoft.com>
2021-10-12 13:32:10 +02:00
Mathieu Tortuyaux
46ac63fdee jenkins/vm: remove --sdk-url
`download-image` already holds the remote host with the --root flag.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-12 13:32:10 +02:00
Jeremi Piotrowski
cbf003e617 jenkins: use 'cork create' instead of 'cork update'
because we need to pass google credentials to update_chroot, and 'cork update'
doesn't support that.

Add --sdk-url-path to sdk.sh for new cork default.
2021-10-12 13:32:07 +02:00
Jeremi Piotrowski
93cf5aa5c3 jenkins: use gs:// uri for DOWNLOAD_ROOT_SDK so that we can apply authentication 2021-10-12 13:31:39 +02:00
Mathieu Tortuyaux
dcccdb8815
Merge pull request #162 from flatcar-linux/tormath1/container-private
kola/dev-container: override binhost to use private GCS
2021-10-11 14:47:40 +02:00
Mathieu Tortuyaux
7ef55eb15d
kola/dev-container: override binhost to use private GCS
in this commit we make sure to use GCS bucket for dev container tests by
providing the required credentials and the associated fetch command.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-11 14:42:09 +02:00
Mathieu Tortuyaux
dc4e4a8701
Merge pull request #158 from flatcar-linux/tormath1/cork-private
jenkins: add `--json-key` and `--sdk-url` to `cork update` commands
2021-10-07 14:42:35 +02:00
Mathieu Tortuyaux
998d2f4fc6
jenkins: add --json-key to cork update commands
it pulls https://github.com/flatcar-linux/mantle/pull/239 to be able to
use `--json-key` in order to access private GCS bucket

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-07 14:41:16 +02:00
Thilo Fromm
7f80cb138b
Merge pull request #159 from flatcar-linux/t-lo/use-new-bincache-mirror
setup_board, update_chroot, dev container: use new bincache mirror
2021-10-07 11:57:30 +02:00
Thilo Fromm
6882ea2d7c
Merge pull request #161 from flatcar-linux/t-lo/add-rsync-upload
release_util.sh: add rsync:// upload
2021-10-07 11:55:50 +02:00
Thilo Fromm
cc469d2f47
build_library/release_util.sh: improve ssh opts for rsync
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2021-10-07 11:17:33 +02:00
Thilo Fromm
0aad4b9dd1
release_util.sh: script improvements
Co-authored-by: Krzesimir Nowak <knowak@microsoft.com>
2021-10-07 10:48:26 +02:00
Thilo Fromm
9c3ba12936 release_util.sh: add rsync:// upload 2021-10-07 09:27:49 +02:00
Mathieu Tortuyaux
3b923e7abc
Merge pull request #160 from flatcar-linux/tormath1/fix-sdk-version
jenkins/manifest: use gsutil to download SDK version
2021-10-06 17:33:30 +02:00
Mathieu Tortuyaux
d9bf2e89c5
jenkins/manifest: use gsutil to download SDK version
Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
2021-10-06 17:27:23 +02:00
Thilo Fromm
17924f9d07
set_version: safely iterate over argv
Co-authored-by: Kai Lüke <pothos@users.noreply.github.com>
2021-10-06 11:44:15 +02:00
Thilo Fromm
eaff2d47eb build_image: add binhost option for dev container
Signed-off-by: Thilo Fromm <thilo@kinvolk.io>
2021-10-05 16:38:43 +02:00
Thilo Fromm
51aac23dc8 setup_board, update_chroot, dev container: use new bincache mirror
This updates the default settings in build scripts to use
https://mirror.release.flatcar-linux.net/
instead of the google storage bucket if no binhost or FLATCAR_DEV_BUILDS
is specified.

Defaults are updated for
* update_chroot (runs at SDK initialisation time)
* setup_board (creates /boards/[ARCH]/) chroots
* the development container
* set_version
2021-10-05 15:03:00 +02:00
Sayan Chowdhury
ccdc52cc15
Merge pull request #155 from flatcar-linux/krnowak/trap-fixes
Fix the traps to align with bash 5.1 upgrade
2021-10-01 21:49:27 +05:30
Kai Lüke
0de747c971
Merge pull request #156 from flatcar-linux/kai/jenkins-cl-internet
jenkins/kola/packet.sh: fix check for skipping machine type tests
2021-09-30 11:53:29 +02:00
Kai Lueke
e24c456889 jenkins/kola/packet.sh: fix check for skipping machine type tests
The cl.basic and cl.internet tests are different tests which wasn't
clear before. Also, the grep process returns an exit code of 1 if it
didn't find a match, causing the job to cancel. The list of tests is
space separated and should not be quoted but on the other hand, we
do have to handle a literal *.
Look for the right test and handle the grep exit code, and disable
globs for the subshell for preserving a literal *.
2021-09-30 11:50:30 +02:00
Kai Lüke
3bbd7221c7
Merge pull request #153 from flatcar-linux/kai/test-more-hw
jenkins: run simple network test on different hardware
2021-09-29 13:55:27 +02:00
Krzesimir Nowak
8215daa1c5
Merge pull request #154 from flatcar-linux/krnowak/ignore-more-categories
build_library: Ignore more categories in write_licenses
2021-09-29 09:20:19 +02:00
Kai Lueke
6a04b54f0b jenkins: run simple network test on different hardware
The Linux 5.10 stable kernel introduced a regression that we didn't
catch because we only run kola on one hardware type in Equinix Metal.
Validate that a simple network test works on various instance types of
the current hardware generation.
2021-09-28 18:10:24 +02:00