Commit Graph

4131 Commits

Author SHA1 Message Date
David Michael
1fea648d36 build_torcx_store: Update the default Docker to 17.09 2017-09-28 19:48:35 -07:00
Euan Kemp
d6eebf74cd Merge pull request #757 from euank/oracle-oci
jenkins/formats-amd64: add oracle_oci_qcow
2017-09-25 14:13:41 -07:00
Euan Kemp
ff26531e3a jenkins/formats-amd64: add oracle_oci_qcow 2017-09-25 14:13:21 -07:00
David Michael
5e6604c85b Merge pull request #754 from dm0-/rust
check_root: Ignore missing Rust libraries
2017-09-22 16:51:55 -07:00
Benjamin Gilbert
e95e77b346 Merge pull request #755 from bgilbert/docker-flag
vm_image_util: bump PXE and ISO scripts to 2 GiB RAM
2017-09-22 16:10:48 -07:00
Benjamin Gilbert
fcbc7c3219 vm_image_util: bump PXE and ISO scripts to 2 GiB RAM
Now that we're shipping multiple docker packages in the image, 1 GiB
is not enough to boot successfully.
2017-09-22 15:52:19 -07:00
Benjamin Gilbert
9b78a27d0a Merge pull request #753 from bgilbert/docker
build_torcx_store: add docker 1.12 to the image
2017-09-21 17:16:41 -07:00
David Michael
abc99cc29e check_root: Ignore missing Rust libraries 2017-09-21 14:37:09 -07:00
Benjamin Gilbert
8e731b8763 build_torcx_store: add docker 1.12 to the image 2017-09-20 21:16:38 -07:00
David Michael
9c8099a0d3 Merge pull request #749 from dm0-/torcx
build_library: Filter out null paths in torcx manifests
2017-09-15 12:18:39 -07:00
David Michael
1742e8ce18 build_library: Filter out null paths in torcx manifests
This avoids odd "null" lines appearing in torcx image names.
2017-09-15 12:17:52 -07:00
David Michael
383c2f4479 Merge pull request #743 from dm0-/torcx
build_library: Add torcx source packages to the package list
2017-09-15 12:11:25 -07:00
Benjamin Gilbert
4b26f47d91 Merge pull request #746 from bgilbert/release
offline_signing: Mechanize more roller interactions
2017-09-14 17:31:35 -07:00
Benjamin Gilbert
20eaa8a371 offline_signing: download artifacts in parallel 2017-09-14 16:57:50 -07:00
Benjamin Gilbert
716b081cdf offline_signing: add command to start rolling an update
Reduce the group update rate to 3/minute on amd64-usr only, then update
the channel version.
2017-09-14 16:57:50 -07:00
Benjamin Gilbert
b372c56d6d offline_signing: make appid array global 2017-09-14 16:57:48 -07:00
Benjamin Gilbert
733a206a95 offline_signing: update version in canary channel after upload
if a canary channel is specified.
2017-09-14 16:57:15 -07:00
David Michael
8fde256e45 build_library: Add torcx source packages to the package list
This includes the source package of all torcx packages that are
installed on disk, including cases where multiple versions of the
same package are available.
2017-09-11 15:32:11 -07:00
Euan Kemp
83a16990d1 Merge pull request #737 from euank/torcx-cas
rework torcx uploading to include a manifest
2017-09-08 17:09:54 -07:00
Euan Kemp
677b5ae116 build_torcx_store: back-out reproducible digests
Per the comment there, they were implemented in a broken fashion.

This leaves the door open for using them in the future, but in the
meanwhile simply uses the sha512sum as the digest (which solves the
immediate issue).
2017-09-08 16:59:54 -07:00
Euan Kemp
ee54181503 build_torcx_store: upload manifests to upload_root
Rather than to a location special to them.
The comment in the code explains the reasoning for this.
2017-09-08 16:59:54 -07:00
Euan Kemp
f496072a10 jenkins/images: use torcx packages from manifest
This accompanies the other changes around moving to a torcx manifest.
2017-09-08 16:59:54 -07:00
Euan Kemp
cc23e8e49e jenkins/packages: configure download root
Pending jenkins also including this variable.
2017-09-08 16:59:54 -07:00
Euan Kemp
1989ff96d8 build_torcx_store: upload to 'pkgs'
This is consistent with the local directory hierarchy
2017-09-08 16:59:51 -07:00
Euan Kemp
d3867403ed build_image: populate torcx store from manifest
This moves the default symlinking logic into build image as well.

This assumes that a torcx store is available locally with all images
referenced in the torcx manifest.

This is accomplished with a highly-indented double-for-loop, but I think
it's still decently readable.
2017-09-08 16:58:51 -07:00
Euan Kemp
31d7b40af3 build_library: add more torcx_manifest helpers
These are useful for the build_image_util code soon to come.
2017-09-08 16:58:51 -07:00
Euan Kemp
c196be8798 build_torcx_store: add package 'url' location
This also moves the 'torcx' prefixing logic over to the torcx upload
root introduced in the release util library.

It also corrects a bug in how the source package was being determined.
2017-09-08 16:58:38 -07:00
Euan Kemp
8f712b2af1 build_library: add torcx upload/download roots
Torcx is special in that it wishes to be uploaded under a prefixed
directory (torcx), typically wishes to be downloaded from there, but
ultimately wants to be downloaded from a location without that prefix.

In fact, I expect during a normal release process, it will be uploaded
with that prefix to the build bucket, copied without that prefix to the
final bucket (during pre-release), and then finally downloaded without
the prefix.

I think this set of variables ends up being the cleanest way to
represent this complexity.
2017-09-08 16:42:47 -07:00
Euan Kemp
fcef524c3a build_torcx_store: generate a torcx_manifest
This modifies the `build_torcx_store` script to produce a manifest and
cas-like structure of packages referenced by that manifest.

It also removes the symlink creation logic (which will be re-added in
build_image in coming commits).

The concept of "extra packages", which are referenced in the manifest,
but aren't installed in the rootfs, is also introduced.

Since the logic of what to include in the rootfs is also extracted into
build_image, supporting these "extra packages" isn't very complicated
for this file.
2017-09-08 16:42:47 -07:00
Benjamin Gilbert
2098a0780d Merge pull request #739 from bgilbert/oracle
build_library: rename oracle_oci image to oracle_oci_qcow
2017-09-07 14:57:22 -07:00
Benjamin Gilbert
6f7abe198a Merge pull request #738 from bgilbert/gc
bin: drop some obviously unused scripts
2017-09-07 14:57:05 -07:00
Euan Kemp
0604b5c40a build_library: add torcx_manifest helper
This implements some basic functionality around working with torcx
manifests.
2017-09-07 12:21:36 -07:00
Euan Kemp
37f3657539 Merge pull request #740 from euank/ccache-mask
update_chroot: set a more permissive ccache umask
2017-09-07 12:19:30 -07:00
Euan Kemp
62bff69a19 update_chroot: set a more permissive ccache umask
This seems to fix the ccache permission issues `update_chroot` hits
while building ninja.

The erroneous files were created as root:portage, so a umask of 002
should let other portage group members share them, which seems entirely
reasonable.
2017-09-07 11:56:51 -07:00
Benjamin Gilbert
2024326789 build_library: rename oracle_oci image to oracle_oci_qcow
Reserve the unsuffixed name for a raw image, in case we ever want to
support installing to disk using "coreos-install -o" on a PXE-booted
system.
2017-09-06 17:46:07 -07:00
Benjamin Gilbert
2de95be0ef bin: drop some obviously unused scripts 2017-09-06 15:33:42 -07:00
Benjamin Gilbert
97ab652443 Merge pull request #735 from bgilbert/signing
offline_signing: Allow download/upload for multiple releases with a single invocation
2017-09-06 12:38:19 -07:00
Benjamin Gilbert
9c93dcb272 offline_signing: add subcommand to upload to roller 2017-09-05 17:34:33 -07:00
Benjamin Gilbert
3ed15a8762 offline_signing: automatically fix ownership of output dir 2017-09-05 16:38:16 -07:00
Benjamin Gilbert
b3cb2e0608 offline_signing: download multiple versions and boards per invocation 2017-09-05 16:35:34 -07:00
Benjamin Gilbert
0a74a57c40 offline_signing: verify downloads with gpg2 2017-09-05 15:32:05 -07:00
Benjamin Gilbert
b48afe581e Merge pull request #734 from bgilbert/oracle
Add Oracle OCI image format
2017-08-30 18:57:11 -07:00
Benjamin Gilbert
95b2c96ce2 oem/oracle: Set SSH keys when launching instance 2017-08-30 16:20:55 -07:00
Benjamin Gilbert
51c5345c0d build_library: Add Oracle OCI OEM and format 2017-08-30 03:10:33 -07:00
Benjamin Gilbert
4a0e9cfb2f oem/oracle: Launch a small VM instance by default
This is faster and cheaper than launching a bare-metal instance, which
is no longer necessary now that networkd works in OCI VMs.
2017-08-30 03:07:41 -07:00
David Michael
8f85212687 Merge pull request #732 from dm0-/docker
build_torcx_store: Bump the Docker image to 17.06
2017-08-24 14:41:55 -07:00
David Michael
219d7558b1 build_torcx_store: Bump the Docker image to 17.06 2017-08-22 16:40:25 -07:00
Andrew Jeddeloh
8b0106a6f3 Merge pull request #731 from ajeddeloh/quiet-torcx
build_torcx_store: emerge quietly
2017-08-18 16:19:59 -07:00
Andrew Jeddeloh
860f878634 build_torcx_store: emerge quietly
Add --quiet so build_torcx_store doesn't flood the terminal.
2017-08-16 15:36:05 -07:00
David Michael
6dd9a75d63 Merge pull request #725 from dm0-/perl
Revert "update_chroot: fix SDK updates during the Perl 5.24 upgrade"
2017-08-14 14:46:58 -07:00