Commit Graph

4592 Commits

Author SHA1 Message Date
David Michael
e0f6100de8 build_library: Whitelist the Go 1.9 GLSA
We handle Go differently than Gentoo, so our 1.8.4 package includes
the same security fixes.  When all packages are built with Go 1.9,
the older Go packages shouldn't be installed anymore, so this line
can be dropped.
2017-10-23 14:35:52 -07:00
Euan Kemp
dcbc6a8686 dev_image_util: hardcode correct portage binhost
We already hardcode similar urls a bit below (the sync-uri).

Not hardcoding the binhost results in an incorrect value during
embargoed build uploads.
2017-10-23 14:14:58 -07:00
Andrew Jeddeloh
767072aa09 Merge pull request #765 from ajeddeloh/rm-serve
serve.go: remove serve.go
2017-10-20 14:38:45 -07:00
Andrew Jeddeloh
1c83274945 serve.go: remove serve.go
No one noticed this was here. It is not used. python -m SimpleHTTPServer
does the same thing.
2017-10-20 14:19:36 -07:00
Benjamin Gilbert
e210eaa853 Merge pull request #764 from coreos/binutils
Revert binutils to 2.25 again
2017-10-19 19:29:16 -07:00
David Michael
20975049b3 Revert "update_chroot: Avoid a portage crash while upgrading binutils"
The binutils update prevents Linux from uncompressing during boot,
so this is being put off until it's fixed.

This reverts commit 5e659964d0.
2017-10-19 08:43:41 -07:00
David Michael
059a21701b build_library: Whitelist the binutils GLSA 2017-10-19 08:42:57 -07:00
David Michael
f7faf7a8a3 Merge pull request #752 from dm0-/glsa
update_chroot: Avoid a portage crash while upgrading binutils
2017-10-16 23:27:07 -07:00
David Michael
87c9cc8ec5 Merge pull request #759 from dm0-/docker
Update Docker torcx images
2017-10-02 14:50:53 -07:00
David Michael
5e659964d0 update_chroot: Avoid a portage crash while upgrading binutils
This omits the toolchain packages' version-pinning flag for the
binutils package while it is being upgraded.  It also removes older
versions installed in parallel that cause unwanted rebuilds.

When stable has the upgraded version, this can be reverted.
2017-09-29 14:10:58 -07:00
David Michael
e6acb6e0c7 build_torcx_store: Build a non-local Docker 17.03 image 2017-09-28 19:49:26 -07:00
David Michael
1fea648d36 build_torcx_store: Update the default Docker to 17.09 2017-09-28 19:48:35 -07:00
Euan Kemp
d6eebf74cd Merge pull request #757 from euank/oracle-oci
jenkins/formats-amd64: add oracle_oci_qcow
2017-09-25 14:13:41 -07:00
Euan Kemp
ff26531e3a jenkins/formats-amd64: add oracle_oci_qcow 2017-09-25 14:13:21 -07:00
David Michael
5e6604c85b Merge pull request #754 from dm0-/rust
check_root: Ignore missing Rust libraries
2017-09-22 16:51:55 -07:00
Benjamin Gilbert
e95e77b346 Merge pull request #755 from bgilbert/docker-flag
vm_image_util: bump PXE and ISO scripts to 2 GiB RAM
2017-09-22 16:10:48 -07:00
Benjamin Gilbert
fcbc7c3219 vm_image_util: bump PXE and ISO scripts to 2 GiB RAM
Now that we're shipping multiple docker packages in the image, 1 GiB
is not enough to boot successfully.
2017-09-22 15:52:19 -07:00
Benjamin Gilbert
9b78a27d0a Merge pull request #753 from bgilbert/docker
build_torcx_store: add docker 1.12 to the image
2017-09-21 17:16:41 -07:00
David Michael
abc99cc29e check_root: Ignore missing Rust libraries 2017-09-21 14:37:09 -07:00
Benjamin Gilbert
8e731b8763 build_torcx_store: add docker 1.12 to the image 2017-09-20 21:16:38 -07:00
David Michael
9c8099a0d3 Merge pull request #749 from dm0-/torcx
build_library: Filter out null paths in torcx manifests
2017-09-15 12:18:39 -07:00
David Michael
1742e8ce18 build_library: Filter out null paths in torcx manifests
This avoids odd "null" lines appearing in torcx image names.
2017-09-15 12:17:52 -07:00
David Michael
383c2f4479 Merge pull request #743 from dm0-/torcx
build_library: Add torcx source packages to the package list
2017-09-15 12:11:25 -07:00
Benjamin Gilbert
4b26f47d91 Merge pull request #746 from bgilbert/release
offline_signing: Mechanize more roller interactions
2017-09-14 17:31:35 -07:00
Benjamin Gilbert
20eaa8a371 offline_signing: download artifacts in parallel 2017-09-14 16:57:50 -07:00
Benjamin Gilbert
716b081cdf offline_signing: add command to start rolling an update
Reduce the group update rate to 3/minute on amd64-usr only, then update
the channel version.
2017-09-14 16:57:50 -07:00
Benjamin Gilbert
b372c56d6d offline_signing: make appid array global 2017-09-14 16:57:48 -07:00
Benjamin Gilbert
733a206a95 offline_signing: update version in canary channel after upload
if a canary channel is specified.
2017-09-14 16:57:15 -07:00
David Michael
8fde256e45 build_library: Add torcx source packages to the package list
This includes the source package of all torcx packages that are
installed on disk, including cases where multiple versions of the
same package are available.
2017-09-11 15:32:11 -07:00
Euan Kemp
83a16990d1 Merge pull request #737 from euank/torcx-cas
rework torcx uploading to include a manifest
2017-09-08 17:09:54 -07:00
Euan Kemp
677b5ae116 build_torcx_store: back-out reproducible digests
Per the comment there, they were implemented in a broken fashion.

This leaves the door open for using them in the future, but in the
meanwhile simply uses the sha512sum as the digest (which solves the
immediate issue).
2017-09-08 16:59:54 -07:00
Euan Kemp
ee54181503 build_torcx_store: upload manifests to upload_root
Rather than to a location special to them.
The comment in the code explains the reasoning for this.
2017-09-08 16:59:54 -07:00
Euan Kemp
f496072a10 jenkins/images: use torcx packages from manifest
This accompanies the other changes around moving to a torcx manifest.
2017-09-08 16:59:54 -07:00
Euan Kemp
cc23e8e49e jenkins/packages: configure download root
Pending jenkins also including this variable.
2017-09-08 16:59:54 -07:00
Euan Kemp
1989ff96d8 build_torcx_store: upload to 'pkgs'
This is consistent with the local directory hierarchy
2017-09-08 16:59:51 -07:00
Euan Kemp
d3867403ed build_image: populate torcx store from manifest
This moves the default symlinking logic into build image as well.

This assumes that a torcx store is available locally with all images
referenced in the torcx manifest.

This is accomplished with a highly-indented double-for-loop, but I think
it's still decently readable.
2017-09-08 16:58:51 -07:00
Euan Kemp
31d7b40af3 build_library: add more torcx_manifest helpers
These are useful for the build_image_util code soon to come.
2017-09-08 16:58:51 -07:00
Euan Kemp
c196be8798 build_torcx_store: add package 'url' location
This also moves the 'torcx' prefixing logic over to the torcx upload
root introduced in the release util library.

It also corrects a bug in how the source package was being determined.
2017-09-08 16:58:38 -07:00
Euan Kemp
8f712b2af1 build_library: add torcx upload/download roots
Torcx is special in that it wishes to be uploaded under a prefixed
directory (torcx), typically wishes to be downloaded from there, but
ultimately wants to be downloaded from a location without that prefix.

In fact, I expect during a normal release process, it will be uploaded
with that prefix to the build bucket, copied without that prefix to the
final bucket (during pre-release), and then finally downloaded without
the prefix.

I think this set of variables ends up being the cleanest way to
represent this complexity.
2017-09-08 16:42:47 -07:00
Euan Kemp
fcef524c3a build_torcx_store: generate a torcx_manifest
This modifies the `build_torcx_store` script to produce a manifest and
cas-like structure of packages referenced by that manifest.

It also removes the symlink creation logic (which will be re-added in
build_image in coming commits).

The concept of "extra packages", which are referenced in the manifest,
but aren't installed in the rootfs, is also introduced.

Since the logic of what to include in the rootfs is also extracted into
build_image, supporting these "extra packages" isn't very complicated
for this file.
2017-09-08 16:42:47 -07:00
Benjamin Gilbert
2098a0780d Merge pull request #739 from bgilbert/oracle
build_library: rename oracle_oci image to oracle_oci_qcow
2017-09-07 14:57:22 -07:00
Benjamin Gilbert
6f7abe198a Merge pull request #738 from bgilbert/gc
bin: drop some obviously unused scripts
2017-09-07 14:57:05 -07:00
Euan Kemp
0604b5c40a build_library: add torcx_manifest helper
This implements some basic functionality around working with torcx
manifests.
2017-09-07 12:21:36 -07:00
Euan Kemp
37f3657539 Merge pull request #740 from euank/ccache-mask
update_chroot: set a more permissive ccache umask
2017-09-07 12:19:30 -07:00
Euan Kemp
62bff69a19 update_chroot: set a more permissive ccache umask
This seems to fix the ccache permission issues `update_chroot` hits
while building ninja.

The erroneous files were created as root:portage, so a umask of 002
should let other portage group members share them, which seems entirely
reasonable.
2017-09-07 11:56:51 -07:00
Benjamin Gilbert
2024326789 build_library: rename oracle_oci image to oracle_oci_qcow
Reserve the unsuffixed name for a raw image, in case we ever want to
support installing to disk using "coreos-install -o" on a PXE-booted
system.
2017-09-06 17:46:07 -07:00
Benjamin Gilbert
2de95be0ef bin: drop some obviously unused scripts 2017-09-06 15:33:42 -07:00
Benjamin Gilbert
97ab652443 Merge pull request #735 from bgilbert/signing
offline_signing: Allow download/upload for multiple releases with a single invocation
2017-09-06 12:38:19 -07:00
Benjamin Gilbert
9c93dcb272 offline_signing: add subcommand to upload to roller 2017-09-05 17:34:33 -07:00
Benjamin Gilbert
3ed15a8762 offline_signing: automatically fix ownership of output dir 2017-09-05 16:38:16 -07:00