Commit Graph

4258 Commits

Author SHA1 Message Date
Michael Marineau
2e9911b978 fix(*): Migrate image storage to new buckets
- Automated builds drop SDK and binary packages into
  gs://builds.developer.core-os.net/ and the new download URL is
  http://builds.developer.core-os.net/ (COREOS_DEV_BUILDS)
- Change default upload path to gs://users.developer.core-os.net/ for
  misc developer builds. Official builds go elsewhere and will just be
  configured in buildbot/jenkins so some COREOS_OFFICIAL stuff is gone.
- Automated builds of images go to a private bucket,
  gs://builds.release.core-os.net which later gets copied to
  gs://alpha.release.core-os.net and friends by core_promote.
2014-05-21 13:21:07 -07:00
Michael Marineau
7372f9f6e6 Merge pull request #254 from marineam/dev-config
Build-time dev cloud configs
2014-05-18 20:46:07 -07:00
Michael Marineau
af0f0f5c73 Merge pull request #253 from marineam/dev-container
nspawn compatible dev container
2014-05-18 20:45:49 -07:00
Michael Marineau
822644fc54 feat(build_image): Add support for injecting a cloud config
The new --developer_data option can be used to specify a path to a cloud
config to bundle into the image. If none is provided but a shared user
password (for core) is set then generate a config to set that password.
This lets us use the same mechanism for setting the default password for
both disk and PXE images.
2014-05-17 16:23:18 -07:00
Michael Marineau
a93cb921d8 refactor(build_library): Add a function for enabling systemd units. 2014-05-17 16:23:16 -07:00
Michael Marineau
b24df04465 feat(build_image): Add 'container' image type.
This image type is the same as the developer image except that it is a
single root filesystem and is bootable via systemd-nspawn. This may
become obsolete eventually when it becomes possible to boot the normal
disk images under nspawn but it is useful for testing until then.

The partition type is defined by the Discoverable Partitions Spec.
http://www.freedesktop.org/wiki/Specifications/DiscoverablePartitionsSpec/
2014-05-16 21:11:01 -07:00
Michael Marineau
54f774d931 fix(build_library): Skip modifying non-existent partitions.
To make it possible to plop a CoreOS install into a simple
single-filesystem image for use as a container some things like
configuring bootloaders need to be skipped.
2014-05-16 20:52:21 -07:00
Michael Marineau
ee6b9ee1f9 fix(disk_util): Set btrfs default subvolume
This avoids needing to always pass the subvol=root mount option.
2014-05-16 19:09:23 -07:00
Michael Marineau
acb9800259 fix(disk_util): Don't try to format blank partitions. 2014-05-16 17:40:35 -07:00
Michael Marineau
0d750e6a28 remove(build_container): Kill catalyst-based container script
Never actually used this, new plan is slightly different.
2014-05-16 17:14:11 -07:00
Michael Marineau
38fa0f92a8 Merge pull request #252 from marineam/clean
Clean out some old ChromeOS junk
2014-05-15 17:57:53 -07:00
Michael Marineau
da934cc439 remove(cruft): Kill a few more things that aren't used 2014-05-15 15:48:41 -07:00
Michael Marineau
11d783b95c remove(symbols): Kill off scripts for managing ChromeOS debug symbols 2014-05-15 15:48:05 -07:00
Michael Marineau
9dc6424da6 remove(tests): Remove old ChromeOS test utilities
None are useful or relevant to us.
2014-05-15 15:45:45 -07:00
Michael Marineau
2b2576c4ab remove(hooks): Kill off old hook that checked compile flags.
This did things like verify that things were linked with gold (which we
don't do) and other checks. We don't have a need for it kill it.
2014-05-15 15:42:02 -07:00
Michael Marineau
dc93012500 Merge pull request #248 from marineam/oem
fix(oem/ami): Remove key options, update wrapper for beta
2014-05-15 15:09:21 -07:00
Michael Marineau
c8addbb6cc Merge pull request #251 from marineam/refactor
Refactor sdk setup
2014-05-15 15:02:50 -07:00
Michael Marineau
68a8a67081 fix(update_chroot): Consolidate more portage configuration
To behave more like setup_board/build_packages update_chroot should
fully configure portage to make sure everything is accurate.

Now binhosts are defined in make.conf.host_setup so the static config in
coreos-overlays doesn't need to refer to version.txt. setup_board
already made this change in 7a43a07f.

Define path locations to reduce dependency between static configs in
coreos-overlays and the behavior of the scripts repo. Spreading
configuration across two repos makes everything harder to understand.
Eventually everything should either be defined in profiles in
coreos-overlays or minimal auto-generated config files here in scripts.
2014-05-14 19:15:30 -07:00
Michael Marineau
57d19d0f06 refactor(update_chroot): Write make.conf.host_setup
There is no need for this to be in sdk_lib any more, remove what little
remains of make_conf_util.sh.
2014-05-14 18:51:58 -07:00
Michael Marineau
a3d3d30b24 fix(sdk_lib): Delete a pile of dead/pointless code.
For the most part this doesn't influence anything. The one exception is
the custom configuration for using curl is dropped, just rely on the
portage defaults. It appears curl was only used to work around a wget
issue with Google's internal SSL certificates. We care not. :)
2014-05-14 18:51:58 -07:00
Michael Marineau
7d6619df8a fix(setup_board): Remove unused option to accept restrictive licenses 2014-05-13 17:42:00 -07:00
Michael Marineau
57992324ba Merge pull request #250 from marineam/refactor
Refactor image building
2014-05-13 17:38:52 -07:00
Michael Marineau
3f41a379c1 Merge pull request #247 from marineam/upload
fix(image_set_group): Add support for uploading images.
2014-05-13 12:17:37 -07:00
Michael Marineau
7fd530c09b Merge pull request #249 from marineam/beta
fix(vm_image_util): Set correct group in Vagrant metadata.
2014-05-13 10:58:15 -07:00
Michael Marineau
5417bd7ae3 fix(vm_image_util): Set correct group in Vagrant metadata. 2014-05-09 11:52:11 -07:00
Michael Marineau
17bde8aa12 refactor(build_image_util): Move prod specific code to prod_image_util 2014-05-09 11:18:20 -07:00
Michael Marineau
56b550dc21 cleanup(build_image_util): Delete unused code 2014-05-09 11:18:19 -07:00
Michael Marineau
1c5393b78e refactor(build_image_util): Merge with base_image_util
There isn't a base image now, and less file clutter is nice.
2014-05-09 11:16:48 -07:00
Michael Marineau
1836d5998d refactor(base_image_util): Split into two functions.
Use what was the base image build function as setup/finalize steps in
the dev and prod build functions. This eliminates duplicate code
that mounted and unmounted the filesystem images.
2014-05-09 11:13:54 -07:00
Michael Marineau
39086358bf refactor(build_image): Build dev and prod images independently
We need some more control over exactly what lands in dev vs prod images
which will require letting them diverge in what is currently the common
base image step. There isn't any real need for the base image in the
first place other than to speed up building both dev and prod images at
the same time but that isn't common enough to worry about.

As part of this cleanup also remove references to CHROMEOS_* variables
and the recovery image that never actually existed in CoreOS.
2014-05-09 10:55:09 -07:00
Michael Marineau
f2bafd7932 fix(oem/ami): Remove key options, update wrapper for beta
The key/cert authentication method doesn't work any more, just rely on
sourcing a file with the right env vars exported.

Re-enable parallel copy.

Add group option to wrapper and custom google storage url options.
2014-05-08 21:30:24 -07:00
Michael Marineau
d11528ca98 fix(image_set_group): Add support for uploading images. 2014-05-08 17:42:30 -04:00
Michael Marineau
28482f8dfa Merge pull request #246 from marineam/promote
add(core_promote): A script for bumping a channel to a new version.
2014-05-07 21:46:45 -07:00
Michael Marineau
fa750b5aeb add(core_promote): A script for bumping a channel to a new version. 2014-05-07 21:45:52 -07:00
Michael Marineau
9dd0a9d87f Merge pull request #245 from marineam/set-group
add(image_set_group): New script to set the update group in prod images.
2014-05-07 16:58:24 -07:00
Michael Marineau
a7e1e5a177 add(image_set_group): New script to set the update group in prod images.
For generating images for groups other than the one given to build_image
run this script along with the usual image_to_vm.sh commands. To avoid
ambiguity with the 'latest' symlink, this script creates $group-latest
symlinks instead. build_image creates the new symlink too.
2014-05-07 15:07:14 -07:00
Michael Marineau
174ab609f8 Merge pull request #244 from marineam/dev-group
fix(set_lsb_release): Set default GROUP= from arg again.
2014-05-07 13:39:44 -07:00
Michael Marineau
b4d6fb9597 fix(set_lsb_release): Set default GROUP= from arg again.
This makes sure developer builds stick to the developer group. After
commit c3d07e94 developer PXE/ISO images would report as 'alpha'.
2014-05-07 12:52:05 -07:00
Michael Marineau
af8e6da2da Merge pull request #242 from marineam/c10n
maint(generate_au_zip): Drop old update service uploader
2014-05-07 11:31:17 -07:00
Michael Marineau
25aad16c38 Merge pull request #243 from marineam/groups
More release/build script updates for beta prep
2014-05-06 21:15:35 -07:00
Michael Marineau
c3d07e942c feat(set_lsb_release): Write configured group to /etc instead of /usr
The /usr images must be identical across groups so that information is
static. Eventually the default will be 'stable'
2014-05-06 13:21:10 -07:00
Michael Marineau
ce9d1c95a9 fix(core_roller_upload): Use new payload names and upload path.
As of 4e85b172 the build system generates the update payload using the
coreos_production_update prefix, so use that instead. Use the release
version in the storage path instead of a disk image MD5; the version is
sufficiently unique and the no need for the obfuscation.

Drop the disk image copy in the download storage that I tacked in, that
will go into a new core_promote script that I have written but not
tested yet (need an alpha release to promote!!).
2014-05-06 13:04:36 -07:00
Michael Marineau
6d165f8a7c maint(generate_au_zip): Drop old update service uploader 2014-05-05 15:14:46 -07:00
Michael Marineau
19d22fb6cf Merge pull request #241 from marineam/fix
fix(tag_release): Fix compatibility with portage's config parser
2014-05-05 10:05:36 -07:00
Michael Marineau
4815c38194 fix(tag_release): Fix compatibility with portage's config parser
Another fix for 10d98e7. Empty values must be quoted, otherwise the
tokenizer gets confused and everything falls apart. :(
2014-05-04 22:52:53 -07:00
Michael Marineau
1acefe7015 Merge pull request #240 from marineam/fix
fix(tag_release): Finish partially completed flag rename.
2014-05-04 22:37:01 -07:00
Michael Marineau
06bcb50a5f fix(tag_release): Finish partially completed flag rename.
Didn't quite complete all the renames in 10d98e7, breaking everything...
2014-05-04 22:31:38 -07:00
Fabrício Godoy
63d519b992 Script to create basic config-drive
New script that creates a basic config-drive, ideal to testing purpose.
2014-05-04 01:16:34 -03:00
Fabrício Godoy
8f3fc749c2 VirtualBox script changed to convert image untouched
With config drive there is no need to crack image to insert SSH keys. Then VirtualBox script was changed to just download CoreOS image and convert it to VDI format.
2014-05-04 01:16:34 -03:00
Michael Marineau
33858859fb Merge pull request #238 from marineam/insecure
fix(vm_image_util): Don't use the full vagrant OEM on vmware_insecure
2014-05-03 14:19:20 -07:00