Commit Graph

3233 Commits

Author SHA1 Message Date
Michael Marineau
3b72f2d86c fix(core_promote): fix typo 2014-06-09 14:47:25 -07:00
Michael Marineau
454a280ed5 Merge pull request #269 from marineam/legacy
feat(core_promote): Copy alpha/beta to legacy bucket as well.
2014-06-09 12:14:53 -07:00
Michael Marineau
2f93bdbd54 fix(oem/ami): Add option to copy to a single region.
It is not uncommon for a single region to fail with some internal server
error or other transient issue. Make it easy to fix up that one region.
2014-06-09 12:12:14 -07:00
Michael Marineau
4b46e7b749 feat(core_promote): Copy alpha/beta to legacy bucket as well.
This replaces a couple of scripts I keep running to sync up the old
download location.
2014-06-09 11:51:59 -07:00
Michael Marineau
5b476734a1 Merge pull request #267 from marineam/containers
fix(disk_util): don't run blkid on empty partitions
2014-06-09 11:38:06 -07:00
Michael Marineau
d762f683c0 Merge pull request #266 from marineam/contents
Publish image contents
2014-06-08 14:14:12 -07:00
Michael Marineau
bb3d751e6f feat(build_image): Generate lists of image contents
Index contents by file and package.
2014-06-08 16:38:54 -04:00
Michael Marineau
388220cfad fix(build_image): move upload calls to build_library
This will let the image building code upload extra data without the
wrapper script having to know about it.
2014-06-08 16:37:48 -04:00
Michael Marineau
02bd7351dd fix(disk_util): don't run blkid on empty partitions 2014-06-06 16:12:37 -07:00
Michael Marineau
bb6a18fbb8 Merge pull request #265 from marineam/json
fix(release_util): Generate correct download path for official releases
2014-06-02 14:02:13 -07:00
Michael Marineau
e31d0f49dc Merge pull request #264 from marineam/ami_all
fix(upload_ami_txt): One missed URL fixup
2014-06-02 13:30:55 -07:00
Michael Marineau
57ebeef297 fix(release_util): Generate correct download path for official releases
This fixes the vagrant metadata json files that we create.
2014-06-02 12:38:01 -07:00
Michael Marineau
a830e8ca49 fix(upload_ami_txt): One missed URL fixup
I added boards to the path for the other files but not ami_all.txt :(
2014-06-02 12:20:57 -07:00
Alex Crawford
17835eeb79 Merge pull request #263 from crawford/teeth
feat(teeth): Add new OEM and disk layout for teeth
2014-05-29 17:06:37 -07:00
Alex Crawford
d9afc85b0e feat(teeth): Add new OEM and disk layout for teeth 2014-05-29 16:46:27 -07:00
Alex Crawford
ed50f5fe0b feat(disk_util): Replace Resize() with Update()
The new Update() performs the same tasks as the old Resize()
in addition to formatting previously-unformatted partitions. This
allows children disk-layouts to repartition the base layout in
addition to resizing.
2014-05-29 16:46:27 -07:00
Michael Marineau
4c15711f66 Merge pull request #261 from marineam/coreception
Fixes for SDK setup
2014-05-29 15:19:15 -07:00
Michael Marineau
0e447a7c06 Merge pull request #262 from marineam/buckets
fix(build_library): Finish conversion to new bucket layout.
2014-05-28 14:54:23 -07:00
Michael Marineau
d408e3c1f5 fix(build_library): Finish conversion to new bucket layout.
I started to move board files under a boards/ directory similar to how
the SDK is under sdk/ but didn't do so everywhere. This should finish
the job so everything is consistent now.

Note: This prefix is only used in developer and buildbot uploads. When
final releases are copied to $channel.release.core-os.net it doesn't use
the prefix since a) I already published urls without the prefix and b)
no sdk files are ever posted to the public release locations.
2014-05-28 14:47:30 -07:00
Michael Marineau
18d796ff3e fix(sdk-lib): Mount a fresh /run directory.
There is no need to arbitrarily bind mount all of the host system's /run
into the chroot. In fact this causes issues when the host system's /run
isn't set up in a way this script anticipates. Namely the user runtime
directory in /run/usr/$UID is another tmpfs mount on my system, leaving
the underlying directory node that is bind-mounted in with the wrong
ownership. Behave a little more like a responsible container and use a
fresh /run but continue binding /run/shm for whatever versions of Ubuntu
that depended on that behavior. Not strictly needed but go ahead and
create the user runtime directory with the correct permissions.
2014-05-27 19:26:34 -07:00
Michael Marineau
f2f74b3423 fix(sdk_lib): Clean up ssh file copying
- Don't copy known_hosts if it doesn't exist.
- Don't bother with copying *.pub, not sure what that was for.
- Don't rewrite .ssh/config to remove internal Google ssh options.
2014-05-27 17:32:58 -07:00
Michael Marineau
796be0a520 fix(sdk_lib): Test for host file existence before copying.
The main case here is /etc/hosts does not exist on CoreOS. In the
process combine related and duplicate code. Setting the timezone now
happens in entire_chroot like hosts and resolv.conf. Don't bother with
setting a default UTC time zone, that is already the default.
2014-05-27 17:32:54 -07:00
Michael Marineau
57f65add2b Merge pull request #260 from marineam/repo
fix(sdk_lib): Remove depot_tools mount
2014-05-27 17:06:53 -07:00
Michael Marineau
47daca491c fix(sdk_lib): Remove depot_tools mount
We now include repo in the SDK which was the only thing from depot_tools
that we depended on.
2014-05-27 16:39:49 -07:00
Michael Marineau
5727ea4214 Merge pull request #259 from marineam/disk
fix(disk_layout): Bump up default ROOT volume sizes for btrfs.
2014-05-27 11:53:42 -07:00
Michael Marineau
d380c8bfb3 Merge pull request #258 from marineam/dev
fix(build_image_util): Reorder when set_lsb_release is called
2014-05-23 18:55:06 -07:00
Michael Marineau
d11815a68d fix(disk_layout): Bump up default ROOT volume sizes for btrfs.
btrfs isn't designed for small volumes and can run out of space sooner
than one would expect in our current setup, particularly with docker.
To try to improve the situation always create the filesystem initially
as 2GB instead of 512MB using the default settings: metadata is
duplicated, data is single, not mixed. The mixed setting may have been
partly why our performance can be so poor. For the default vm layout
use 6GB instead of 3GB, about what we use for EC2.
2014-05-23 18:22:02 -07:00
Michael Marineau
0ec871b203 fix(build_image_util): Reorder when set_lsb_release is called
dev_image_util needs to be able to append to update.conf so move
set_lsb_release to start_image instead of finish_image.
2014-05-22 22:41:54 -07:00
Michael Marineau
a7b67723ac Merge pull request #257 from marineam/boards
fix(build_toolchains): Update board package location
2014-05-22 18:56:34 -07:00
Michael Marineau
61704a02c7 fix(build_toolchains): Update board package location
The naming scheme in the new buckets has changed slightly, missed this
one in the other updates.
2014-05-22 18:15:52 -07:00
Michael Marineau
bf83487c29 Merge pull request #255 from marineam/buckets
fix(*): Migrate image storage to new buckets
2014-05-21 18:02:10 -07:00
Michael Marineau
ff2d216142 fix(release_util): Add options to configure download path.
Since the new bucket scheme uploads images to a private staging area
first we need to configure the final location to generate vagrant json
metadata correctly.
2014-05-21 13:39:56 -07:00
Michael Marineau
2e9911b978 fix(*): Migrate image storage to new buckets
- Automated builds drop SDK and binary packages into
  gs://builds.developer.core-os.net/ and the new download URL is
  http://builds.developer.core-os.net/ (COREOS_DEV_BUILDS)
- Change default upload path to gs://users.developer.core-os.net/ for
  misc developer builds. Official builds go elsewhere and will just be
  configured in buildbot/jenkins so some COREOS_OFFICIAL stuff is gone.
- Automated builds of images go to a private bucket,
  gs://builds.release.core-os.net which later gets copied to
  gs://alpha.release.core-os.net and friends by core_promote.
2014-05-21 13:21:07 -07:00
Michael Marineau
7372f9f6e6 Merge pull request #254 from marineam/dev-config
Build-time dev cloud configs
2014-05-18 20:46:07 -07:00
Michael Marineau
af0f0f5c73 Merge pull request #253 from marineam/dev-container
nspawn compatible dev container
2014-05-18 20:45:49 -07:00
Michael Marineau
822644fc54 feat(build_image): Add support for injecting a cloud config
The new --developer_data option can be used to specify a path to a cloud
config to bundle into the image. If none is provided but a shared user
password (for core) is set then generate a config to set that password.
This lets us use the same mechanism for setting the default password for
both disk and PXE images.
2014-05-17 16:23:18 -07:00
Michael Marineau
a93cb921d8 refactor(build_library): Add a function for enabling systemd units. 2014-05-17 16:23:16 -07:00
Michael Marineau
b24df04465 feat(build_image): Add 'container' image type.
This image type is the same as the developer image except that it is a
single root filesystem and is bootable via systemd-nspawn. This may
become obsolete eventually when it becomes possible to boot the normal
disk images under nspawn but it is useful for testing until then.

The partition type is defined by the Discoverable Partitions Spec.
http://www.freedesktop.org/wiki/Specifications/DiscoverablePartitionsSpec/
2014-05-16 21:11:01 -07:00
Michael Marineau
54f774d931 fix(build_library): Skip modifying non-existent partitions.
To make it possible to plop a CoreOS install into a simple
single-filesystem image for use as a container some things like
configuring bootloaders need to be skipped.
2014-05-16 20:52:21 -07:00
Michael Marineau
ee6b9ee1f9 fix(disk_util): Set btrfs default subvolume
This avoids needing to always pass the subvol=root mount option.
2014-05-16 19:09:23 -07:00
Michael Marineau
acb9800259 fix(disk_util): Don't try to format blank partitions. 2014-05-16 17:40:35 -07:00
Michael Marineau
0d750e6a28 remove(build_container): Kill catalyst-based container script
Never actually used this, new plan is slightly different.
2014-05-16 17:14:11 -07:00
Michael Marineau
38fa0f92a8 Merge pull request #252 from marineam/clean
Clean out some old ChromeOS junk
2014-05-15 17:57:53 -07:00
Michael Marineau
da934cc439 remove(cruft): Kill a few more things that aren't used 2014-05-15 15:48:41 -07:00
Michael Marineau
11d783b95c remove(symbols): Kill off scripts for managing ChromeOS debug symbols 2014-05-15 15:48:05 -07:00
Michael Marineau
9dc6424da6 remove(tests): Remove old ChromeOS test utilities
None are useful or relevant to us.
2014-05-15 15:45:45 -07:00
Michael Marineau
2b2576c4ab remove(hooks): Kill off old hook that checked compile flags.
This did things like verify that things were linked with gold (which we
don't do) and other checks. We don't have a need for it kill it.
2014-05-15 15:42:02 -07:00
Michael Marineau
dc93012500 Merge pull request #248 from marineam/oem
fix(oem/ami): Remove key options, update wrapper for beta
2014-05-15 15:09:21 -07:00
Michael Marineau
c8addbb6cc Merge pull request #251 from marineam/refactor
Refactor sdk setup
2014-05-15 15:02:50 -07:00
Michael Marineau
68a8a67081 fix(update_chroot): Consolidate more portage configuration
To behave more like setup_board/build_packages update_chroot should
fully configure portage to make sure everything is accurate.

Now binhosts are defined in make.conf.host_setup so the static config in
coreos-overlays doesn't need to refer to version.txt. setup_board
already made this change in 7a43a07f.

Define path locations to reduce dependency between static configs in
coreos-overlays and the behavior of the scripts repo. Spreading
configuration across two repos makes everything harder to understand.
Eventually everything should either be defined in profiles in
coreos-overlays or minimal auto-generated config files here in scripts.
2014-05-14 19:15:30 -07:00