Commit Graph

3708 Commits

Author SHA1 Message Date
Michael Marineau
0b052bc756 Merge pull request #276 from marineam/conf
make.conf cleanup
2014-06-16 13:57:50 -07:00
Michael Marineau
b01421992a Merge pull request #273 from marineam/metadata
feat(metadata): Add support for updating ebuild metadata cache
2014-06-16 13:47:09 -07:00
Michael Marineau
e86fd080b2 Merge pull request #277 from marineam/devdata
fix(build_image): Use developer_data as a system config.
2014-06-15 17:26:44 -07:00
Michael Marineau
9d2774af3b fix(build_image): Use developer_data as a system config.
Evaluating this as a user config causes it to block on
coreos-environment-setup.service which will wait on networking. This
makes it hard to add extra tricks for testing/debugging situations where
networking is failing. For example, to trigger dhcpcd if networkd dies:

    #cloud-config

    write_files:
      - path: /etc/systemd/system/systemd-networkd.service.d/dhcpcd.conf
        content: |
          [Unit]
          OnFailure=dhcpcd.service

          [Service]
          Restart=no
2014-06-15 15:41:53 -07:00
Michael Marineau
7f599ac764 fix(update_chroot): Remove old make.conf symlinks
The old static files are pretty much empty and unused now.
2014-06-12 16:57:54 -07:00
Michael Marineau
99ed29d218 fix(board_setup): Remove old make.conf symlinks
Just use the single auto-generated make.conf, it covers everything now.
2014-06-12 16:53:27 -07:00
Michael Marineau
2aa81abb9d add(core_pre_alpha): New release script for just posting alpha images.
Since moving to the new bucket scheme we haven't been posting alpha disk
images as soon as they were built but it is often useful to post them
before promoting them so people can easily test them.
2014-06-11 13:33:11 -07:00
Michael Marineau
bd7adb6c4f feat(metadata): Add support for updating ebuild metadata cache
New script update_metadata to do a global update of both repos.
Add support to update_ebuilds to do incremental updates when just
pulling new ebuilds into portage-stable.
2014-06-10 18:55:36 -07:00
Michael Marineau
81045d2921 Merge pull request #272 from marineam/fix-again
fix(setup_board): Got lost in my own if statements :(
2014-06-10 16:04:56 -07:00
Michael Marineau
bb3b7d4fcd fix(setup_board): Got lost in my own if statements :( 2014-06-10 16:00:32 -07:00
Michael Marineau
0992af818b Merge pull request #271 from marineam/profiles
Profile and config updates
2014-06-10 13:10:16 -07:00
Michael Marineau
9a973e4113 fix(setup_board): Migrate packages in existing board roots. 2014-06-10 15:38:36 -04:00
Michael Marineau
0d29e73534 fix(*): Use binary package for baselayout
It is no longer necessary to use the build USE flag or avoid binary
packages when installing baselayout for the first time.
2014-06-10 14:45:56 -04:00
Michael Marineau
09faef6d02 feat(setup_board): Generate a complete make.conf
Add settings that are currently provided by make.conf.common-target in
coreos-overlay. Most of these are better off being derived directly from
the host environment's portage configuration.

The PKGDIR, TMPDIR, and LOGDIR values are changing to be more consistant
with the SDK configuration but these changes won't take effect until the
old make.conf.common-target is removed since its values override these.
2014-06-10 14:45:56 -04:00
Michael Marineau
93b0ec304a fix(build_library): Remove reference to old SDK profile
The SDK's profile changed to coreos:coreos/amd64/sdk quite a long time
ago. Remove this last reference to it so the alias can be forgotten.
2014-06-10 14:45:56 -04:00
Michael Marineau
9a4ec472ce fix(build_library): Update amd64-usr's portage profile
The usr profile is just an alias to generic now so drop the old name.
2014-06-10 14:45:56 -04:00
Michael Marineau
460d74b13a Merge pull request #268 from marineam/copy-region
fix(oem/ami): Add option to copy to a single region.
2014-06-09 19:29:44 -07:00
Michael Marineau
2bcb9bfd4f Merge pull request #270 from marineam/legacy
fix(core_promote): fix typo
2014-06-09 15:35:14 -07:00
Michael Marineau
3b72f2d86c fix(core_promote): fix typo 2014-06-09 14:47:25 -07:00
Michael Marineau
454a280ed5 Merge pull request #269 from marineam/legacy
feat(core_promote): Copy alpha/beta to legacy bucket as well.
2014-06-09 12:14:53 -07:00
Michael Marineau
2f93bdbd54 fix(oem/ami): Add option to copy to a single region.
It is not uncommon for a single region to fail with some internal server
error or other transient issue. Make it easy to fix up that one region.
2014-06-09 12:12:14 -07:00
Michael Marineau
4b46e7b749 feat(core_promote): Copy alpha/beta to legacy bucket as well.
This replaces a couple of scripts I keep running to sync up the old
download location.
2014-06-09 11:51:59 -07:00
Michael Marineau
5b476734a1 Merge pull request #267 from marineam/containers
fix(disk_util): don't run blkid on empty partitions
2014-06-09 11:38:06 -07:00
Michael Marineau
d762f683c0 Merge pull request #266 from marineam/contents
Publish image contents
2014-06-08 14:14:12 -07:00
Michael Marineau
bb3d751e6f feat(build_image): Generate lists of image contents
Index contents by file and package.
2014-06-08 16:38:54 -04:00
Michael Marineau
388220cfad fix(build_image): move upload calls to build_library
This will let the image building code upload extra data without the
wrapper script having to know about it.
2014-06-08 16:37:48 -04:00
Michael Marineau
02bd7351dd fix(disk_util): don't run blkid on empty partitions 2014-06-06 16:12:37 -07:00
Michael Marineau
bb6a18fbb8 Merge pull request #265 from marineam/json
fix(release_util): Generate correct download path for official releases
2014-06-02 14:02:13 -07:00
Michael Marineau
e31d0f49dc Merge pull request #264 from marineam/ami_all
fix(upload_ami_txt): One missed URL fixup
2014-06-02 13:30:55 -07:00
Michael Marineau
57ebeef297 fix(release_util): Generate correct download path for official releases
This fixes the vagrant metadata json files that we create.
2014-06-02 12:38:01 -07:00
Michael Marineau
a830e8ca49 fix(upload_ami_txt): One missed URL fixup
I added boards to the path for the other files but not ami_all.txt :(
2014-06-02 12:20:57 -07:00
Alex Crawford
17835eeb79 Merge pull request #263 from crawford/teeth
feat(teeth): Add new OEM and disk layout for teeth
2014-05-29 17:06:37 -07:00
Alex Crawford
d9afc85b0e feat(teeth): Add new OEM and disk layout for teeth 2014-05-29 16:46:27 -07:00
Alex Crawford
ed50f5fe0b feat(disk_util): Replace Resize() with Update()
The new Update() performs the same tasks as the old Resize()
in addition to formatting previously-unformatted partitions. This
allows children disk-layouts to repartition the base layout in
addition to resizing.
2014-05-29 16:46:27 -07:00
Michael Marineau
4c15711f66 Merge pull request #261 from marineam/coreception
Fixes for SDK setup
2014-05-29 15:19:15 -07:00
Michael Marineau
0e447a7c06 Merge pull request #262 from marineam/buckets
fix(build_library): Finish conversion to new bucket layout.
2014-05-28 14:54:23 -07:00
Michael Marineau
d408e3c1f5 fix(build_library): Finish conversion to new bucket layout.
I started to move board files under a boards/ directory similar to how
the SDK is under sdk/ but didn't do so everywhere. This should finish
the job so everything is consistent now.

Note: This prefix is only used in developer and buildbot uploads. When
final releases are copied to $channel.release.core-os.net it doesn't use
the prefix since a) I already published urls without the prefix and b)
no sdk files are ever posted to the public release locations.
2014-05-28 14:47:30 -07:00
Michael Marineau
18d796ff3e fix(sdk-lib): Mount a fresh /run directory.
There is no need to arbitrarily bind mount all of the host system's /run
into the chroot. In fact this causes issues when the host system's /run
isn't set up in a way this script anticipates. Namely the user runtime
directory in /run/usr/$UID is another tmpfs mount on my system, leaving
the underlying directory node that is bind-mounted in with the wrong
ownership. Behave a little more like a responsible container and use a
fresh /run but continue binding /run/shm for whatever versions of Ubuntu
that depended on that behavior. Not strictly needed but go ahead and
create the user runtime directory with the correct permissions.
2014-05-27 19:26:34 -07:00
Michael Marineau
f2f74b3423 fix(sdk_lib): Clean up ssh file copying
- Don't copy known_hosts if it doesn't exist.
- Don't bother with copying *.pub, not sure what that was for.
- Don't rewrite .ssh/config to remove internal Google ssh options.
2014-05-27 17:32:58 -07:00
Michael Marineau
796be0a520 fix(sdk_lib): Test for host file existence before copying.
The main case here is /etc/hosts does not exist on CoreOS. In the
process combine related and duplicate code. Setting the timezone now
happens in entire_chroot like hosts and resolv.conf. Don't bother with
setting a default UTC time zone, that is already the default.
2014-05-27 17:32:54 -07:00
Michael Marineau
57f65add2b Merge pull request #260 from marineam/repo
fix(sdk_lib): Remove depot_tools mount
2014-05-27 17:06:53 -07:00
Michael Marineau
47daca491c fix(sdk_lib): Remove depot_tools mount
We now include repo in the SDK which was the only thing from depot_tools
that we depended on.
2014-05-27 16:39:49 -07:00
Michael Marineau
5727ea4214 Merge pull request #259 from marineam/disk
fix(disk_layout): Bump up default ROOT volume sizes for btrfs.
2014-05-27 11:53:42 -07:00
Michael Marineau
d380c8bfb3 Merge pull request #258 from marineam/dev
fix(build_image_util): Reorder when set_lsb_release is called
2014-05-23 18:55:06 -07:00
Michael Marineau
d11815a68d fix(disk_layout): Bump up default ROOT volume sizes for btrfs.
btrfs isn't designed for small volumes and can run out of space sooner
than one would expect in our current setup, particularly with docker.
To try to improve the situation always create the filesystem initially
as 2GB instead of 512MB using the default settings: metadata is
duplicated, data is single, not mixed. The mixed setting may have been
partly why our performance can be so poor. For the default vm layout
use 6GB instead of 3GB, about what we use for EC2.
2014-05-23 18:22:02 -07:00
Michael Marineau
0ec871b203 fix(build_image_util): Reorder when set_lsb_release is called
dev_image_util needs to be able to append to update.conf so move
set_lsb_release to start_image instead of finish_image.
2014-05-22 22:41:54 -07:00
Michael Marineau
a7b67723ac Merge pull request #257 from marineam/boards
fix(build_toolchains): Update board package location
2014-05-22 18:56:34 -07:00
Michael Marineau
61704a02c7 fix(build_toolchains): Update board package location
The naming scheme in the new buckets has changed slightly, missed this
one in the other updates.
2014-05-22 18:15:52 -07:00
Michael Marineau
bf83487c29 Merge pull request #255 from marineam/buckets
fix(*): Migrate image storage to new buckets
2014-05-21 18:02:10 -07:00
Michael Marineau
ff2d216142 fix(release_util): Add options to configure download path.
Since the new bucket scheme uploads images to a private staging area
first we need to configure the final location to generate vagrant json
metadata correctly.
2014-05-21 13:39:56 -07:00