28179 Commits

Author SHA1 Message Date
Michael Marineau
2e37393af5 fix(sys-kernel/coreos-kernel): Add evdev module.
ACPI power buttons are input devices! Without this it isn't possible to
trigger a graceful shutdown via qemu's command 'system_powerdown' or
whatever libvirt and similar APIs that are layered on top of it.

Probably applicable to other things too that we just don't know about.
2013-07-30 21:10:41 -04:00
Michael Marineau
9d975a3dd7 fix(coreos-devel/coreos-buildbot): Update git commit hash
Merged, use fresh new merge hash.
2013-07-30 16:52:26 -04:00
Michael Marineau
5f2f390b9a fix(profiles): Set use flags required by buildhost-depends 2013-07-30 13:41:23 -04:00
Michael Marineau
4e829155c2 bump(dev-util/buildbot): sync with upstream
Lots of dependencies to pull in!

Packages updated:
  dev-python/decorator
  dev-python/jinja
  dev-python/markupsafe
  dev-python/pyflakes
  dev-python/python-dateutil
  dev-python/six
  dev-python/sqlalchemy
  dev-python/sqlalchemy-migrate
  dev-python/tempita
  dev-python/twisted
  dev-python/twisted-web
  dev-util/buildbot
  dev-util/buildbot-slave
  net-zope/zope-fixers
  net-zope/zope-interface
2013-07-30 13:37:31 -04:00
Michael Marineau
0c564ebf78 add(coreos-devel/*-depends): Meta ebuilds for buildhost and SDK.
Create a meta-ebuild for the SDK based on the packages currently listed
explicitly in bootstrap_sdk.sh and a buildhost ebuild that expands on
that, adding packages that are required in containers used by build
slave instances.
2013-07-30 13:19:15 -04:00
Michael Marineau
ae43aaf5df add(coreos-devel/coreos-buildbot): Add ebuild for our buildbot tools.
Creating a new category for this, coreos-base is overused and dev-python
didn't seem right for custom infrastructure tools. Going forward I'd
like to put SDK and build host specific stuff in this category when
previously coreos-base would be used. Things that actually land in
images would stick with coreos-base.
2013-07-30 13:02:17 -04:00
Brandon Philips
64350b1aed Merge pull request #140 from philips/drop-unused-package
chore(coreos): remove app-crypt/trousers
2013-07-30 09:24:57 -07:00
Michael Marineau
4e88f96fa1 Merge pull request #142 from marineam/notice-404
fix(dev-db/etcd): Handle missing ec2 user-data correctly.
2013-07-30 09:21:44 -07:00
Brandon Philips
bf35170ead fix(dev-db/etcd): use mkdir -p in pre-exec
Ensure that we don't fail on the /var/run/etcd directory creation.
2013-07-30 09:04:47 -07:00
Brandon Philips
db2708f2e8 fix(dev-db/etcd): use new state location
have etcd use /var/lib like other daemons do.
2013-07-30 09:03:45 -07:00
Michael Marineau
9d25f8c06c fix(dev-db/etcd): Handle missing ec2 user-data correctly.
Important notice to all using curl: by default a 404 is not an error!

I noticed that instances created without any user data were attempting
to connect to a *lot* of random IP addresses and failing. After
attempting the curl command c10n uses to fetch user data it would seem
we have lots of virtual machines using the following as a secret key:

    <?xml version="1.0" encoding="iso-8859-1"?>
    <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
             "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
    <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
     <head>
      <title>404 - Not Found</title>
     </head>
     <body>
      <h1>404 - Not Found</h1>
     </body>
    </html>

ᕙ(⇀‸↼‶)ᕗ

The --fail option is required for curl to behave responsibly.
2013-07-30 11:44:46 -04:00
Brandon Philips
5bd666247c feat(dev-db/etcd): run as etcd user
thie patch does a few things

1) Add the etcd user and run etcd as that user

2) Add the /var/lib/etcd directory and have it owned by the etcd user

3) Move /media/state/etcd/* files into /var/lib/etcd/ and chown them to
   etcd

Test-plan: Build an AMI and ensure this all works with the
bootstrapping.
2013-07-29 23:09:14 -07:00
Brandon Philips
ea25c209af chore(coreos): remove app-crypt/trousers
It will be awhile before CoreOS runs on something with a working TPM.
Remove this.
2013-07-29 21:39:53 -07:00
Brandon Philips
62db854432 Merge pull request #139 from philips/cleanup-unix-users
chore(coreos-base/coreos-base): remove unused groups/users
2013-07-29 21:36:58 -07:00
Brandon Philips
033a385685 chore(coreos-base/coreos-base): remove unused groups/users
we have a few unused groups and users. Reserve the UIDs but just don't
have them in the DB until we need them.
2013-07-29 21:33:04 -07:00
Brandon Philips
c3444a8ad5 Merge pull request #138 from doodles526/certs
added commit for our certs
2013-07-29 14:05:46 -07:00
Brandon Philips
2c1b5517b2 Merge pull request #137 from marineam/fix-hash
fix(coreos-base/coreos-init): Fix invalid git hash.
2013-07-29 13:43:03 -07:00
Josh Deare
9df7791b42 added commit for our certs 2013-07-29 11:47:18 -07:00
Michael Marineau
3d7b6336fb fix(coreos-base/coreos-init): Fix invalid git hash.
Merge gone wrong with a rebase maybe? Dunno but should build now. :)
2013-07-29 14:36:26 -04:00
Brandon Philips
b48f95c3db Merge pull request #135 from philips/add-local.target
fix(init): move a few things around
2013-07-29 10:15:36 -07:00
Brandon Philips
da254bcd45 fix(init): move a few things around
1) Make default.target be multi-user.target instead of the default,
   graphical.target

2) Move daemons out of coreos-startup and just have them wantedby
   default.target

3) Have update-engine not rely on coreos-startup and add itself to
   default.target.wants

4) Grab the new init code that does the above

5) Add the local-enable.service which will add /media/state/units to
   /run/systemd/system and start local.target
2013-07-28 22:59:08 -07:00
polvi
fd4502226f Merge pull request #133 from marineam/rebump
bump(dev-db/etcd): Fix revision number, we wend backwards by mistake.
2013-07-28 14:44:40 -07:00
Michael Marineau
c8b83b06c8 bump(dev-db/etcd): Fix revision number, we wend backwards by mistake. 2013-07-28 17:41:29 -04:00
Michael Marineau
ae9b5f877a Merge pull request #66 from marineam/fstrim
fix(build_library): Re-enable zeroing free-space but in a sane way.
2013-07-27 14:45:26 -07:00
Michael Marineau
9f3517a474 Merge pull request #67 from marineam/use-tags
fix(master_release): Use tag names in commit message when available
2013-07-27 14:44:52 -07:00
Michael Marineau
84348c39af fix(build_library): Re-enable zeroing free-space but in a sane way.
As of Linux 3.2 loopback supports discard by punching holes in the
underlying file. This doesn't actually seem to impact things right now
since we are writing to fresh filesystems but might as well do this to
prevent wasted space from sneaking in later on.
2013-07-27 16:39:52 -04:00
Michael Marineau
84f2909531 fix(master_release): Use tag names in commit message when available 2013-07-27 15:56:51 -04:00
polvi
113b6e6282 Merge pull request #132 from marineam/nsswitch
fix(coreos-base/coreos-base): Include default nsswitch.conf
2013-07-27 10:42:32 -07:00
Michael Marineau
6f7ec78b85 fix(coreos-base/coreos-base): Include default nsswitch.conf
Until we start installing glibc like sane people we need to include this
via other means. Without it name resolution behavior is somewhat surprising.
2013-07-27 13:20:13 -04:00
Michael Marineau
215a558a20 Merge pull request #65 from marineam/misc
Misc build updates
2013-07-27 09:42:21 -07:00
Michael Marineau
ec9ee86139 Merge pull request #131 from marineam/dev
bump(coreos-base/cros-devutils+gmerge): Update to latest code
2013-07-27 07:15:55 -07:00
Michael Marineau
505107c48d fix(catalyst): Cleanup temporary files.
Catalyst doesn't clean up the temporary root directories even though we
don't have seedcache enabled. So lets wipe that mess up.
2013-07-27 00:07:09 -04:00
Michael Marineau
a1a1ed830c fix(build_library): Use sparse files for disk images, no useless sudo
Enable sparse files for all dd and cp commands and replace some dd
commands that are really better off being truncate commands.

While in the neighborhood there were a number of useless sudo commands
for things that just happen to be in sbin. Call them directly instead.
2013-07-26 23:45:10 -04:00
Michael Marineau
f46ee8c332 fix(build_image): Fix building dev and prod without base
Ever since adding prod it hasn't been possible to build just dev and
prod without explicitly building base. Base is always built but usually
there is no point to keeping it around. Add some logic to make dev not
conflict with prod and make sure base is deleted and not uploaded if it
wasn't explicitly requested.
2013-07-26 22:56:27 -04:00
Michael Marineau
9effa608cd bump(coreos-base/cros-devutils+gmerge): Update to latest code 2013-07-26 22:49:05 -04:00
Michael Marineau
1ea1e8ba9b cleanup(common): Remove rarely used pv_cat_cmd
Its single use is in build_common and even then having a little progress
bar for copying images isn't that interesting, they just get lost in the
noise of the emerge output. Keep it simple, use cp.
2013-07-26 22:40:59 -04:00
Brandon Philips
6b603ae9ef Merge pull request #64 from marineam/rename-dev
fix(*): Rename dev image to coreos_developer_image.bin
2013-07-26 19:27:11 -07:00
Michael Marineau
42a4536d7d fix(*): Rename dev image to coreos_developer_image.bin
Remove hard-coded references and unused scripts that mentioned it.
2013-07-26 22:12:10 -04:00
Michael Marineau
17736820bd Merge pull request #63 from marineam/rel
fix(master_release): Fix default branch to pull from, fetch evyerhing.
2013-07-26 18:38:28 -07:00
Michael Marineau
6544b67b89 Merge pull request #130 from marineam/etcd
bump(dev-db/etcd): Grab latest build fixes
2013-07-26 18:27:19 -07:00
Michael Marineau
27af72359e fix(master_release): Fix default branch to pull from, fetch evyerhing. 2013-07-26 21:27:18 -04:00
Michael Marineau
7ed8357499 bump(dev-db/etcd): Grab latest build fixes 2013-07-26 21:14:55 -04:00
Michael Marineau
5375057c86 Merge pull request #62 from marineam/lbzip2
fix(cros_sdk): Support using lbzip2 during chroot creation.
2013-07-26 16:46:58 -07:00
Michael Marineau
06ce63152f Merge pull request #129 from marineam/lbzip2
fix(profiles): Enable lbzip2 for both SDK and targets, move to profiles
2013-07-26 16:46:24 -07:00
Michael Marineau
7696459498 fix(profiles): Enable lbzip2 for both SDK and targets, move to profiles
It has been long enough since adding lbzip2 to the system set, time to
put it to work for all our binary package needs!
2013-07-26 19:12:31 -04:00
Michael Marineau
ca6415dc89 fix(cros_sdk): Support using lbzip2 during chroot creation.
Our SDK tarballs aren't compressed using pbzip2 so there is no advantage
to using pbzip2 to decompress them over bzip2, however lbzip2 does offer
a big advantage. Also trust that the portage config defines a valid
version of bzip2 since we have control over the tarball creation and can
make sure to always include required utilities.
2013-07-26 18:31:18 -04:00
Michael Marineau
6697c05d0a Merge pull request #61 from marineam/vm_upload
Vm upload
2013-07-26 15:18:04 -07:00
Michael Marineau
37c56b64de feat(build_ebs_on_ec2): Fetch prod images by version, misc cleanup.
The build host will start generating production ami disk images so to
simplify the next step this script can automatically fetch them from
that location by version. The default sticks with the existing 'master'
versioning scheme. Added logging and turned off -x by default to make
the output log more readable.

Removing the zip_and_ship script since it isn't useful with officially
built disk images and only works with locally built images and a very
particular ec2 host. A different long term automation scheme will have
to be found.
2013-07-26 17:45:27 -04:00
Michael Marineau
c5cd245603 feat(image_to_vm): Add support for uploading vm images
After this I can make production AMI images available for download! :-D
2013-07-26 16:31:11 -04:00
Brandon Philips
ecb8ea259c Merge pull request #60 from philips/move-stateful-around
Move stateful around
2013-07-26 11:33:59 -07:00