30859 Commits

Author SHA1 Message Date
Michael Marineau
e6b3c60836 cleanup(setup_board): Remove /etc/make.conf.board
This file mostly just defined BINHOSTs but I'd like to move that
completely into coreos-overlay as the SDK BINHOSTs have always been. It
also sourced src/overlays/overlay-amd64-generic/make.conf but I want to
move the few things it defined into coreos-overlay as well.

The one interesting thing this file did was to optionally define
ACCEPT_LICENSE but that can go into /etc/make.conf.board_setup instead.

Overall this takes a chunk out of the make.conf spaghetti. :)
2013-06-22 16:05:33 -04:00
Brandon Philips
55ec02e342 Merge pull request #25 from marineam/bootstrap
Bootstrap
2013-06-22 11:51:00 -07:00
Brandon Philips
c02392ebff Merge pull request #26 from marineam/cvs
fix(coreos-base/hard-host-depends): Add cvs to SDK chroot
2013-06-22 11:50:16 -07:00
Brandon Philips
bc7b9b75e6 Merge pull request #3 from marineam/getbinpkg
fix(scripts): Add --nogetbinpkg command line option
2013-06-22 11:45:16 -07:00
Brandon Philips
27ea8c25a8 Merge pull request #5 from marineam/bootstrap
Bootstrap
2013-06-22 09:15:17 -07:00
Brandon Philips
e140183dc7 Merge pull request #5 from marineam/catalyst
add(dev-util/catalyst): Add catalyst and its missing dependencies
2013-06-22 09:14:57 -07:00
Michael Marineau
a8bf0fc986 add(dev-util/catalyst): Add catalyst and its missing dependencies
With these installed bootstrap_sdk should work inside the sdk itself.
Probably won't add this to the sdk by default since it pulls in extra
stuff most people don't need and is only really needed for build hosts.
2013-06-22 12:00:55 -04:00
Michael Marineau
e18841a44a fix(coreos-base/hard-host-depends): Add cvs to SDK chroot
This is required for the update_ebuilds command.
2013-06-22 10:58:29 -04:00
Michael Marineau
84572f0e9e fix(coreos/config): Switch download host to our own CNAME
We now have http://storage.core-os.net/ working so use that instead of
the generic Google host name.
2013-06-22 10:48:22 -04:00
Michael Marineau
ab0efd5d28 fix(coreos/config): Replace old ChromiumOS SDK binhosts and tarball.
Building our own packages so we don't want the old ones! This is just a
first stage, automated builds aren't going yet and I'm not covering
amd64-generic and its cross toolchain, just the sdk.

The old binhost/host/*.conf files are just stubbed out until I'm
positive nothing else is referring to them.
2013-06-22 00:30:10 -04:00
Michael Marineau
518bc10ded fix(coreos-base/update_engine): Add missing dependency to stable ebuild.
This fix previously made it into the live ebuild but not the stable one.
2013-06-22 00:30:10 -04:00
Michael Marineau
b7bde0b21c fix(profiles): Don't use live ebuilds by default.
As-is catalyst and cros-workon's live ebuilds don't mix since the
catalyst chroot does not provide /mnt/host like the sdk chroot does.
Besides, only people actively working on a project should use the live
versions since anyone else will install it one time and then never
upgrade after that, even when the version marked stable is actually
newer than their old live build.

For SDK builds this means not accepting ~amd64 for core-admin and
update_engine and adding a stable ebuild for core-admin. (update_engine
already has a stable ebuild which is even up-to-date)
2013-06-22 00:30:10 -04:00
Michael Marineau
19ceed57ab fix(profiles): Add shadow to the bootstrap package list
Despite the big scary warning saying otherwise upstream Gentoo has
actually included shadow in this list since 2011 (while also forgetting
to delete the warning, cute!). Not having it here runs the risk of
causing a failure during catalyst builds if something tries to add a
system user or group before shadow gets installed.

Upstream commit:
http://sources.gentoo.org/cgi-bin/viewvc.cgi/gentoo-x86/profiles/default/linux/packages.build?r1=1.5&r2=1.6
2013-06-22 00:30:10 -04:00
Michael Marineau
2dde5c7215 fix(profiles): Move USE from make.conf to make.defaults in profiles.
Moving more things into the profiles means we eventually reduce the
magic around generating make.conf and aids bootstrapping.
2013-06-22 00:30:10 -04:00
Michael Marineau
18db4d8f86 add(sys-apps/efunctions): Replace coreos-base version with generic one.
This version of efunctions does not depend on cros workon and git to
install and thus is suitable for bootstrapping. It also uses the
original author as the upstream rather than a coreos mirror. Since it is
not coreos specific any more I've moved it to sys-apps.

Added to both system and bootstrap package sets.

For extra fun it is also in my new systemd-only Gentoo overlay:
https://github.com/marineam/systemd-only-overlay
2013-06-22 00:30:10 -04:00
Michael Marineau
3f94c8ab1e fix(profiles): Add 'curl' to bootstrap use flags.
We are still using the Google toolchain which is in git, so add curl
support the bootstrapped git package so it can fetch the toolchain.
2013-06-22 00:30:10 -04:00
Michael Marineau
2e4405c3ec fix(profiles): Add 'threads' to the bootstrap use flags
This works around a dependency issue caused by our newer portage ebuilds
depending on +threads in our older python ebuilds. Will go away later.
2013-06-22 00:30:10 -04:00
Michael Marineau
f5e61302f1 fix(make_chroot): Remove unnecessary package rebuilds/removals
These are not required when starting from the new sdk stage4 tarballs
instead of a stock gentoo stage3 tarball.
2013-06-22 00:30:09 -04:00
Michael Marineau
9b53896653 fix(profiles): Drop references to virtual/portage
The old-style virtual/portage is gone and replaced by a new-style
virtual/package-manager in Gentoo. For now just use sys-apps/portage
since that's all we want anyway.
2013-06-22 00:30:09 -04:00
Michael Marineau
c77b595d66 fix(catalyst): Add --with-bdeps=y to stage4 upgrade
By default emerge will not install build dependencies if it doesn't need
them (i.e. installing a binary package) but we want to make sure
everything gets included in stage4 no matter how it was installed.
2013-06-22 00:30:09 -04:00
Michael Marineau
7c9a447541 add(profiles): Add profiles.desc to identify valid profiles 2013-06-22 00:30:09 -04:00
Michael Marineau
7bf839c6fb add(bootstrap_sdk): Add a script for bootstrapping the sdk tarball
This uses Gentoo's catalyst for very thoroughly building images from
scratch. Using images based on this will eliminate some of the hackery
in make_chroot.sh for building up the sdk from a stock stage3 tarball.

For reference the procedure it performs is this:

1. snapshot: Grab a snapshot of portage-stable. Note that overalys are
   not snapshotted.
2. stage1: Using a "seed" tarball as a build environment, build a
   minimal root file system into a clean directory using ROOT=...
   and USE=-* The restricted USE flags are key be small and avoid
   circular dependencies.
3. stage2: Run portage-stable/scripts/bootstrap.sh
   This rebuilds the toolchain. Probably not strictly necessary most of
   the time but does super-duper-promise that the toolchain isn't linked
   to or otherwise influenced by whatever was in the "seed" tarball.
4. stage3: Run emerge -e system to rebuild everything using the fresh
   toolchain using the normal USE flags provided by the profile. This
   will also pull in assorted base system packages that weren't included
   in the minimal environment stage1 created.
5. stage4: Install any extra packages or other desired tweaks. For the
   sdk we just install all the packages normally make_chroot.sh does.
2013-06-22 00:30:09 -04:00
Brandon Philips
603a1b1a05 Merge pull request #4 from marineam/mirrors
bump(thirdpartymirrors): Update portage's mirror list
2013-06-21 18:00:46 -07:00
Michael Marineau
121b4ebfb8 bump(thirdpartymirrors): Update portage's mirror list
This was over a year out of date and it seems a sizable number of the
ones for Apache aren't responding so downloading an old version of
subversion has been less than happy with the old list...
2013-06-21 00:32:00 -04:00
Brandon Philips
f809866aa4 Merge pull request #3 from marineam/bootstrap
add(bootstrap.sh): Add scripts/bootstrap.sh from upstream Gentoo.
2013-06-20 21:07:21 -07:00
Brandon Philips
77882c7653 Merge pull request #4 from marineam/update_ebuilds
add(update_ebuilds): A little script for fetching upstream ebuilds.
2013-06-20 21:06:50 -07:00
Michael Marineau
38f81b7b4e add(update_ebuilds): A little script for fetching upstream ebuilds.
Meant to add this last week... It can either pull from Gentoo CVS or a
local directory (in case you rsynced the whole portage tree). Just name
a package by pkg-cat/name and it will update portage-stable.
2013-06-20 23:27:25 -04:00
Brandon Philips
07c62d7765 Merge pull request #24 from unclejack/fix_docker_container_networking
Fix docker container networking
2013-06-20 10:40:17 -07:00
unclejack
9bf1948e3f enable IPv4 forwarding 2013-06-20 20:30:28 +03:00
unclejack
5eb00202e0 let docker set up its own bridge 2013-06-20 20:29:20 +03:00
Michael Marineau
0cf9a3f7c2 add(bootstrap.sh): Add scripts/bootstrap.sh from upstream Gentoo.
Required for building stage2 via catalyst.
2013-06-20 12:38:55 -04:00
Brandon Philips
de918bcb82 Merge pull request #23 from gregkh/kernel_docker
Two more kernel changes to enable Docker to work properly.
2013-06-18 12:40:12 -07:00
Greg Kroah-Hartman
9750d3979c fix(cros-kernel/x86_64_defconfig) enable some more vlan modules
Enable:
	CONFIG_MACVLAN=m
	CONFIG_MACVTAP=m
	CONFIG_VETH=m

Docker needs VETH, and might use MACVLAN in the future, it can't hurt to
enable them, they take up no running space if not used.
2013-06-18 12:37:01 -07:00
Greg Kroah-Hartman
337010c50d fix(cros-kernel/x86_64_defconfig) enable CONFIG_NETFILTER_XT_MATCH_ADDRTYPE=m
Docker uses this to manage the network containers properly.
2013-06-18 12:35:27 -07:00
Brandon Philips
0bc914a973 Merge pull request #21 from gregkh/kernel_slimdown
fix(cros-kernel/x86_64_defconfig) disable ext3 and ext2
2013-06-18 12:29:01 -07:00
Michael Marineau
19a993be96 fix(scripts): Add --nogetbinpkg command line option
As-is all of the various emerge wrapping scripts default to using
--getbinpkg whenever --usepkg is enabled. This means every single emerge
command made makes multiple synchronous HTTP requests to the upstream
binary package repository to get the latest package list. This gets
really frustrating when working remotely with limited network
connectivity. Using --usepkg with --nogetbinpkg will use locally cached
packages without making remote requests.
2013-06-18 14:49:59 -04:00
Greg Kroah-Hartman
0d779e0a36 fix(cros-kernel/x86_64_defconfig) enable CONFIG_MEMCG_SWAP_ENABLED
This is requested so that cgroups can swap properly.
2013-06-18 11:45:39 -07:00
Greg Kroah-Hartman
8c07bdb012 Merge pull request #22 from marineam/mirror
fix(make.conf): Disable force-mirror
2013-06-18 10:48:18 -07:00
Michael Marineau
d86b12d982 fix(make.conf): Disable force-mirror
This feature forces emerge to only fetch sources from mirrors, never the
SRC_URI provided in actual ebuilds. Disabling this should fix our issues
with portage tarballs vanishing. :-D
2013-06-18 13:38:22 -04:00
Greg Kroah-Hartman
b8332bffac fix(cros-kernel/x86_64_defconfig) disable ext3 and ext2
ext4 can, and should, handle both of these filesystems now, so have it
do so.
2013-06-16 20:57:19 -07:00
Michael Marineau
0213194ec7 Merge pull request #20 from gregkh/kernel_slimdown
Kernel slimdown
2013-06-14 17:55:58 -07:00
Michael Marineau
907ed2943b Merge pull request #19 from gregkh/boot_kernel_slimdown
Boot kernel slimdown
2013-06-14 17:53:36 -07:00
Greg Kroah-Hartman
352e260000 fix(cros-kernel/x86_64_defconfig) disable HOTPLUG_PCI
The kernel does not need HOTPLUG_PCI enabled, so turn it off, which
disables a number of other unneeded drivers as well.
2013-06-14 14:36:10 -07:00
Greg Kroah-Hartman
45da329724 fix(cros-kernel/x86_64_defconfig) turn off SELINUX
SELinux does not need to be enabled in the kernel, so turn it off and
fall back to the "default" Linux security model
2013-06-14 14:12:26 -07:00
Greg Kroah-Hartman
095359b384 fix(cros-kernel/x86_64_defconfig) enable vmware drivers
Build the vmware drivers so that machines can be properly managed on
those systems.
2013-06-14 14:10:44 -07:00
Greg Kroah-Hartman
2a7d97cae3 fix(cros-bootkernel/x86_64_defconfig_boot) enable vmware drivers
Enable the vmware drivers which were somehow not being built.
2013-06-14 13:59:06 -07:00
Greg Kroah-Hartman
e66fffd4e5 fix(cros-bootkernel/x86_64_defconfig_boot) disable unneeded crypto modules
Now that the ethernet drivers are gone, we can disable a number of the
crypto modules that are no longer needed.
2013-06-14 13:41:16 -07:00
Greg Kroah-Hartman
d8175c1d5f fix(cros-bootkernel/x86_64_defconfig_boot) disable CONFIG_PPS
This is no longer needed for the boot kernels, as we disabled ethernet
devices.
2013-06-14 13:32:10 -07:00
Greg Kroah-Hartman
7ce163dd33 fix(cros-bootkernel/x86_64_defconfig_boot) disable ACPI_HED and NETPRIO_CGROUP
Neither of these options are needed for the boot kernel, so disable
them.
2013-06-14 13:27:42 -07:00
Greg Kroah-Hartman
bd6c4a5373 fix(cros-bootkernel/x86_64_defconfig_boot) disable CONFIG_I2C
I2C is not needed for the boot kernel, so disable it, removing a bunch of
build options and modules.
2013-06-14 12:58:31 -07:00