Commit Graph

28179 Commits

Author SHA1 Message Date
Zdenek Behan
47d039a48c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

Reintroduces commit dc3359ba7c, with fixed list cmd

Review URL: http://codereview.chromium.org/3022003
2010-07-16 16:05:14 -07:00
Paul Stewart
cfe2a1960c Fix move of shflags
BUG=verbal
TEST=Reran script

Review URL: http://codereview.chromium.org/3010008
2010-07-16 15:14:51 -07:00
Raymes Khoury
cd29fd7a91 Build Chromium browser source as part of sync_build_test.sh
Added --chrome_root option to sync_build_test.sh which, if specified, builds Chromium browser from source in the directory given.

Review URL: http://codereview.chromium.org/2824054
2010-07-16 15:11:42 -07:00
Chris Sosa
16caaf0c7d Adds remaining functions to cros_mark_as_stable and cleaned up error messaging.
TEST=Tested with following workflow:
cros_mark_as_stable -p 'crash-reporter' -i 'boogabooga' commit
cros_mark_as_stable push
cros_mark_as_stable clean

Also passed in some real options for push_options in a branch that had nothing in it.

Review URL: http://codereview.chromium.org/3017002
2010-07-16 15:04:26 -07:00
Will Drewry
721d94f429 build_image,update_bootloaders: directly update the built image
Instead of playing mount and loop device games, this change adds support for
update_bootloaders.sh to directly update the EFI system partition living in the
image if a file, offset, and size is supplied.

TEST=build_image for x86-generic; booted resulting image
BUG=broken build

Change-Id: I3d891fd965df6fb4abfc63d660e314c497a4184d

Review URL: http://codereview.chromium.org/3006006
2010-07-16 14:39:45 -05:00
Andrew de los Reyes
3172b7e296 build_image: add temporary hack to fix syslinux building.
Will Drewry is working on the proper fix, but this unblocks people who
build images that boot w/ syslinux.

Review URL: http://codereview.chromium.org/3009003
2010-07-15 22:10:47 -07:00
David James
21d93ccac3 Revert "cros-workon: change forall into iterate"
This breaks cros-workon list, which is used by build_packages.

This reverts commit dc3359ba7c.

Review URL: http://codereview.chromium.org/3008005
2010-07-15 20:37:23 -07:00
David James
677d9c9b6c Fix parallel_emerge --unmerge to actually work.
When we run custom actions in parallel_emerge, we should pass the list of
packages on to emerge. Otherwise emerge won't know what packages to unmerge.

Besides the above, also fix an issue where --workon doesn't override
--getbinpkgonly or --usepkgonly.

TEST=Ran parallel_emerge --unmerge dhcpd and parallel_emerge --usepkgonly --board=x86-generic
     --workon=power_manager power_manager
BUG=none

Review URL: http://codereview.chromium.org/2927013
2010-07-15 19:32:36 -07:00
David McMahon
9f463ccf38 Created branch 0.8.56.B. Update CHROMEOS_VERSION_BRANCH=57
Change-Id: I8650a88dc8a88321dffe9d246298bc12edca6b9c
2010-07-15 17:03:01 -07:00
David McMahon
6d9d7a61e3 Update Minor version to 8 - this should have happened after R7
Review URL: http://codereview.chromium.org/3038003
2010-07-15 16:37:06 -07:00
Zdenek Behan
dc3359ba7c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

This is a re-upload of the original CL which seems to be broken beyond repair
by the git malfunctions yesterday

Review URL: http://codereview.chromium.org/3040001
2010-07-15 16:13:00 -07:00
Kelly Lucas
ee04e47a48 TBR: reviewed at: http://codereview.chromium.org/3001002/show 2010-07-15 15:47:52 -07:00
Zdenek Behan
d27f9039b5 cros_workon: fix forall (broken by --host) :/
Review URL: http://codereview.chromium.org/2966016
2010-07-15 15:41:52 -07:00
Paul Stewart
335a8eb131 Add copyright and script description
BUG=none
TEST=Reran script looking for syntax errors

Review URL: http://codereview.chromium.org/2958009
2010-07-15 15:34:18 -07:00
Paul Stewart
bfe72ce842 Wrapper script around run_remote_tests that knows about test cells
This is a first pass.  I'll review this code myself and do more
testing, but I wanted to get folks a look at it to make sure I
was going in the right direction.

BUG=none
TEST=ran using both cell and hostname scenarios

Review URL: http://codereview.chromium.org/3007002
2010-07-15 15:32:46 -07:00
Anush Elangovan
bd30076470 Enable get_svn_repos.sh to be run from src/scripts/. This script will be killed as soon as the autotest ebuild is fixed.
Change-Id: I7ddb0152d62a41b53c363c7363d13e7324e5ef55

Review URL: http://codereview.chromium.org/3019002
2010-07-15 15:19:04 -07:00
David James
ba2d887695 Fix parallel_emerge to handle "=" and "." in package names. Both can occur.
TEST=parallel_emerge --board=x86-generic -g =app-arch/bzip2-1.0.5-r1 =chromeos-base/power_manager-0.0.1 =dev-libs/expat-2.0.1-r3 =x11-libs/xtrans-1.2.5 =chromeos-base/google-breakpad-598-r2 =sys-libs/zlib-1.2.3-r1 =x11-proto/kbproto-1.0.4 =sys-libs/ncurses-5.7-r3 =x11-proto/xproto-7.0.16 =app-admin/eselect-python-20091230 =chromeos-base/kernel-headers-0.0.1-r1 =virtual/libintl-0
BUG=none

Review URL: http://codereview.chromium.org/2937011
2010-07-15 14:55:05 -07:00
Zdenek Behan
9f52b31150 cros_workon: introduce --all flag
* Replaced listall with list --all
* stop/start without arguments will now fail
* stop/start with --all will do just the expected thing
* Rewritten package list decision logic

TBR: msb - already got LGTM, then fixed a comment i noticed

Review URL: http://codereview.chromium.org/2963011
2010-07-14 15:47:09 -07:00
Rahul Chaturvedi
e770e16379 Resize stateful partition flag
Added flag to resize stateful partition that we put onto the VM image.

Review URL: http://codereview.chromium.org/2964011
2010-07-15 00:35:11 +05:30
Zelidrag Hornung
478a0d44a4 Renamed VM image to match naming convention of other images.
Review URL: http://codereview.chromium.org/2955014
2010-07-14 11:47:39 -07:00
Zdenek Behan
8683b8082f cros_workon: introduce a very simple listall command
TBR: sosa, msb - I already got the LGTM, then made a silly whitespace change!

Review URL: http://codereview.chromium.org/2909009
2010-07-13 16:48:12 -07:00
Allen Martin
07bfc7aa9d Separate out additional cmd line args to chroot
This fix separates out any additional command line arguments given to
the enter_chroot.sh script when passed to the interior chroot.  This
allows one to pass environment variable settings to the interior
chroot shell such as:

./enter_chroot.sh -- CHROME_ORIGIN=LOCAL_SOURCE emerge-x86-generic ...

Before this fix any of these variable settings will be sucked up by
the shell launching the chroot, not the interior shell.

BUG=chromium-os:2457
TEST=ran test cases detailed in bug report

Review URL: http://codereview.chromium.org/2855034
2010-07-13 15:44:59 -07:00
Chris Sosa
bebf3798e5 First cut at stable script
TEST=Tested by using crash-reporter and crash_ids set to "12345"

Review URL: http://codereview.chromium.org/2873016
2010-07-13 15:34:11 -07:00
Anush Elangovan
2c7d19693e Move shflags into crosutils.git
Change-Id: I3aa6275362910addfaa25db9a1578a5496019c9e

Review URL: http://codereview.chromium.org/2983005
2010-07-13 15:24:54 -07:00
Zdenek Behan
2089bed7b8 cros_workon: check selected packages if they are cros-workon, related fixes
Override locally warn/error functions to not interfere with stdout of canonicalize_name.
Future FIXME in common.sh.

Review URL: http://codereview.chromium.org/2985003
2010-07-13 15:08:07 -07:00
Zdenek Behan
aefb186237 cros_workon: corner case fixes
* Warn if user stops working on a package he wasn't working on
* Warn if user starts to work on a package he already is working on

Review URL: http://codereview.chromium.org/2978002
2010-07-13 13:31:44 -07:00
Paul Stewart
b3f323ed73 Clean up command line arguments and user output
Clean up command-line argument used to disable re-download of image bits down to the upgrade server.  This is now handed via a much more concise "--no_copy_archive" argument.  and user output output "fast restart" messages

Output information on how to run the "image_to_live.sh" client unconditionally (even if a client isn't being launched by this instance).

BUG=none
TEST=Reran commands, observed output

Review URL: http://codereview.chromium.org/2919009
2010-07-13 09:07:18 -07:00
Paul Stewart
bd2871a43a Fix duplicate sever-port bug
cros_copy_upgrade_server had a bug where it would always start servers
on port 8081 regrdless of whether that port was free.  This was a bug
in the "get next free port" code.

BUG=chromium-os:4776
TEST=Reran multiple instances at once, run netstat -nlt

Review URL: http://codereview.chromium.org/2975006
2010-07-13 07:59:15 -07:00
Tan Gao
8ae113bb42 remove handling of kernel verification block from recovery image
Change-Id: I749dc652651fdb02b49b290863e2fa9adc6b904e

Review URL: http://codereview.chromium.org/2948005
2010-07-13 07:04:48 -07:00
David James
dc07fb27e4 Teach parallel_emerge to uninstall packages.
Currently, parallel_emerge doesn't know how to handle uninstall actions, so it
actually installs packages when it should be uninstalling them. This patch
fixes that.

TEST=sudo ./parallel_emerge -uDNv hard-host-depends, and make sure it
     uninstalls nih-dbus-tool, which is blocked by hard-host-depends
BUG=none

Review URL: http://codereview.chromium.org/2990001
2010-07-13 00:33:20 -07:00
David James
b9ad46e9f7 Update parallel_emerge to support --workon.
Packages specified as workon packages are always built from source.
Dependencies of workon packages are also built from source.

Dependencies are calculated with --selective=n so that workon packages will be included in the install list. Packages that are not being worked on and are being unnecessarily replaced because of --selective=n are filtered out later.

This patch also fixes a bug with world file updating -- previously the world file was never updated because the packages were getting removed by RemoveInstalledPackages. We now keep the appropriate world file updates, and instead update SanitizeTree to handle world file updates without trouble.

I also optimized the cycle cracking algorithm so that it only visits each node once. This seems to improve run time significantly on graphs that have cycles.

TEST=Ran ./parallel_emerge -uDNvpg --board=x86-generic chromeos --workon=chromeos-chrome &&
         ./parallel_emerge -uDNvpg --board=x86-generic chromeos --workon=libcros &&
         ./parallel_emerge -uDNvpg world --workon=libxml2 &&
         ./parallel_emerge -uDNv -p world hard-host-depends --workon='bcel'
BUG=none

Review URL: http://codereview.chromium.org/2959006
2010-07-12 23:44:10 -07:00
Zelidrag Hornung
42ca818d3b fixed vm scripts
Review URL: http://codereview.chromium.org/2973005
2010-07-12 18:08:44 -07:00
David McMahon
464ae31739 Created branch 0.7.54.B. Update CHROMEOS_VERSION_BRANCH=55
Change-Id: Ib8374af3729a2660e28a78df1ee9b93d0556e7e9
2010-07-12 16:15:05 -07:00
Zdenek Behan
a5959f5c14 cros_workon: allow unmasking packages for the host
modified:   cros_workon

Review URL: http://codereview.chromium.org/2945010
2010-07-12 15:40:49 -07:00
Tan Gao
ffbe06d6d1 remove update_engine flag from start_devserver
Change-Id: Ie54dcad3e12b51272f05dbb5f2de5bfb994c6f90

Review URL: http://codereview.chromium.org/2897011
2010-07-12 15:22:53 -07:00
Denis Romanov
95bdf47a1a Added command line parameter to specify OEM content location.
Added populating OEM partner partition with content.
Added creating flag file .consider_oobe for OEM partition to get mounted on OOBE.

BUG=http://crosbug.com/3828
TEST=Install Chrome OS on the device from USB stick. /mnt/partner_partition contains etc/... directory with customization manifests on first boot.

Review URL: http://codereview.chromium.org/2938003
2010-07-12 22:44:42 +04:00
Mandeep Singh Baines
87b169428f build_image: modify to not get devkeys from vboot_reference checkout
An earlier CL modifies the vboot_reference ebuild to install the
keys into /usr/share/vboot.

TEST=verified that build_image fails without this change and no
vboot_reference checkout but succeeds with this change and no
vboot_reference checkout

Change-Id: Ie2bc1091b52c36fd56cd5f763ee275afc91765c3

Review URL: http://codereview.chromium.org/2896008
2010-07-09 20:52:41 -07:00
Gaurav Shah
561be04e50 Add a script to re-sign Chrome OS images with keys of our choosing.
Currently the output of build_image signs the kernel partition with the recovery keys on the final image. This script allows us to replace the kernel vblock and resign the kernel with the right set of keys (for example, using the normal boot path kernel keys, or the keys for factory install, etc.)

BUG=4623
TEST=Tested by running the script on one of the latest builbot images (801) and resigning with test kernel keys. The resulting image was dd-ed off to an SSD and was succesfully able to boot on one of our dev systems with our custom firmware with both dev mode and recovery mode turned off.

To test (can do outside chroot):

1) Download the latest image from the buildbot (I used build 801)
2) Run script with the following arguments and paths adjusted below

resign_image
 --from /path/to/chromiumos_image.bin \
 --datakey /path/to/vboot_reference/tests/devkeys/kernel_data_key.vbprivk \
 --keyblock /path/to/vboot_reference/tests/devkeys/kernel.keyblock \
 --vsubkey /path/to/vboot_reference/tests/devkeys/kernel_subkey.vbpubk \
 --vbutil_dir /path/to/vbutil/binaries
 --to image.out

This re-signs the image with the normal test keys (instead of recovery as done by build_image)

3) Copy the image to an SSD drive

dd if=image.out of=/dev/ssd [replace with the correct device]

4) Boot with the latest custom firmware in normal mode (recovery and dev mode turned off).
5) Profit!

Review URL: http://codereview.chromium.org/2938004
2010-07-09 18:33:39 -07:00
Zdenek Behan
9a8f3998f0 cros_workon: also create unmask
* This fixes the issue, where cros-workon packages have a package.mask set
to prevent upstream ebuilds from rolling in. In general, it brings out the
cavalry for unmasking the live package in every possible way.

Review URL: http://codereview.chromium.org/2934007
2010-07-09 18:08:46 -07:00
Chris Masone
3adf3f71e9 replace test -n ... && clauses with proper ifs
The version of this using test -n syntax didn't work in my chroot.

Review URL: http://codereview.chromium.org/2951007
2010-07-09 16:44:18 -07:00
Will Drewry
07e350578b build_image: enable syslinux installation for x86
Adds the --install_syslinux to the update_bootloaders call for x86.

BUG=chromium-os:2693
TEST=build_image with both tegra2 and x86-generic in progress. Doesn't affect actual booting until we change the active gpt boot partition.

Review URL: http://codereview.chromium.org/2911003
2010-07-09 14:50:42 -07:00
Mandeep Singh Baines
f9acd8e3d3 get_svn_repos.sh: remove repos that are no longer needed
This change removes svn repos which have had their ebuild modified
to use the subversion eclass. This repos have already been removed
from the DEPS file.

Change-Id: I290d0bc6e401511abb7d637d83fe2d6961851aa9

Review URL: http://codereview.chromium.org/2899013
2010-07-09 13:27:14 -07:00
Will Drewry
1670d481a1 build_image, build_kernel_image, legacy_bootloaders: Rename vboot flags
The use_vboot and vboot_ flags were confusing from a functionality perspective
since verified boot as a feature encompasses firmware and kernel functionality.
The firmware bits are always enabled, but use_vboot enabled the image-integrity
portion of vboot.  It is not called
  --enable_rootfs_verification
and all options for the kernel functionality is under --verity_* given that
verity/dm-verity is the current working name for the module and userspace tool.

TEST=ran x86-generic build_image & tegra2-dev-board build_image and checked the resulting boot.config files (with and without --enable_rootfs_verification).
BUG=chromium-os:2693

Review URL: http://codereview.chromium.org/2917008
2010-07-09 13:08:38 -07:00
Ken Mixter
10b62483ec Use hard host depends emerged breakpad binaries
BUG=3437

Review URL: http://codereview.chromium.org/2873037
2010-07-09 12:55:47 -07:00
David James
fd7403ab89 Revert "Use --fast by default in build_image when --jobs is enabled."
See if this fixes the symlink problems we've been running into.

This reverts commit 8edffbaec5.
2010-07-09 12:00:17 -07:00
Chris Sosa
54d8baacc0 Make generate_test_reports a symlink to the py file so it can be imported.
TEST=Ran archive_build with --official-build and test_mod set.

Review URL: http://codereview.chromium.org/2951003
2010-07-09 10:46:53 -07:00
Olof Johansson
2e1f24ba3e parallel_emerge: print total time and load in status output
TEST=run build_packages/build_image
BUG=none

Review URL: http://codereview.chromium.org/2946003
2010-07-09 12:20:32 -05:00
Rahul Chaturvedi
b5643e8bf6 Final set of VM scripts - integrated with changes from Zelidrag to create a test image if specified.
Integrated comments from http://codereview.chromium.org/2604001/show
[the git repository that commit was on was deleted and replaced, hence this new commit]

Review URL: http://codereview.chromium.org/2803015
2010-07-09 10:46:05 +05:30
David James
8edffbaec5 Revert "Revert "Use --fast by default in build_image when --jobs is enabled.""
parallel_emerge prints a message every 30 seconds now so that buildbot doesn't
kill us early. Per discussion with cmasone, reverting the revert.

This reverts commit debaa3d8cf.
2010-07-08 21:21:41 -07:00
David James
37f50a00e6 Print status every 30 seconds so that buildbot doesn't kill us.
TEST=Ran CHROME_ORIGIN=SERVER_SOURCE ./parallel_emerge chromeos-chrome
BUG=none

Review URL: http://codereview.chromium.org/2924008
2010-07-08 21:14:03 -07:00