Commit Graph

2152 Commits

Author SHA1 Message Date
Chris Sosa
b28538692c Need $ on same line to not eval hash as command in bash
TEST=Re-ran script and saw new changes.

Review URL: http://codereview.chromium.org/3032021
2010-07-23 16:59:50 -07:00
Nick Sanders
409703715b The current rekeying command is probably too complicated for ODMs to be happy with. I've added a script that wraps this.
I'd be OK just setting the defaults in the original command as well.

BUG=4246
TEST=ran it and image booted in normal mode.

Review URL: http://codereview.chromium.org/3008021
2010-07-23 16:55:28 -07:00
Will Drewry
4f0a7f6ef1 create_legacy_bootloader_templates: re-enable chromeos-vusb with --enable-rootfs_verification
This change can land once the kernel support for dm device waiting and
the chromeos-installer changes land and their ebuilds are rev'd.

TEST=build_image --enable_rootfs_verification; booted to a verified image!
BUG=chromium-os:2963

Change-Id: Ia68f90a59ab1360da01d5f422c16178af16cbaeb

Review URL: http://codereview.chromium.org/3013028
2010-07-23 12:33:57 -05:00
Olof Johansson
e07324f53c don't use qemu on x86 for mod_image_for_test
BUG=none
TEST=run mod_image_for_test on x86. Watch it fail. D'oh.

Review URL: http://codereview.chromium.org/3048017
2010-07-22 22:38:36 -05:00
Justin Neddo
6b5b16b8fe Generate fake root certs for autotest via qemu
mod_image_for_test.sh now passes the target architecture to the subscripts
mod_for_test_scripts/710enableAuthTesting generates the /etc/fake_root_cert
databases by running nsscertutil under QEMU.

BUG=3310
TEST=Built autotest enabled images for x86 and arm.  On arm, the browser no
longer crashes trying to read the fake root certs.

Review URL: http://codereview.chromium.org/2878033
2010-07-22 10:17:03 -05:00
Antoine Labour
2a58d0e610 fix toolchain location when using variants
BUG=None
TEST=run setup_board with a variant, run build_packages --fast

Review URL: http://codereview.chromium.org/3046009
2010-07-21 15:28:31 -07:00
Tom Wai-Hong Tam
a1feb99412 TBR: Issue 2861071: Fix name changed of init script dump-boot-stats.conf to boot-complete.conf.
A file name changed which breaks the factory test phase on the builders.

This change was LGTM'd but not submitted.
Patch from Tom Wai-Hong Tam <waihong@chromium.org>.

Change-Id: I961515ba4667891d82833035f2d312a653f746fd
2010-07-21 16:37:25 -05:00
David James
2be3f829e9 Fix infinite recursion in PrebuiltsReady when graph is cyclic.
Our package graph is cyclic, so parallel_emerge needs to handle cycles
correctly in all cases. PrebuiltsReady should only need to check each package
once, so we should set cache[pkg] to True if we found the package in the cache.

TEST=Ran build_packages --fast
BUG=none

Review URL: http://codereview.chromium.org/3047009
2010-07-21 14:17:05 -07:00
Will Drewry
9926ee2879 build_image: avoid losetup -c because older kernels seem to balk
Instead of resizing the loop device after adding padding for the
hash tree data.  Just ensure that the mkfs.ext3 call doesn't exceed
the rootfs size.

TEST=reran build_image on my lucid machine and checked the rootfs size; asked someone with hardy machine to test.
BUG=none

Change-Id: I59f95e1d17e35aca265bd44bb863da6069c05bd2

Review URL: http://codereview.chromium.org/3048009
2010-07-21 15:11:10 -05:00
Chris Sosa
a48a37af11 Remove support for old way of building and running unit tests
Review URL: http://codereview.chromium.org/3041012
2010-07-21 12:40:04 -07:00
Chris Sosa
2566c3fc3c Adding --desc_from_logs option from git cl upload
TEST=Tested git cl upload --desc_from_logs -m "Message" in http://codereview.chromium.org/3027010/show

Review URL: http://codereview.chromium.org/3048005
2010-07-21 12:19:08 -07:00
Will Drewry
78992a33f4 build_image, build_kernel_image, update_bootloaders: fix up rootfs_verification
This change adds
- --rootfs_hash_pad to specify the MBs reserved for the pad
- the implementation of the above flag
- check if total fs size + pad size exceeds the partition size
- hash appending in make_image_bootable()

Fixes:
- a style for ROOT_FS_HASH usage
- bad mount|grep
- bad bash subst for root devices in all boot paths
- fixed a typo in the update_bootloaders table creation
- disables verified usb for now

Adding the padding argument ensures that the generated hash tree for the root filesystem is appended to the image.  Assuming the rootfs is _never_ mounted read-write
again, that hash tree will be valid and vboot will be able to proceed.

BUG=chromium-os:2693
TEST=manual build_image

Review URL: http://codereview.chromium.org/3043011

Change-Id: I67d9b0f91cacdefa309c0cc2dd7fed1d2eddd7a7
2010-07-21 14:02:20 -05:00
Rahul Chaturvedi
e79e88eb0e Changes to use the postinst --esp-part-file flag; postinst fixups removed
Added the flags required for mounted images to the postinst call.
Scripts no longer need to fixup postinst hence that code is removed.

Review URL: http://codereview.chromium.org/3027012
2010-07-21 02:04:59 +05:30
David James
dd059edd58 Integrate parallel_emerge with emerge, boosting performance.
Instead of loosely wrapping emerge, parallel_emerge now integrates tightly with emerge. This boosts performance while allowing us to map dependencies more accurately.

With this change, build_image --fast can clock under 4 minutes, and build_packages --fast now clocks as low as 4:30. With the --rebuild option, build_packages takes 5:30, but it has the big benefit of producing actually-correct results.

Note that this change also depends on us updating the various build scripts to prefix
calls to parallel_emerge with sudo -E.

TEST=Ran several parallel_emerge test cases, build_packages --fast, and
     build_image --fast
BUG=none

Review URL: http://codereview.chromium.org/2891013
2010-07-20 11:21:23 -07:00
David James
b44b04d0f9 Update mod_image_for_test to support --fast option.
Added --fast option. Updated the one place that wasn't using sudo when calling
emerge to use sudo like the others. This is safe because we're merging with
--usepkgonly.

TEST=Ran mod_image_for_test.sh with and without the --fast options
BUG=none

Review URL: http://codereview.chromium.org/2834055
2010-07-20 00:36:32 -07:00
David McMahon
21fd22e1b1 Created branch 0.8.60.B. Update CHROMEOS_VERSION_BRANCH=61
Change-Id: I724a2f805f237ef4b7e102b6011603dbe7450462
2010-07-19 17:22:54 -07:00
David McMahon
ce4eccfbc6 Created branch 0.8.58.B. Update CHROMEOS_VERSION_BRANCH=59
Change-Id: Iec03956393563287d742a9ebc65998589c8b3a88
2010-07-19 15:01:56 -07:00
Chris Sosa
db51f31139 Add wrapper script to get list of updates to pass to stablizing script without other changes
TEST=Ran script

Review URL: http://codereview.chromium.org/3034011
2010-07-19 11:57:31 -07:00
Chris Sosa
a5e394704d Create common script file for workon tools. Planning on using in another CL.
Review URL: http://codereview.chromium.org/3022010
2010-07-19 11:50:11 -07:00
Chris Sosa
92d3779dff Return error when error occurs by raising exception
Review URL: http://codereview.chromium.org/2819052
2010-07-19 11:12:20 -07:00
Paul Stewart
90f689c2d3 Pack and unpack scripts switched to bash
The "[[ ... ]]" syntax is bash-specific.  Reflect this by changing shbang to "#!/bin/bash".  Many of our dev systems symlink "/bin/sh" to "/bin/bash" which has masked this problem for a long time, but "real" sh fails on "[[".

BUG=none
TEST=rerun

Review URL: http://codereview.chromium.org/2825050
2010-07-19 10:37:06 -07:00
Tan Gao
7ead6c4fa1 issue 2825046
Change-Id: I8eb21d76e75f97270596907fb309b81e8b6c8d2e

Review URL: http://codereview.chromium.org/3007005
2010-07-19 10:12:37 -07:00
Tom Wai-Hong Tam
ab3682d570 If qualified components not specified, use the one based on board name.
Review URL: http://codereview.chromium.org/2965013
2010-07-19 00:22:42 +08:00
Zdenek Behan
47d039a48c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

Reintroduces commit dc3359ba7c, with fixed list cmd

Review URL: http://codereview.chromium.org/3022003
2010-07-16 16:05:14 -07:00
Paul Stewart
cfe2a1960c Fix move of shflags
BUG=verbal
TEST=Reran script

Review URL: http://codereview.chromium.org/3010008
2010-07-16 15:14:51 -07:00
Raymes Khoury
cd29fd7a91 Build Chromium browser source as part of sync_build_test.sh
Added --chrome_root option to sync_build_test.sh which, if specified, builds Chromium browser from source in the directory given.

Review URL: http://codereview.chromium.org/2824054
2010-07-16 15:11:42 -07:00
Chris Sosa
16caaf0c7d Adds remaining functions to cros_mark_as_stable and cleaned up error messaging.
TEST=Tested with following workflow:
cros_mark_as_stable -p 'crash-reporter' -i 'boogabooga' commit
cros_mark_as_stable push
cros_mark_as_stable clean

Also passed in some real options for push_options in a branch that had nothing in it.

Review URL: http://codereview.chromium.org/3017002
2010-07-16 15:04:26 -07:00
Will Drewry
721d94f429 build_image,update_bootloaders: directly update the built image
Instead of playing mount and loop device games, this change adds support for
update_bootloaders.sh to directly update the EFI system partition living in the
image if a file, offset, and size is supplied.

TEST=build_image for x86-generic; booted resulting image
BUG=broken build

Change-Id: I3d891fd965df6fb4abfc63d660e314c497a4184d

Review URL: http://codereview.chromium.org/3006006
2010-07-16 14:39:45 -05:00
Andrew de los Reyes
3172b7e296 build_image: add temporary hack to fix syslinux building.
Will Drewry is working on the proper fix, but this unblocks people who
build images that boot w/ syslinux.

Review URL: http://codereview.chromium.org/3009003
2010-07-15 22:10:47 -07:00
David James
21d93ccac3 Revert "cros-workon: change forall into iterate"
This breaks cros-workon list, which is used by build_packages.

This reverts commit dc3359ba7c.

Review URL: http://codereview.chromium.org/3008005
2010-07-15 20:37:23 -07:00
David James
677d9c9b6c Fix parallel_emerge --unmerge to actually work.
When we run custom actions in parallel_emerge, we should pass the list of
packages on to emerge. Otherwise emerge won't know what packages to unmerge.

Besides the above, also fix an issue where --workon doesn't override
--getbinpkgonly or --usepkgonly.

TEST=Ran parallel_emerge --unmerge dhcpd and parallel_emerge --usepkgonly --board=x86-generic
     --workon=power_manager power_manager
BUG=none

Review URL: http://codereview.chromium.org/2927013
2010-07-15 19:32:36 -07:00
David McMahon
9f463ccf38 Created branch 0.8.56.B. Update CHROMEOS_VERSION_BRANCH=57
Change-Id: I8650a88dc8a88321dffe9d246298bc12edca6b9c
2010-07-15 17:03:01 -07:00
David McMahon
6d9d7a61e3 Update Minor version to 8 - this should have happened after R7
Review URL: http://codereview.chromium.org/3038003
2010-07-15 16:37:06 -07:00
Zdenek Behan
dc3359ba7c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

This is a re-upload of the original CL which seems to be broken beyond repair
by the git malfunctions yesterday

Review URL: http://codereview.chromium.org/3040001
2010-07-15 16:13:00 -07:00
Kelly Lucas
ee04e47a48 TBR: reviewed at: http://codereview.chromium.org/3001002/show 2010-07-15 15:47:52 -07:00
Zdenek Behan
d27f9039b5 cros_workon: fix forall (broken by --host) :/
Review URL: http://codereview.chromium.org/2966016
2010-07-15 15:41:52 -07:00
Paul Stewart
335a8eb131 Add copyright and script description
BUG=none
TEST=Reran script looking for syntax errors

Review URL: http://codereview.chromium.org/2958009
2010-07-15 15:34:18 -07:00
Paul Stewart
bfe72ce842 Wrapper script around run_remote_tests that knows about test cells
This is a first pass.  I'll review this code myself and do more
testing, but I wanted to get folks a look at it to make sure I
was going in the right direction.

BUG=none
TEST=ran using both cell and hostname scenarios

Review URL: http://codereview.chromium.org/3007002
2010-07-15 15:32:46 -07:00
Anush Elangovan
bd30076470 Enable get_svn_repos.sh to be run from src/scripts/. This script will be killed as soon as the autotest ebuild is fixed.
Change-Id: I7ddb0152d62a41b53c363c7363d13e7324e5ef55

Review URL: http://codereview.chromium.org/3019002
2010-07-15 15:19:04 -07:00
David James
ba2d887695 Fix parallel_emerge to handle "=" and "." in package names. Both can occur.
TEST=parallel_emerge --board=x86-generic -g =app-arch/bzip2-1.0.5-r1 =chromeos-base/power_manager-0.0.1 =dev-libs/expat-2.0.1-r3 =x11-libs/xtrans-1.2.5 =chromeos-base/google-breakpad-598-r2 =sys-libs/zlib-1.2.3-r1 =x11-proto/kbproto-1.0.4 =sys-libs/ncurses-5.7-r3 =x11-proto/xproto-7.0.16 =app-admin/eselect-python-20091230 =chromeos-base/kernel-headers-0.0.1-r1 =virtual/libintl-0
BUG=none

Review URL: http://codereview.chromium.org/2937011
2010-07-15 14:55:05 -07:00
Zdenek Behan
9f52b31150 cros_workon: introduce --all flag
* Replaced listall with list --all
* stop/start without arguments will now fail
* stop/start with --all will do just the expected thing
* Rewritten package list decision logic

TBR: msb - already got LGTM, then fixed a comment i noticed

Review URL: http://codereview.chromium.org/2963011
2010-07-14 15:47:09 -07:00
Rahul Chaturvedi
e770e16379 Resize stateful partition flag
Added flag to resize stateful partition that we put onto the VM image.

Review URL: http://codereview.chromium.org/2964011
2010-07-15 00:35:11 +05:30
Zelidrag Hornung
478a0d44a4 Renamed VM image to match naming convention of other images.
Review URL: http://codereview.chromium.org/2955014
2010-07-14 11:47:39 -07:00
Zdenek Behan
8683b8082f cros_workon: introduce a very simple listall command
TBR: sosa, msb - I already got the LGTM, then made a silly whitespace change!

Review URL: http://codereview.chromium.org/2909009
2010-07-13 16:48:12 -07:00
Allen Martin
07bfc7aa9d Separate out additional cmd line args to chroot
This fix separates out any additional command line arguments given to
the enter_chroot.sh script when passed to the interior chroot.  This
allows one to pass environment variable settings to the interior
chroot shell such as:

./enter_chroot.sh -- CHROME_ORIGIN=LOCAL_SOURCE emerge-x86-generic ...

Before this fix any of these variable settings will be sucked up by
the shell launching the chroot, not the interior shell.

BUG=chromium-os:2457
TEST=ran test cases detailed in bug report

Review URL: http://codereview.chromium.org/2855034
2010-07-13 15:44:59 -07:00
Chris Sosa
bebf3798e5 First cut at stable script
TEST=Tested by using crash-reporter and crash_ids set to "12345"

Review URL: http://codereview.chromium.org/2873016
2010-07-13 15:34:11 -07:00
Anush Elangovan
2c7d19693e Move shflags into crosutils.git
Change-Id: I3aa6275362910addfaa25db9a1578a5496019c9e

Review URL: http://codereview.chromium.org/2983005
2010-07-13 15:24:54 -07:00
Zdenek Behan
2089bed7b8 cros_workon: check selected packages if they are cros-workon, related fixes
Override locally warn/error functions to not interfere with stdout of canonicalize_name.
Future FIXME in common.sh.

Review URL: http://codereview.chromium.org/2985003
2010-07-13 15:08:07 -07:00
Zdenek Behan
aefb186237 cros_workon: corner case fixes
* Warn if user stops working on a package he wasn't working on
* Warn if user starts to work on a package he already is working on

Review URL: http://codereview.chromium.org/2978002
2010-07-13 13:31:44 -07:00
Paul Stewart
b3f323ed73 Clean up command line arguments and user output
Clean up command-line argument used to disable re-download of image bits down to the upgrade server.  This is now handed via a much more concise "--no_copy_archive" argument.  and user output output "fast restart" messages

Output information on how to run the "image_to_live.sh" client unconditionally (even if a client isn't being launched by this instance).

BUG=none
TEST=Reran commands, observed output

Review URL: http://codereview.chromium.org/2919009
2010-07-13 09:07:18 -07:00