Commit Graph

4592 Commits

Author SHA1 Message Date
Chris Sosa
2566c3fc3c Adding --desc_from_logs option from git cl upload
TEST=Tested git cl upload --desc_from_logs -m "Message" in http://codereview.chromium.org/3027010/show

Review URL: http://codereview.chromium.org/3048005
2010-07-21 12:19:08 -07:00
Will Drewry
78992a33f4 build_image, build_kernel_image, update_bootloaders: fix up rootfs_verification
This change adds
- --rootfs_hash_pad to specify the MBs reserved for the pad
- the implementation of the above flag
- check if total fs size + pad size exceeds the partition size
- hash appending in make_image_bootable()

Fixes:
- a style for ROOT_FS_HASH usage
- bad mount|grep
- bad bash subst for root devices in all boot paths
- fixed a typo in the update_bootloaders table creation
- disables verified usb for now

Adding the padding argument ensures that the generated hash tree for the root filesystem is appended to the image.  Assuming the rootfs is _never_ mounted read-write
again, that hash tree will be valid and vboot will be able to proceed.

BUG=chromium-os:2693
TEST=manual build_image

Review URL: http://codereview.chromium.org/3043011

Change-Id: I67d9b0f91cacdefa309c0cc2dd7fed1d2eddd7a7
2010-07-21 14:02:20 -05:00
Rahul Chaturvedi
e79e88eb0e Changes to use the postinst --esp-part-file flag; postinst fixups removed
Added the flags required for mounted images to the postinst call.
Scripts no longer need to fixup postinst hence that code is removed.

Review URL: http://codereview.chromium.org/3027012
2010-07-21 02:04:59 +05:30
David James
dd059edd58 Integrate parallel_emerge with emerge, boosting performance.
Instead of loosely wrapping emerge, parallel_emerge now integrates tightly with emerge. This boosts performance while allowing us to map dependencies more accurately.

With this change, build_image --fast can clock under 4 minutes, and build_packages --fast now clocks as low as 4:30. With the --rebuild option, build_packages takes 5:30, but it has the big benefit of producing actually-correct results.

Note that this change also depends on us updating the various build scripts to prefix
calls to parallel_emerge with sudo -E.

TEST=Ran several parallel_emerge test cases, build_packages --fast, and
     build_image --fast
BUG=none

Review URL: http://codereview.chromium.org/2891013
2010-07-20 11:21:23 -07:00
David James
b44b04d0f9 Update mod_image_for_test to support --fast option.
Added --fast option. Updated the one place that wasn't using sudo when calling
emerge to use sudo like the others. This is safe because we're merging with
--usepkgonly.

TEST=Ran mod_image_for_test.sh with and without the --fast options
BUG=none

Review URL: http://codereview.chromium.org/2834055
2010-07-20 00:36:32 -07:00
David McMahon
21fd22e1b1 Created branch 0.8.60.B. Update CHROMEOS_VERSION_BRANCH=61
Change-Id: I724a2f805f237ef4b7e102b6011603dbe7450462
2010-07-19 17:22:54 -07:00
David McMahon
ce4eccfbc6 Created branch 0.8.58.B. Update CHROMEOS_VERSION_BRANCH=59
Change-Id: Iec03956393563287d742a9ebc65998589c8b3a88
2010-07-19 15:01:56 -07:00
Chris Sosa
db51f31139 Add wrapper script to get list of updates to pass to stablizing script without other changes
TEST=Ran script

Review URL: http://codereview.chromium.org/3034011
2010-07-19 11:57:31 -07:00
Chris Sosa
a5e394704d Create common script file for workon tools. Planning on using in another CL.
Review URL: http://codereview.chromium.org/3022010
2010-07-19 11:50:11 -07:00
Chris Sosa
92d3779dff Return error when error occurs by raising exception
Review URL: http://codereview.chromium.org/2819052
2010-07-19 11:12:20 -07:00
Paul Stewart
90f689c2d3 Pack and unpack scripts switched to bash
The "[[ ... ]]" syntax is bash-specific.  Reflect this by changing shbang to "#!/bin/bash".  Many of our dev systems symlink "/bin/sh" to "/bin/bash" which has masked this problem for a long time, but "real" sh fails on "[[".

BUG=none
TEST=rerun

Review URL: http://codereview.chromium.org/2825050
2010-07-19 10:37:06 -07:00
Tan Gao
7ead6c4fa1 issue 2825046
Change-Id: I8eb21d76e75f97270596907fb309b81e8b6c8d2e

Review URL: http://codereview.chromium.org/3007005
2010-07-19 10:12:37 -07:00
Tom Wai-Hong Tam
ab3682d570 If qualified components not specified, use the one based on board name.
Review URL: http://codereview.chromium.org/2965013
2010-07-19 00:22:42 +08:00
Zdenek Behan
47d039a48c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

Reintroduces commit dc3359ba7c, with fixed list cmd

Review URL: http://codereview.chromium.org/3022003
2010-07-16 16:05:14 -07:00
Paul Stewart
cfe2a1960c Fix move of shflags
BUG=verbal
TEST=Reran script

Review URL: http://codereview.chromium.org/3010008
2010-07-16 15:14:51 -07:00
Raymes Khoury
cd29fd7a91 Build Chromium browser source as part of sync_build_test.sh
Added --chrome_root option to sync_build_test.sh which, if specified, builds Chromium browser from source in the directory given.

Review URL: http://codereview.chromium.org/2824054
2010-07-16 15:11:42 -07:00
Chris Sosa
16caaf0c7d Adds remaining functions to cros_mark_as_stable and cleaned up error messaging.
TEST=Tested with following workflow:
cros_mark_as_stable -p 'crash-reporter' -i 'boogabooga' commit
cros_mark_as_stable push
cros_mark_as_stable clean

Also passed in some real options for push_options in a branch that had nothing in it.

Review URL: http://codereview.chromium.org/3017002
2010-07-16 15:04:26 -07:00
Will Drewry
721d94f429 build_image,update_bootloaders: directly update the built image
Instead of playing mount and loop device games, this change adds support for
update_bootloaders.sh to directly update the EFI system partition living in the
image if a file, offset, and size is supplied.

TEST=build_image for x86-generic; booted resulting image
BUG=broken build

Change-Id: I3d891fd965df6fb4abfc63d660e314c497a4184d

Review URL: http://codereview.chromium.org/3006006
2010-07-16 14:39:45 -05:00
Andrew de los Reyes
3172b7e296 build_image: add temporary hack to fix syslinux building.
Will Drewry is working on the proper fix, but this unblocks people who
build images that boot w/ syslinux.

Review URL: http://codereview.chromium.org/3009003
2010-07-15 22:10:47 -07:00
David James
21d93ccac3 Revert "cros-workon: change forall into iterate"
This breaks cros-workon list, which is used by build_packages.

This reverts commit dc3359ba7c.

Review URL: http://codereview.chromium.org/3008005
2010-07-15 20:37:23 -07:00
David James
677d9c9b6c Fix parallel_emerge --unmerge to actually work.
When we run custom actions in parallel_emerge, we should pass the list of
packages on to emerge. Otherwise emerge won't know what packages to unmerge.

Besides the above, also fix an issue where --workon doesn't override
--getbinpkgonly or --usepkgonly.

TEST=Ran parallel_emerge --unmerge dhcpd and parallel_emerge --usepkgonly --board=x86-generic
     --workon=power_manager power_manager
BUG=none

Review URL: http://codereview.chromium.org/2927013
2010-07-15 19:32:36 -07:00
David McMahon
9f463ccf38 Created branch 0.8.56.B. Update CHROMEOS_VERSION_BRANCH=57
Change-Id: I8650a88dc8a88321dffe9d246298bc12edca6b9c
2010-07-15 17:03:01 -07:00
David McMahon
6d9d7a61e3 Update Minor version to 8 - this should have happened after R7
Review URL: http://codereview.chromium.org/3038003
2010-07-15 16:37:06 -07:00
Zdenek Behan
dc3359ba7c cros-workon: change forall into iterate
* Bend iterate to accept either list of packages or --all, following the new
semantics

This is a re-upload of the original CL which seems to be broken beyond repair
by the git malfunctions yesterday

Review URL: http://codereview.chromium.org/3040001
2010-07-15 16:13:00 -07:00
Kelly Lucas
ee04e47a48 TBR: reviewed at: http://codereview.chromium.org/3001002/show 2010-07-15 15:47:52 -07:00
Zdenek Behan
d27f9039b5 cros_workon: fix forall (broken by --host) :/
Review URL: http://codereview.chromium.org/2966016
2010-07-15 15:41:52 -07:00
Paul Stewart
335a8eb131 Add copyright and script description
BUG=none
TEST=Reran script looking for syntax errors

Review URL: http://codereview.chromium.org/2958009
2010-07-15 15:34:18 -07:00
Paul Stewart
bfe72ce842 Wrapper script around run_remote_tests that knows about test cells
This is a first pass.  I'll review this code myself and do more
testing, but I wanted to get folks a look at it to make sure I
was going in the right direction.

BUG=none
TEST=ran using both cell and hostname scenarios

Review URL: http://codereview.chromium.org/3007002
2010-07-15 15:32:46 -07:00
Anush Elangovan
bd30076470 Enable get_svn_repos.sh to be run from src/scripts/. This script will be killed as soon as the autotest ebuild is fixed.
Change-Id: I7ddb0152d62a41b53c363c7363d13e7324e5ef55

Review URL: http://codereview.chromium.org/3019002
2010-07-15 15:19:04 -07:00
David James
ba2d887695 Fix parallel_emerge to handle "=" and "." in package names. Both can occur.
TEST=parallel_emerge --board=x86-generic -g =app-arch/bzip2-1.0.5-r1 =chromeos-base/power_manager-0.0.1 =dev-libs/expat-2.0.1-r3 =x11-libs/xtrans-1.2.5 =chromeos-base/google-breakpad-598-r2 =sys-libs/zlib-1.2.3-r1 =x11-proto/kbproto-1.0.4 =sys-libs/ncurses-5.7-r3 =x11-proto/xproto-7.0.16 =app-admin/eselect-python-20091230 =chromeos-base/kernel-headers-0.0.1-r1 =virtual/libintl-0
BUG=none

Review URL: http://codereview.chromium.org/2937011
2010-07-15 14:55:05 -07:00
Zdenek Behan
9f52b31150 cros_workon: introduce --all flag
* Replaced listall with list --all
* stop/start without arguments will now fail
* stop/start with --all will do just the expected thing
* Rewritten package list decision logic

TBR: msb - already got LGTM, then fixed a comment i noticed

Review URL: http://codereview.chromium.org/2963011
2010-07-14 15:47:09 -07:00
Rahul Chaturvedi
e770e16379 Resize stateful partition flag
Added flag to resize stateful partition that we put onto the VM image.

Review URL: http://codereview.chromium.org/2964011
2010-07-15 00:35:11 +05:30
Zelidrag Hornung
478a0d44a4 Renamed VM image to match naming convention of other images.
Review URL: http://codereview.chromium.org/2955014
2010-07-14 11:47:39 -07:00
Zdenek Behan
8683b8082f cros_workon: introduce a very simple listall command
TBR: sosa, msb - I already got the LGTM, then made a silly whitespace change!

Review URL: http://codereview.chromium.org/2909009
2010-07-13 16:48:12 -07:00
Allen Martin
07bfc7aa9d Separate out additional cmd line args to chroot
This fix separates out any additional command line arguments given to
the enter_chroot.sh script when passed to the interior chroot.  This
allows one to pass environment variable settings to the interior
chroot shell such as:

./enter_chroot.sh -- CHROME_ORIGIN=LOCAL_SOURCE emerge-x86-generic ...

Before this fix any of these variable settings will be sucked up by
the shell launching the chroot, not the interior shell.

BUG=chromium-os:2457
TEST=ran test cases detailed in bug report

Review URL: http://codereview.chromium.org/2855034
2010-07-13 15:44:59 -07:00
Chris Sosa
bebf3798e5 First cut at stable script
TEST=Tested by using crash-reporter and crash_ids set to "12345"

Review URL: http://codereview.chromium.org/2873016
2010-07-13 15:34:11 -07:00
Anush Elangovan
2c7d19693e Move shflags into crosutils.git
Change-Id: I3aa6275362910addfaa25db9a1578a5496019c9e

Review URL: http://codereview.chromium.org/2983005
2010-07-13 15:24:54 -07:00
Zdenek Behan
2089bed7b8 cros_workon: check selected packages if they are cros-workon, related fixes
Override locally warn/error functions to not interfere with stdout of canonicalize_name.
Future FIXME in common.sh.

Review URL: http://codereview.chromium.org/2985003
2010-07-13 15:08:07 -07:00
Zdenek Behan
aefb186237 cros_workon: corner case fixes
* Warn if user stops working on a package he wasn't working on
* Warn if user starts to work on a package he already is working on

Review URL: http://codereview.chromium.org/2978002
2010-07-13 13:31:44 -07:00
Paul Stewart
b3f323ed73 Clean up command line arguments and user output
Clean up command-line argument used to disable re-download of image bits down to the upgrade server.  This is now handed via a much more concise "--no_copy_archive" argument.  and user output output "fast restart" messages

Output information on how to run the "image_to_live.sh" client unconditionally (even if a client isn't being launched by this instance).

BUG=none
TEST=Reran commands, observed output

Review URL: http://codereview.chromium.org/2919009
2010-07-13 09:07:18 -07:00
Paul Stewart
bd2871a43a Fix duplicate sever-port bug
cros_copy_upgrade_server had a bug where it would always start servers
on port 8081 regrdless of whether that port was free.  This was a bug
in the "get next free port" code.

BUG=chromium-os:4776
TEST=Reran multiple instances at once, run netstat -nlt

Review URL: http://codereview.chromium.org/2975006
2010-07-13 07:59:15 -07:00
Tan Gao
8ae113bb42 remove handling of kernel verification block from recovery image
Change-Id: I749dc652651fdb02b49b290863e2fa9adc6b904e

Review URL: http://codereview.chromium.org/2948005
2010-07-13 07:04:48 -07:00
David James
dc07fb27e4 Teach parallel_emerge to uninstall packages.
Currently, parallel_emerge doesn't know how to handle uninstall actions, so it
actually installs packages when it should be uninstalling them. This patch
fixes that.

TEST=sudo ./parallel_emerge -uDNv hard-host-depends, and make sure it
     uninstalls nih-dbus-tool, which is blocked by hard-host-depends
BUG=none

Review URL: http://codereview.chromium.org/2990001
2010-07-13 00:33:20 -07:00
David James
b9ad46e9f7 Update parallel_emerge to support --workon.
Packages specified as workon packages are always built from source.
Dependencies of workon packages are also built from source.

Dependencies are calculated with --selective=n so that workon packages will be included in the install list. Packages that are not being worked on and are being unnecessarily replaced because of --selective=n are filtered out later.

This patch also fixes a bug with world file updating -- previously the world file was never updated because the packages were getting removed by RemoveInstalledPackages. We now keep the appropriate world file updates, and instead update SanitizeTree to handle world file updates without trouble.

I also optimized the cycle cracking algorithm so that it only visits each node once. This seems to improve run time significantly on graphs that have cycles.

TEST=Ran ./parallel_emerge -uDNvpg --board=x86-generic chromeos --workon=chromeos-chrome &&
         ./parallel_emerge -uDNvpg --board=x86-generic chromeos --workon=libcros &&
         ./parallel_emerge -uDNvpg world --workon=libxml2 &&
         ./parallel_emerge -uDNv -p world hard-host-depends --workon='bcel'
BUG=none

Review URL: http://codereview.chromium.org/2959006
2010-07-12 23:44:10 -07:00
Zelidrag Hornung
42ca818d3b fixed vm scripts
Review URL: http://codereview.chromium.org/2973005
2010-07-12 18:08:44 -07:00
David McMahon
464ae31739 Created branch 0.7.54.B. Update CHROMEOS_VERSION_BRANCH=55
Change-Id: Ib8374af3729a2660e28a78df1ee9b93d0556e7e9
2010-07-12 16:15:05 -07:00
Zdenek Behan
a5959f5c14 cros_workon: allow unmasking packages for the host
modified:   cros_workon

Review URL: http://codereview.chromium.org/2945010
2010-07-12 15:40:49 -07:00
Tan Gao
ffbe06d6d1 remove update_engine flag from start_devserver
Change-Id: Ie54dcad3e12b51272f05dbb5f2de5bfb994c6f90

Review URL: http://codereview.chromium.org/2897011
2010-07-12 15:22:53 -07:00
Denis Romanov
95bdf47a1a Added command line parameter to specify OEM content location.
Added populating OEM partner partition with content.
Added creating flag file .consider_oobe for OEM partition to get mounted on OOBE.

BUG=http://crosbug.com/3828
TEST=Install Chrome OS on the device from USB stick. /mnt/partner_partition contains etc/... directory with customization manifests on first boot.

Review URL: http://codereview.chromium.org/2938003
2010-07-12 22:44:42 +04:00
Mandeep Singh Baines
87b169428f build_image: modify to not get devkeys from vboot_reference checkout
An earlier CL modifies the vboot_reference ebuild to install the
keys into /usr/share/vboot.

TEST=verified that build_image fails without this change and no
vboot_reference checkout but succeeds with this change and no
vboot_reference checkout

Change-Id: Ie2bc1091b52c36fd56cd5f763ee275afc91765c3

Review URL: http://codereview.chromium.org/2896008
2010-07-09 20:52:41 -07:00