Commit Graph

25366 Commits

Author SHA1 Message Date
Paul Stewart
e45157fe07 Temporarily clear noexec flag on /var if set
The "emerge" process sometimes copies files to /var/tmp
and then run it.  Recent changes to images set the
"noexec" flag on /var, thus preventing such activities.
Temporarily clear this flag from within cros_package_to_live.

BUG=none
TEST=Manually set noexec on /var and run cros_package_to_live

Review URL: http://codereview.chromium.org/3739001
2010-10-12 14:25:02 -07:00
Chris Sosa
e695541bc6 Hide errors until builder succeeds.
Change-Id: Ifb40e4931c1b0a1d32051d1d4851bca572ef3acf

BUG=7649
TEST=Ran it with fake urls

Review URL: http://codereview.chromium.org/3678004
2010-10-12 11:07:28 -07:00
Chris Sosa
4bec3be90b Gets image_to_live to work with a custom devserver_port
BUG=
TEST=Ran image_to_live using port 9090

Review URL: http://codereview.chromium.org/3646005

Change-Id: I2a7086ec46f4e1f221ca4dd22f636d53708a88a1
2010-10-11 19:50:10 -07:00
Scott Zawalski
96619e72e1 Update RemoteUpload to return a set Update if failed_uploads to check deeper
in the returned set to see if it is a bonified failure

BUG=NA
TEST=Local run to verify

Review URL: http://codereview.chromium.org/3667005
2010-10-11 15:31:53 -07:00
David James
807d018656 Update all ebuilds to point to a branch or tag.
Mark all ebuilds in chromiumos-overlay and chromeos-overlay as stable and
point them at the current version we have checked out.

This is useful in case we want to verify that all ebuilds are pointing at the
right commit hash when we are doing a build on a branch. It is intended to be
used prior to tagging and can be used instead of a preflight queue. It is an
alternative to cros_mark_all_as_stable that does not require a chroot and
does not increase the revision number on ebuilds.

Unlike cros_mark_all_as_stable, which only updates the latest stable ebuild
for a given board, this script updates all stable ebuilds for all boards,
including unused stable ebuilds. We do this for the sake of simplicity
because it's hard to know in advance which ebuilds are truly unused, and it
shouldn't hurt to update unused ebuilds.

This script does not support cros_mark_as_stable_blacklist. If there are any
packages in the blacklist, this script exits with an error message.

TEST=Ran this script to point power_manager at branch and tested that we
     built power_manager from the branch.
BUG=chromium-os:7218, chromium-os:6429

Change-Id: Ib2308806c5a4db979b1245a90407fd5b6353e4fd

Review URL: http://codereview.chromium.org/3607014
2010-10-11 15:04:08 -07:00
Will Drewry
32d8c11747 build_image & make_bootable: allow additional kernel cmdline args
In order to more easily test kernel commandline tweaks, ensure that
--boot_args is propagated to all kernel cmdline sinks.

This is useful for changing default schedulers and any other kernel argument
tweaks we may want to quickly test out.

TEST=build and tested x86-generic
BUG=none

Change-Id: I5138755aa8c5e32e7f117f18291d2ae197e95bef

Review URL: http://codereview.chromium.org/3644004
2010-10-11 15:37:17 -05:00
David James
3a4a6bbfb9 Update cros_mark_as_stable_unittest.py to pass again.
cros_mark_as_stable.py was updated on Sep 8, but the unit test was not updated
to match. This patch fixes the unit test.

BUG=chromium-os:7586
TEST=Ran unit test.

Change-Id: I283ef33e172a95efc41b4090dc4f67c9d84dd9a3

Review URL: http://codereview.chromium.org/3682003
2010-10-11 09:59:39 -07:00
Chris Sosa
020aa69f37 Fixes for cbuild to work with ctest.
1)  image_to_vm aborts because e2fschk requires a terminal to
be connected in order to check whether or not you want to repair the fs.  Since
we always want this to be true, set -p

2)  Clean up test harness to only verify the number of tests that passed on the
base image are the same on the update back to.  This is because older images
have many tests that fail.  I leave 10% as a reasonable number to pass.

3)  Redirect output from autotest in run_remote_tests to stderr so it gets
logged in a calling script that captures stdout.

Change-Id: If412274353683add20d136747113eb9c2bd41330

BUG=4690, 5533, 7287
TEST=Ran with internal tools for builders.

Review URL: http://codereview.chromium.org/3536018
2010-10-08 16:36:20 -07:00
Frank Swiderski
3a8f8eda47 This uncomments a remount line in chromeos_startup that mounts /home as exec, allowing autotest to run.
Change-Id: I51df060627770d88c219501bc628e91229ac0d42

BUG=7286
TEST=Boot in mod_for_test, home is mounted exec

Review URL: http://codereview.chromium.org/3529021
2010-10-08 15:41:14 -07:00
Tan Gao
e1e306566a Issue 6759: reduce size of stateful partition for non-developer recovery image
Change-Id: I636f3156e549508230515174edffaff650c9d46e

BUG=chromium-os:6759
TEST=(1)manually built a non-developer recovery image and verified recovery install
completes on an agz device and the device is able to boot from HD upon reboot
(2) repeat for a developer recovery image and verified dev image from dev_payload is installed onto target and the target is able to boot from HD

Review URL: http://codereview.chromium.org/3391018
2010-10-08 15:22:51 -07:00
Chris Sosa
d76a917edb Add a simple wrapper script around vm lib to start a vm.
Change-Id: Ic3238b3063d0e889c424ff6a9792d9c0f6bebca1

BUG=
TEST=Ran it

Review URL: http://codereview.chromium.org/3628002
2010-10-07 23:20:20 -07:00
Andrew de los Reyes
45c24df9a3 AU update generator script: support for new style full updates
A corresponding CL adds support for the delta generator to generate
new style full updates. This CL adds support for creating new style
full updates to the common update payload generator script.

This does not change the defaults, so generating a full update still uses
the old style.

BUG=7248
TEST=generated/applied full update on host

Review URL: http://codereview.chromium.org/3604011
2010-10-07 19:57:12 -07:00
Hung-Te Lin
7e366a5ed3 crosutils: refine image_to_usb progress output and performance
Adding "-B 4m" to balance pipe (+10% speed on some SD) and -b to make progress more readable.
Since the size report from pv (k=1024) and dd(k=1000) are different, we also disable dd's summary report to prevent confusion.

BUG=none
TEST=executed: ./image_to_usb.sh --from=... --to=/dev/sdX (ok)

Change-Id: I184c4ce2d9a8274079ddb26f0420ccf8f2a674dd

Review URL: http://codereview.chromium.org/3608013
2010-10-08 10:35:10 +08:00
Chris Sosa
4befe39060 Revert "Revert "Close tree when smoke bvt fails.""
This reverts commit 224f7548b5.

BUG=
TEST=

Review URL: http://codereview.chromium.org/3525022

Change-Id: Ib4e136b96a1d9dac7345598b281b053a47421e77
2010-10-07 19:04:05 -07:00
Ken Mixter
f5adf798f0 crosutils: Detect sym_upload errors by its stdout instead of return value
Change-Id: If649d355f3d9cb2650613e4eb6d34813216c0b61

BUG=7516
TEST=Change hardcoded URL to illegal URL and verify symbol sends fail

Review URL: http://codereview.chromium.org/3635001
2010-10-07 17:54:04 -07:00
Chris Sosa
33146728ef Add ability to vm library to retry until we can ssh into it.
Change-Id: I4de388bb1af6cd4568cdc154971927941eb73800

BUG=7503
TEST=Ran test by closing vm's as they start up to see retry work.

Review URL: http://codereview.chromium.org/3598019
2010-10-07 15:58:24 -07:00
Ken Mixter
5f53e5e732 crosutils: Fix verify bug with image_to_live without args
Change-Id: I0bcc3dbbf72fbae4bfa11340831d60d28202bb88

BUG=
TEST=Ran with just --remote=... to pick up latest image and it verified.

Review URL: http://codereview.chromium.org/3609003
2010-10-07 13:19:19 -07:00
Scott Zawalski
e69a464192 Add an absolute path to gsutil that we will be using.
Change the way uploads work so we error if one doesn't sync properly.
2010-10-07 12:53:32 -07:00
Scott Zawalski
13f82d8da1 Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-10-07 12:20:15 -07:00
Chris Sosa
d8f50a931f Propagate return code correctly from tests.
Change-Id: I28c5f3e48646ec24813ef86f4cd16aac120cba5b

BUG=
TEST=Introduced artificial bug and checked return code
from test.

Review URL: http://codereview.chromium.org/3593010
2010-10-07 11:24:28 -07:00
Chris Sosa
224f7548b5 Revert "Close tree when smoke bvt fails."
This reverts commit d9bbe8792f.

TBR=Open tree.

Change-Id: I2d81711e4f995dbe025b7ed5f99fb4e4f7aba1c8
2010-10-06 17:40:51 -07:00
Chris Sosa
24680f0059 Add ability to test machines with au test harness.
Change-Id: I913acd95c49b1cf0fd666b49fb5ec1e24f0f83d1

BUG=7285
TEST=Ran through test against with two test images.

Review URL: http://codereview.chromium.org/3619009
2010-10-06 16:56:56 -07:00
Andrew de los Reyes
db0fa3f9ac AU Payload Generator: allow extracting kernel/rootfs for debugging
BUG=7427
TEST=verified old style full and delta updates work

Review URL: http://codereview.chromium.org/3582016
2010-10-06 16:54:16 -07:00
David McMahon
83935df893 Created branch 0.9.78.B. Update CHROMEOS_VERSION_BRANCH=79
Change-Id: I2151e1cacc86b1e6282c4117cf6e7cf36df5db4c
2010-10-06 16:45:14 -07:00
Chris Sosa
2cc5cd4155 Add ctest that calls the au test harness.
Change-Id: Ief14528b7e98d792da4be39976ff0fe48219f93b

BUG=6913
TEST=Ran image_to_vm, cros_au_test_harness, and ctest using internal urls.

Review URL: http://codereview.chromium.org/3606008
2010-10-06 14:29:45 -07:00
Will Drewry
52c40f8d35 build_image: fix verity defaults
This changes defaults failure to a panic/recovery reboot and
disables the debugging max_bios argument to ensure that we don't
trigger race conditions in the kernel during un-protected
pending_bio count decrements.  (Can lead to a hung-system.)

TEST=built x86-generic; ensured -1 and the panic changes worked
BUG=chromium-os:6956

Review URL: http://codereview.chromium.org/3595015

Change-Id: I81c9e1a7f406e551cd528d5226902c89165b30f9
2010-10-06 14:54:38 -05:00
Tom Wai-Hong Tam
146e8e8a80 Remove GBB-populating script since we no longer prebuild GBB.
Change-Id: Ia4cb505c27a4f868ff409968e3ba79603308e234

Review URL: http://codereview.chromium.org/3602019
2010-10-07 02:28:59 +08:00
David James
145b4e0412 Cleanup parallel_emerge exit conditions to fix hangs.
I've cleaned up parallel_emerge to send explicit signals to children to tell
them when they need to exit. I also cleaned up the CTRL-C handling to
correctly print data when interrupted by CTRL-C (previously, the print
thread exited first, so the data we wanted on the failure wasn't
actually printed.)

BUG=chromium-os:5976
TEST=Test several board emerges, including exiting early with CTRL-C.

Change-Id: Iab6efc8e1bf868106244a6210bd02e9e8283af37

Review URL: http://codereview.chromium.org/3534006
2010-10-06 11:05:29 -07:00
Chris Sosa
d9bbe8792f Close tree when smoke bvt fails.
Change-Id: I01d613527777098616e8d5bd2b4b27bce240c02f

BUG=
TEST=Ran cbuildbot and prematurely killed autotest to show test failure.  CBuildbot fails saying that cros_run_vm_test smoke_Suite failed.

Review URL: http://codereview.chromium.org/3517010
2010-10-06 10:58:08 -07:00
Eric Li
47518898af Support run multiple control file under the same test directory.
Change-Id: I1ad0aaec6517758812bf4ba0460ab0c81a6f84cb

BUG=7357
TEST=run_remote_tests.sh ... bvt regression and then observer both bvt and regression test result

Review URL: http://codereview.chromium.org/3603012
2010-10-06 10:12:27 -07:00
David McMahon
91e5b35e7a Created branch 0.9.76.B. Update CHROMEOS_VERSION_BRANCH=77
Change-Id: I50ef77682b6f3a610015ac8941569a4d48ff9223
2010-10-05 17:51:34 -07:00
David McMahon
5635ce2b29 Update CHROMEOS_VERSION_MINOR=9 on trunk 2010-10-05 16:35:17 -07:00
Chris Sosa
c1b14b52d0 Add defaults for cros_make_image_bootable.
This will allow dev who didn't build an image to still use cros_make_image_bootable
to update their image -- including mod_image_for_test / image_to_vm.

Change-Id: I1ba4292223b28b21d5416745e7744641100fa4ad

BUG=7370
TEST=Ran image_to_vm with other image and image I built myself.  Also ran
cros_make_image_bootable directly on a the same two images.

Review URL: http://codereview.chromium.org/3569015
2010-10-05 13:23:50 -07:00
Scott Zawalski
4d6d093a77 Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-10-05 11:22:37 -07:00
Darin Petkov
c90b71ed1f AU: Add a private_key option to cros_generate_update_payload.
BUG=5663
TEST=generated a delta payload

Change-Id: I62f2fae07152f67ecbf64d16948e6add1c6ba3db

Review URL: http://codereview.chromium.org/3548013
2010-10-05 10:44:06 -07:00
Scott Zawalski
8fcab50063 Fix doc string and use self.assertRaises 2010-10-05 10:39:51 -07:00
Chris Sosa
af33f8f8ae Add board option to au test harness so that this works for others without a default board and add ability to reference images without relative paths.
Change-Id: I4afa86fa7a6b772124de56114910a1ca5e3d4511

BUG=
TEST=Ran through update harness code and ran loman.

Review URL: http://codereview.chromium.org/3612004
2010-10-04 18:19:29 -07:00
Hung-Te Lin
2ffe2bed8b crosutils: refine imaging output message (as instructions)
image_to_usb has been made to work inside chroot for quite some time
(maybe since http://codereview.chromium.org/1991006), and some special
modes may even require it to be executed inside chroot.
However the output messages were not fixed, so we should remove the
"OUTSIDE CHROOT" alerts.

BUG=none
TEST=manually:
1. executed build_image and verified that output messages is correct, and the image is really built successfully.
2. executed image_to_usb.sh --from=... --to=/dev/sde and verified output messages is correct, and the USB device is really imaged by the given target

Change-Id: I8f4274c5f59a0aa585471469ac285e91c0cead13

Review URL: http://codereview.chromium.org/3519003
2010-10-05 08:15:40 +08:00
Scott Zawalski
fba0975883 Remove a line 2010-10-04 15:18:54 -07:00
Scott Zawalski
f5948251b6 Change prebuilt filters to use the private ebuilds to generate a
definitive list.
Add unittests to test an empty filter list, loading filters, and
filtering specific packages based off of mock filters.
2010-10-04 15:15:44 -07:00
Scott Zawalski
11f13514b5 Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-10-04 15:15:09 -07:00
Chris Sosa
bd61304ebe Pass --board to get_latest_image.sh.
Change-Id: Iaa388bc6dd3ef8b07199ee42de6693cad2f4368f

BUG=
TEST=rm src/scripts/default_board and ran image_to_vm --board x86-generic.

Review URL: http://codereview.chromium.org/3530007
2010-10-04 13:29:23 -07:00
Scott Zawalski
e394d421fa Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-10-04 13:00:24 -07:00
David Rochberg
c1a3e56e23 Fix enter_chroot.sh so that it can be run from a cwd that is not in a git repository
BUG=none
TEST=run from within and without a repo

Change-Id: I00eb999974656450f6af24583ca2247805b5799e

Review URL: http://codereview.chromium.org/3529005
2010-10-04 09:44:57 -04:00
Hung-Te Lin
4732d5d0c3 crosutils: Improve dd in image_to_usb.sh
1. add oflags=sync to allow interrupting dd without hanging system I/O for a long time
   (since bs=4M, the speed is almost the same)
2. use pv to provide progress report if available.
   (add pv into host-depends in http://codereview.chromium.org/3608004)

BUG=none
TEST=manually:
1. install pv in chroot, then execute image_to_usb.sh --to /dev/sdX and verified there's progress bar
2. ctrl-c to break the dd process and verified it can stop immediately
3. remove pv from chroot, then execute image_to_usb.sh and verify that it still works

Change-Id: I62fc373a4feee6d7e61897325d9e1e6d84a74d63

Review URL: http://codereview.chromium.org/3581007
2010-10-04 11:01:11 +08:00
Chris Sosa
3ede50ed4e Add enabling of local account. This should get the suite_Smoke to go green on the pfq.
Change-Id: Id480f45836a81d7d994b92d7a45d16208e1dd11c

BUG=
TEST=Ran locally.  Saw all tests pass.

Review URL: http://codereview.chromium.org/3567010
2010-10-01 14:12:26 -07:00
Scott Zawalski
9d892dd99f First submission of prebuilt upload script.
This introduces a way to upload prebuilts from the command line.

The following features are available

  * Multiprocess upload (cuts time down by a 1/5th for uploading)
  * Versioned uploading with git file commital
  * Host prebuilt uploading
  * Board prebuilt uploading

BUG=chromium-os:4843,chromium-os:5855

TEST=./prebuilt_unittest.py
{'/b/cbuild/build/chroot/build/x86-dogfood/packages/x11-misc/util-macros-1.5.0.tbz2':
'gs://chromeos-prebuilt/host/version/packages/x11-misc/util-macros-1.5.0.tbz2',
'/b/cbuild/build/chroot/build/x86-dogf}
.FILTERING /usr/local/package/oob
FILTERING /var/tmp/bibby.file
.....Updating stage 20100309/stage3-amd64-20100309.tar.bz2 to stage
test_update
.
----------------------------------------------------------------------
Ran 7 tests in 0.002s

OK

Review URL: http://codereview.chromium.org/3452032
2010-10-01 11:28:44 -07:00
Scott Zawalski
da17d44127 Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-10-01 11:28:21 -07:00
Paul Stewart
3da3113c01 Remove cros_copy_upgrade_server.sh
This script had a short painful life, constantly being brittle
and broken.  It is time for it to go.  Please use
cros_image_to_target.py instead.

BUG=none
TEST=none

Review URL: http://codereview.chromium.org/3536002
2010-10-01 11:22:23 -07:00
Scott Zawalski
f9923b0164 Changed FILTER_PACKAGES to _FILTER_PACKAGES
Fixed a missed TODO item without username
2010-10-01 10:58:55 -07:00