Commit Graph

2152 Commits

Author SHA1 Message Date
Chris Sosa
fd38b5bdfe Revert "Fix common.sh to work in it's new location at /usr/lib/crosutils."
This reverts commit 856799a47f.

TBR=Anton for pfq.

Change-Id: Id592ee7a68c5f77300f5bf4f55192a372dd8a9da
2011-01-26 12:47:49 -08:00
Don Garrett
91c39378e0 Add buildbot functionality to cbuildbot.
Change-Id: I1291d2f52122fe345c5927a7ef27e20d07e917d7

BUG=chromium-os:11229
TEST=(building locally, still in progress)

Review URL: http://codereview.chromium.org/6317014
2011-01-26 11:53:26 -08:00
Chris Sosa
f2ee5f6871 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=c418a8f

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=be787f3

Review URL: http://codereview.chromium.org/6277015
2011-01-26 11:38:14 -08:00
Anton Staaf
856799a47f Fix common.sh to work in it's new location at /usr/lib/crosutils.
If we are inside the chroot then we assume that the "gclient" root
is ~/trunk.  If we are outside the chroot we continue with the
previous search mechanism to find the "gclient" root.

Change-Id: Ia40de609ea596228fec2644ff3046e376b112b06

BUG=chromium-os:4230
TEST=run "src/scripts/cros_overlay_list --board tegra2 --variant seaboard" inside and outside the chroot.

Review URL: http://codereview.chromium.org/6265028
2011-01-26 11:23:50 -08:00
Chris Sosa
404bfdf073 Revert "Passes cache location to tests and runs the tests in parallel."
This reverts commit be787f3525.

Revert "Fix sudo again."

This reverts commit 0f411ec7d9.

TBR dgarrett

BUG=
TEST=

Review URL: http://codereview.chromium.org/6348022

Change-Id: I2fb9ca4967ff173c17840b96eb68b02ff2b7774a
2011-01-25 18:16:55 -08:00
Chris Sosa
0f411ec7d9 Fix sudo again.
TBR:dgarrett

Change-Id: Idf2c15b873c4ee6c7865978d62f0b134c149b66f

BUG=chromium-os:10723
TEST=NA

Review URL: http://codereview.chromium.org/6384012
2011-01-25 17:59:46 -08:00
Chris Sosa
be787f3525 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=c418a8f

Review URL: http://codereview.chromium.org/6277015
2011-01-25 17:16:56 -08:00
Chris Sosa
27729c7dbf Revert "Passes cache location to tests and runs the tests in parallel."
This reverts commit c418a8fce7.

TBR=open tree

Change-Id: I471d186fca9084fd18858998b4bcf8cb1de19f14
2011-01-25 15:12:39 -08:00
Darin Petkov
145205a3bd Don't black list gconf since it's back in.
BUG=chromium-os:11222
TEST=none

Change-Id: I3f400da70e9cada72bfa7e632a681b56488f48ed

Review URL: http://codereview.chromium.org/6358012
2011-01-25 14:44:52 -08:00
Chris Sosa
c418a8fce7 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Review URL: http://codereview.chromium.org/6277015
2011-01-25 13:49:29 -08:00
Chris Sosa
3ee8b17d63 Don't prompt the build bot to delete its dir on error.
Change-Id: I9a4fc8ea0ed51a11a912f3d1c896579369fd8880

BUG=Tac0
TEST=Ran with USER=chrome-bot ./build_image and hit Ctrl+C

Review URL: http://codereview.chromium.org/6288012
2011-01-24 15:55:46 -08:00
Anton Staaf
9bcd84140a Add common function to determin board and variant values.
Change-Id: I9fe8b267a6fe96f3c4049d77cf866d0b6d36ecbe

BUG=None
TEST=setup_board --board tegra2 --variant seaboard

Review URL: http://codereview.chromium.org/6371008
2011-01-24 15:27:14 -08:00
Chris Sosa
637b55326b Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Review URL: http://codereview.chromium.org/6277015
2011-01-24 14:48:02 -08:00
Mandeep Singh Baines
07f92099a4 cros_workon: allow a stop on a dead package
Previously, you could not stop working on a package if its ebuild had
been removed. This fixes this issue by skipping canonicalization if the
package name exactly matches a name in the workon file.

BUG=11214
TEST=See below.

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
(cros-chroot) msb@msb ~/trunk/src/scripts $ echo "=foo/bar-9999" >> ~/trunk/.config/cros_workon/x86-generic
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
foo/bar
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop foo/bar
!!! No packages matching 'foo/bar'
WARNING: error looking up package foo/bar
ERROR  : Error parsing package list

*** I made changes to cros_workon here

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
foo/bar
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop foo/bar
INFO   : Stopped working on 'foo/bar' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel

Change-Id: Id5cbd2b145b4d0fca96cfb245f1ac99e0b3cbdf3

Review URL: http://codereview.chromium.org/6379006
2011-01-24 14:04:35 -08:00
Mandeep Singh Baines
26998d4c6e cros_workon: remove logic for handling ~ in workon file
We stopped using ~ in the workon files many months ago.

BUG=n0ne
TEST=See below.

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic start perf
Please run "repo sync" now.
INFO   : Started working on 'dev-util/perf' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
dev-util/perf
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop perf
INFO   : Stopped working on 'dev-util/perf' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel

Change-Id: I61babd89073d749111be7257b2e8491f07ca52f2

Review URL: http://codereview.chromium.org/6268012
2011-01-24 13:46:52 -08:00
Darin Petkov
72444a2bf6 Blacklist gconf, orbit, libIDL so that they don't creep back in unless needed.
BUG=chromium-os:430
TEST=build_image x86-mario

Change-Id: I90ce6ea102a2c30f46b4e184211ba86a2cacc089

Review URL: http://codereview.chromium.org/6356006
2011-01-24 09:55:00 -08:00
Anush Elangovan
f3e7025a75 crosutils:Remove dead scripts
Change-Id: I666296627fc87910903b0a4c3f9bcfd7362daa41

BUG=n0ne
TEST=Verify they are not in the developer workflow

Review URL: http://codereview.chromium.org/6287010
2011-01-22 12:13:15 -08:00
Ken Mixter
60dabf1a79 crosutils: enable learning board type and setting localaccount
Change-Id: Ib2509f2f8f650e037cad173496930ec71eeb64ef

BUG=n0ne
TEST=various invocations though mostly --remote=IP --test=bvt

Review URL: http://codereview.chromium.org/4104004
2011-01-21 17:30:17 -08:00
Don Garrett
3343f56b77 Add a verbose option to RunCommandCaptureOutput. Not used yet, does not
dump output until after the command has finished, so not useful for
following 'live'.

Change-Id: Ia8562f5e6f8d7ed8af7e188faa68f5cdbba487c6

BUG=chromium-os:11164
TEST=None

Review URL: http://codereview.chromium.org/6296013
2011-01-21 16:06:51 -08:00
Mandeep Singh Baines
779babc3b2 cros_mark_as_stable: remove old kernel hack
This is no longer needed due to recent cleanup of the ebuild:

http://git.chromium.org/gitweb/?p=chromiumos-overlay.git;a=commit;h=2c58ec2cabfbd2658cc48b2c0cf74e6b5759b483

BUG=11124
TEST=See below.

$ export CROS_WORKON_LOCALNAME="kernel" CROS_WORKON_PROJECT="kernel" eval $(grep -E ^"^CROS_WORKON" kernel-9999.ebuild) && echo $CROS_WORKON_PROJECT $CROS_WORKON_LOCALNAME/$CROS_WORKON_SUBDIR
kernel "../third_party/kernel/files"/

Change-Id: Ib9b0d89b41753b490a9f1e73095ad106beefffa6

Review URL: http://codereview.chromium.org/6328005
2011-01-21 10:50:12 -08:00
Chris Sosa
b6d82e8bb7 Pre-generate updates with root user.
image_to_live runs dev_server with sudo so old cached entries are
owned by root rather than $USER.  Change to pre-generate also with
sudo.

Change-Id: I587f15953b37d4de439977e7dbac9fced175c173

BUG=chromium-os:10723
TEST=Ran it

Review URL: http://codereview.chromium.org/6380008
2011-01-20 13:00:08 -08:00
Darin Petkov
8a7c3acce7 Make sure iso-codes and libxklavier don't creep back into the image unless needed.
BUG=chromium-os:11063
TEST=x86-mario -- repo sync, build_packages, build_image

Change-Id: I5433438245ea8f3b75e1b617f837bbb47145662a

Review URL: http://codereview.chromium.org/6308011
2011-01-20 11:45:13 -08:00
Don Garrett
83d063b670 Pass along RunCommandException correctly. This is a minor
fix, but it leads to better error messages from ctest.

Change-Id: I624ad805ef037b022e6e67b56f0ed10ca05fe325

BUG=11096
TEST=Test currently in progress.

Review URL: http://codereview.chromium.org/6257007
2011-01-20 11:44:41 -08:00
Chris Sosa
a4cc3cd3ab Pre-generate updates for test harness in parallel.
First CL of many.  Thought I'd commit this before the others since
it sets stuff up for the other CL's (i.e. Thread Pool).

With this CL, all updates will be pre-generated before the test run.
This should improve some speeds since the two updates will be produced
at the same time rather than at the time of the sequential tests.

Change-Id: Iaf0a06f0d99c31d3d749e478fd2fb6efa0763a28

BUG=chromium-os:10723
TEST=Ran it with -q

Review URL: http://codereview.chromium.org/6264005
2011-01-20 10:23:54 -08:00
Scott Zawalski
2c11e0d7bc Update prebuilt to use cros_overlay_list as the definitive answer for which overlay to modify.
The last entry from the commands output will always be the one that we
want. By using this we also avoid having to tack on -private and hope
that people who created the overlay conformed to that naming convention.

BUG=NA
TEST=prebuilt_unittest updated and run

Review URL: http://codereview.chromium.org/6348010
2011-01-19 14:38:01 -08:00
Don Garrett
e70ccb91b1 Use different proxy ports, and log port conflicts. Hopefully works around
build problems, and will give better diagnostics if not.

Change-Id: I2f7a5d9b2e0c63a8189ad212125c7a5c0178c3c4

BUG=10567
TEST=

Review URL: http://codereview.chromium.org/6331007
2011-01-19 13:41:23 -08:00
Nick Sanders
2a517638ef Add legacy fixup for diskimg
make_factory_package.sh --diskimg can now boot on H2O bios.

BUG=chromeium-os:10915
TEST=boots

Change-Id: I8358247e475fa2d4298e225fa9445b00e4dad253

Review URL: http://codereview.chromium.org/6296001
(cherry picked from commit 10418cc13c298f3514fdc5898655132cb9b09037)

Review URL: http://codereview.chromium.org/6278003
2011-01-18 22:20:03 -08:00
Scott Zawalski
7bac5ab46f Update prebuilt.py to handle files not existing. Add a unittest to test the case
TBR=sosa

BUG=NA
TEST=Unittest

Review URL: http://codereview.chromium.org/6261013
2011-01-18 20:33:32 -08:00
Scott Zawalski
e90029493e Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2011-01-18 17:08:54 -08:00
Scott Zawalski
11bc4c7213 Merge branch 'prebuilt' 2011-01-18 17:08:32 -08:00
Scott Zawalski
61a543d901 Start using prebuilt.conf instead of make.conf this is an initial step
to eventually moving entirely out of the overlay directory. The reason
to do this now is to avoid devs having to remerge there make.conf changes
while they are in flight.

Add private support to prebuilt.py so we will update private overlays if
we are internal and external if we are external.
Update prebuilt_unittest to ensure we are returning the proper path if
the private overlay exists. Also ensure we are returning the proper host
path regardless.

BUG=9919
TEST=unittest added for private case
2011-01-18 17:06:56 -08:00
J. Richard Barnette
3d0a18e676 Fix showbootdata handling when invoked with options but no arguments
Change-Id: Ieacacae968f45325b7a164d1a38b8cd27272d367

BUG=chromium-os:10519
TEST=see bug description

Review URL: http://codereview.chromium.org/6085003
2011-01-18 16:57:52 -08:00
Todd Broch
93300cd754 Revert "build_kernel_image: enable nmi watchdog"
This reverts commit ea621903e9.

TEST=grep dmesg for clock & nmi to make sure things look ok.
Run example program to make sure result of clock_getres call tv_nsec = 1 again
BUG=chromium-os:10720

Change-Id: Ife23fc7d08420788d4c165957d739ec2ce974969

Review URL: http://codereview.chromium.org/6274006
2011-01-18 10:05:21 -08:00
Scott Zawalski
cc4a3f5b28 Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2011-01-14 14:42:23 -08:00
Mandeep Singh Baines
2f3b5fc537 update_kernel.sh: modify to work inside chroot
BUG=n0ne
TEST=Successfully updated a kernel.

Change-Id: If168c47cca4b5b794d95c9b839b17bff3f96ed9c

Review URL: http://codereview.chromium.org/6249004
2011-01-14 14:20:12 -08:00
Mandeep Singh Baines
aef91ad564 remote_access.sh: remove dependence on ssh-agent
This is take 2 of this CL. Modified run_remote_test.sh to
explicitly start an ssh-agent if necessary instead of
implicitly relying on remote_access.sh to do it.

BUG=n0ne
TEST=Verified I could successfully ssh.

Change-Id: I4e70b8574af1119dcf36768f6602ecc0cabedc31

Review URL: http://codereview.chromium.org/6288004
2011-01-14 14:17:25 -08:00
Chris Sosa
f867de71d0 Disable tests that don't work with verbose and set verbose as default.
Change-Id: I25066c75797ec7ce481ee096a2dc777d48634581

BUG=Get tree 0pen
TEST=Ran it

Review URL: http://codereview.chromium.org/6279002
2011-01-14 10:38:26 -08:00
Mandeep Singh Baines
9af6ba1b77 run_remote_test.sh: explicitly start/stop ssh-agent
run_remote_test.sh is implicitly depending on remote_access.sh to setup
the ssh-agent for it. This broke when I tried to remove ssh-agent starting
from remote-access.sh. Implicitly dependencies are ugly.

BUG=n0ne
TEST=Ran a test on my local machine. Tested with and without default board.

Change-Id: I50db1717cafc2565cb8bb648919430d9ce24ce80

Review URL: http://codereview.chromium.org/6333001
2011-01-13 15:45:42 -08:00
Scott Zawalski
d1f0db8c7d Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2011-01-13 15:39:37 -08:00
Chris Sosa
4db7ac8f98 Print out SVN revision number for TOT chrome pfq builds.
Change-Id: I046d49c7002586671dc7c6707afeeeb0a0360cd5

BUG=10934
TEST=Ran it with bin/cros_mark_chrome_as_stable tot. Verified output and that it still did the right thing

Review URL: http://codereview.chromium.org/6327002
2011-01-13 14:11:18 -08:00
Chris Sosa
5c9571a926 Revert "remote_access.sh: remove dependence on ssh-agent"
This reverts commit 78476aba5f.

BUG=
TEST=Reverted on bot and re-ran test suite

Review URL: http://codereview.chromium.org/6311002

Change-Id: Ib9405dac19b8b19d89e5d2346f5e1fd130a7280f
2011-01-13 13:12:55 -08:00
Chris Sosa
bb4661dee7 Put wait around remote_reboot core code itself rather than around the ping.
The last CL had a race condition where we could ping but not run the reboot_check code.
This CL moves to watch the reboot_check code rather than a ping.

Change-Id: I8bdda97850ac085be9cf5dfb0b80fb7e1c8dd212

BUG=chromium-os:10867
TEST=Ran it 100 times without error.

Review URL: http://codereview.chromium.org/6287001
2011-01-13 11:19:02 -08:00
Mandeep Singh Baines
78476aba5f remote_access.sh: remove dependence on ssh-agent
Change-Id: I68d02f5630bd885894ca69728254f2a5ba5cc2aa

BUG=n0ne
TEST=Verified I could successfully ssh.

Review URL: http://codereview.chromium.org/6314001
2011-01-13 11:16:51 -08:00
Hung-Te Lin
4653cbd0e5 crosutils/make_factory_package.sh: support full SSD image as target outside chroot
When running outside chroot, we should use locate_cgpt + "$GPT" to invoke cgpt;
otherwise it may be not in system PATH.

For dealing with a true SSD image (over USB, for example) this CL also improved
data writing speed from <2M/s to 8M/s+ (over USB).

BUG=chromium-os:10531
TEST=./make_factory_package.sh \
  --factory=../build/images/x86-mario/latest/chromiumos_factory_image.bin \
  --release=../build/images/x86-mario/latest//chromiumos_image.bin \
  --diskimg=/dev/sdb

Also tested:
  --diskimg=blah # local file
  (chroot) --diskimg=/dev/sdd
  (chroot) --diskimg=blah

Change-Id: I647d97fe388f5b6a6223fa8cacfecdf00265f60c

Review URL: http://codereview.chromium.org/6261003
2011-01-13 16:59:42 +08:00
Hung-Te Lin
c584cf0e95 crosutils/make_factory_package.sh: Support relative path
Since there's a pushd call when building images, we have to first retrieve
the complete (full/absolute) path of target disk image.

BUG=chromium-os:10706
TEST=make_factory_package.sh \
     --factory ../build/images/x86-mario/latest/factory_image.bin \
     --release ../build/images/x86-mario/latest/chromiumos_image.bin \
     --diskimg blah_relative.bin

Change-Id: I02e2edb0f76b724337a82dd400297877681bc338

Review URL: http://codereview.chromium.org/6244003
2011-01-13 15:34:59 +08:00
Chris Sosa
60587527c1 Add more robust ssh ping to be run on reboot for updates.
Upon investigation it seems there's a race condition when ssh
starts up the first time.  This adds a much more robust way to
ping a machine when it's up then the previous method.

Change-Id: I092744b259c169975d1c4f283f01a556fce24723

BUG=chromium-os:10867
TEST=Ran it 30 times with image_to_live --noupdate --nostateful_update.

Review URL: http://codereview.chromium.org/6115009
2011-01-12 15:10:35 -08:00
Antoine Labour
3866923b00 Revert "This change removes the autotest mount-specific change from the mod_for_test scripts as we no longer need executable /tmp or /home for autotest."
This reverts commit 4092ff5651.

TBR=fes

Change-Id: I9baa8836fce86963af97a618d75aeb90325fbc42
2011-01-12 14:36:51 -08:00
Frank Swiderski
4092ff5651 This change removes the autotest mount-specific change from the mod_for_test scripts as we no longer need executable /tmp or /home for autotest.
Change-Id: I03c563b11d5df043683e904c7794faa34748b063

BUG=chromium-os:7286
TEST=bvt autotest

Review URL: http://codereview.chromium.org/6080007
2011-01-12 13:50:48 -08:00
Will Drewry
d07f61d812 build_image: enable Chrome OS partition/hardware error behavior in dm-verity
ARM (kernel-next) should now be in sync with kernel.git so that we get similar
error handling behavior on all targeted platforms (with our partition layout).

This change makes that the default.

BUG=chromium-os:9697
TEST=manual build_image with kernel-next profile; booted and validated failover error behavior

Change-Id: I281302adb3cbc96aa5770630898f103b0d3639ca

Review URL: http://codereview.chromium.org/6220002
2011-01-12 10:39:54 -06:00
Chris Sosa
8617623516 Major cleanup of cros_au_test_harness code.
This cleanup code consolidates parsing of options, removes
globals, cleans up private vs. public functions, removes the backup full update option, and cleans up
docstrings.

Change-Id: I3eba26b3634fd87f4a36f195ab42ec7bd11e963f

BUG=chromium-os:8901
TEST=Ran with prefix SimpleTest and ran whole suite for a vm using my latest built image.  Also ran normal update test using latest image against latest dev channel image for mario.  Re-tested with new changes after build break.

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=2b2d7a1

Review URL: http://codereview.chromium.org/6015013
2011-01-10 13:37:49 -08:00