Commit Graph

1728 Commits

Author SHA1 Message Date
Chris Sosa
24da49e6ee Revert remote_access refactor.
Reverts http://codereview.chromium.org/6322002/

Change-Id: I3cf60747b4d25bf6c8ad8f290fc46cf360b8c074

BUG=chromium-os:11568
TEST=Ran it

Review URL: http://codereview.chromium.org/6349036
2011-02-01 17:06:12 -08:00
Chris Sosa
4c5396d872 Respect debug flag setting when building unit tests.
Change-Id: Id942eefeea4bfb51b076d8d567c398557a522937

BUG=7976
TEST=Ran with both options

Review URL: http://codereview.chromium.org/6312073
2011-02-01 14:17:19 -08:00
Chris Sosa
558940dddb Make git config optional to allow multiple calls to enter_chroot at the same time.
It's very rarely needed anyway but enter_chroot does everything under the sun.

Avoids:

error: could not lock config file ~/.gitconfig

Change-Id: Ide72b14fd434b182a88d2fc636559b3515905509

BUG=chromium-os:11523
TEST=Ran it ... 10x

Review URL: http://codereview.chromium.org/6312069
2011-02-01 13:07:55 -08:00
Chris Sosa
19ef17732c Do not pregenerate update payloads in parallel.
TBR dgarret

Change-Id: I71ef4b02108f43717e4bc404290952df99112654

BUG=n0ne
TEST=NA

Review URL: http://codereview.chromium.org/6349021
2011-02-01 09:57:29 -08:00
Mandeep Singh Baines
0fdf2a7aeb cros_workon: use portageq instead of sourcing make.conf
Fixes the following issue:

/home/msb/trunk/src/overlays/overlay-x86-generic/make.conf: line 7: prebuilt.conf: No such file or directory

BUG=11513
TEST=Verified that the error goes away.

Change-Id: I5b1dfab55394ba40c02e2a1a2ee7b03a5c4a7941

Review URL: http://codereview.chromium.org/6409031
2011-01-31 16:59:37 -08:00
Mandeep Singh Baines
f9ea0036fa cros_workon: collapse cros_workon_common.sh
cros_workon is the only user of cros_workon_common.sh

This is pre-requisite to moving cros_workon into devutils.git

BUG=11507
TEST=Ran ./cros_workon --board x86-generic --all list

Change-Id: I1eab551ab33646360e507328932c151a0d36f50a

Review URL: http://codereview.chromium.org/6347052
2011-01-31 16:13:30 -08:00
Chris Sosa
39ed0d0ebe Clear cache for runs of ctest if --cache not set.
Change-Id: I013c838c83dd23cbfe04f77f87df74778d8e874e

BUG=chromium-os:10723
TEST=Ran it

Review URL: http://codereview.chromium.org/6389004
2011-01-31 12:12:41 -08:00
Chris Sosa
b8a84b2cb7 Change uprev to False for Chrome pfq.
Change-Id: I8c635cf228c9bf1c77d97656d6b38de5289ff9e6

BUG=
TEST=

Review URL: http://codereview.chromium.org/6347027
2011-01-28 22:48:46 -08:00
Chris Sosa
25272888e8 add cwd
TBR dgarret

Change-Id: I8d7f86d716f1da76f4c85259f401c3ccc9a031ff

BUG=
TEST=

Review URL: http://codereview.chromium.org/6392010
2011-01-28 20:53:08 -08:00
Chris Sosa
d7beed79b6 Rebuild chroot for full builders.
TBR dgarrett

Change-Id: Ibed5341626d498adeeb259cac54ebb05ca1b4421

BUG=
TEST=

Review URL: http://codereview.chromium.org/6407001
2011-01-28 18:43:46 -08:00
Chris Sosa
b62c4860f8 Fix issue where full builders end prematurely.
TBR dgarrett

Change-Id: I08b7c19b8010003857f9791ca45ec9cadb972d47

BUG=N0ne
TEST=Ran

Review URL: http://codereview.chromium.org/6352027
2011-01-28 18:30:02 -08:00
Chris Sosa
af47e0e488 Make push and clean more robust.
Change-Id: Iea9f8947b8ad651abe92cfdd8ea575603d1e2bb1

BUG=chromium-os:10723
TEST=Ran it ... saw nothing glaring

Review URL: http://codereview.chromium.org/6250037
2011-01-28 17:31:57 -08:00
Don Garrett
7b8075ac6d Added arm-tegra2-seaboard-full, should have added in previous change.
Change-Id: Iecb40121b4bc8ee652fe72c4a8c07e3d231293bf

BUG=chromium-os:11229
TEST=Passed unittests (shows correct syntax)

Review URL: http://codereview.chromium.org/6379015
2011-01-28 14:52:17 -08:00
Chris Sosa
436209ec5b Have the ability for the PFQ to both rev Chrome and other packages.
This issue seems bigger than it first appears because we had put extra logic to "Delete" the branch if we didn't rev anything.  This CL basically takes out all the Deletes and relies and cros_mark_as_stable clean to clean up any old dirs correctly.  To do this, I had to fix a bug in clean so that we actually delete the stable branch as part of it (if it exists).

EOM

Change-Id: Ic1020451dc1d492d4b6e2a233d1d49cf8c1c16b3

BUG=chromium-os:11329
TEST=Ran x86-generic-pfq w/ dev options + --chrome_rev=latest_release ...built chrome,
and revved packages without error.  Doing more testing still.

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=a8ac0ec

Review URL: http://codereview.chromium.org/6291013
2011-01-28 14:27:38 -08:00
Don Garrett
e7b9a4f558 Add new configs to cbuildbot_conf to match master.cfg
Change-Id: I4a28ac0f8e1a90313a9373e213e8a30003d1f8ad

BUG=chromium-os:11229
TEST=Unittests

Review URL: http://codereview.chromium.org/6268020
2011-01-28 14:14:26 -08:00
Vincent Palatin
3eb3543e9a Revert "Have the ability for the PFQ to both rev Chrome and ..."
This reverts the commit a8ac0ec8c3.

TBR the x86 PFQ buildbot fails

BUG=chromium-os:11447
TEST=
TBR=sosa

Change-Id: I019de669db13b753365e1208acc9923c4bb5c993

Review URL: http://codereview.chromium.org/6339018
2011-01-28 15:55:47 -05:00
Chris Sosa
a8ac0ec8c3 Have the ability for the PFQ to both rev Chrome and other packages.
This issue seems bigger than it first appears because we had put extra logic to "Delete" the branch if we didn't rev anything.  This CL basically takes out all the Deletes and relies and cros_mark_as_stable clean to clean up any old dirs correctly.  To do this, I had to fix a bug in clean so that we actually delete the stable branch as part of it (if it exists).

EOM

Change-Id: Ic1020451dc1d492d4b6e2a233d1d49cf8c1c16b3

BUG=chromium-os:11329
TEST=Ran x86-generic-pfq w/ dev options + --chrome_rev=latest_release ...built chrome,
and revved packages without error.  Doing more testing still.

Review URL: http://codereview.chromium.org/6291013
2011-01-28 11:17:57 -08:00
Ruchi Chaturvedi
571d1c95f9 Added HWQual utility script - call_script.py
Change-Id: I07722c5eac6836051dedf015593d4717bf852853

BUG=chromium-os:10197
TEST= Run HWQual scripts as -

python call_autoserv.py --ip=<remote machine IP> --test=<server or client HWQual testname in suite_HWQual or site_tests>

Review URL: http://codereview.chromium.org/6187006
2011-01-27 16:19:55 -08:00
Don Garrett
38a66574b6 Add more cbuild options, revise configs
BUG=chromium-os:11229
TEST=Local, unittests

Review URL: http://codereview.chromium.org/6245013

Change-Id: I103d693a2e6ce033c1f495f9f48450156ad72e94
2011-01-27 14:04:15 -08:00
Chris Sosa
6e79ebeaa1 Actually die if a parallel test fails.
Change-Id: I24b498fffb7e7ce54517945730c91fecd1d57586

BUG=chromium-os:10723
TEST=Ran it and killed a test

Review URL: http://codereview.chromium.org/6260023
2011-01-27 11:18:25 -08:00
Anton Staaf
95e56d1ca2 Update cros_overlay_list to work from either src/scripts or /usr/bin.
Change-Id: If4c2852568454c2dccf09b0fc1e180ed228a1bb7

BUG=chromium-os:4230
TEST=run cros_overlay_list from both locations in the chroot and src/scripts outside the chroot.

Review URL: http://codereview.chromium.org/6293021
2011-01-27 09:38:46 -08:00
Chris Sosa
d6ca361c09 Add Chrome PFQ config that is a copy of current pfq.
Change-Id: Ie1ee6554ec0973a85a11c264346295fd27f59ebf

BUG=chromium-os:11329
TEST=Ran with cbuildbot on local system.

Review URL: http://codereview.chromium.org/6384017
2011-01-26 22:01:33 -08:00
Chris Sosa
fb58ea5d96 This change squashes output while pregenerationg updates.
It also caches sudo credentials before running jobs (for devs) and
exits if any updater returns an error code != 0 with the output
of pregenerate update

BUG=chromium-os:10723
TEST=Ran it ... killed one pregeneration to make sure it did print + exit
correctly

Review URL: http://codereview.chromium.org/6381013

Change-Id: I04842211e469b3a0022cb53b78efd17fbebe7010
2011-01-26 18:44:59 -08:00
Anton Staaf
30acb0b926 Fix common.sh to work in it's new location at /usr/lib/crosutils.
If we are inside the chroot then we assume that the "gclient" root
is ~/trunk.  If we are outside the chroot we continue with the
previous search mechanism to find the "gclient" root.

Change-Id: Ia40de609ea596228fec2644ff3046e376b112b06

BUG=chromium-os:4230
TEST=run "src/scripts/cros_overlay_list --board tegra2 --variant seaboard" inside and outside the chroot, and under sudo.

Review URL: http://codereview.chromium.org/6265028

Review URL: http://codereview.chromium.org/6344016
2011-01-26 16:00:20 -08:00
Olof Johansson
e0b7551f7b add quiet to arm bootargs
Not printing on the uart makes a huge difference in boot time performance. Since it's easy to re-enable again for those debugging boot time issues, let's disable it by default. It's how x86 does it as well.

Change-Id: Idb4af8d98434e70ee1389b3579c220da34be9c3b

BUG=chromium-os:11351
TEST=Build image and boot system

Review URL: http://codereview.chromium.org/6290011
2011-01-26 14:31:26 -08:00
Olof Johansson
f53fa0d5f8 update_kernel: first cut at arm support
Change-Id: I5dc22223559d3cdad357530af66c14115da63c89

BUG=n0ne
TEST=update_kernel to seaboard (and mario for regression test)

Review URL: http://codereview.chromium.org/6031005
2011-01-26 13:06:46 -08:00
Chris Sosa
fd38b5bdfe Revert "Fix common.sh to work in it's new location at /usr/lib/crosutils."
This reverts commit 856799a47f.

TBR=Anton for pfq.

Change-Id: Id592ee7a68c5f77300f5bf4f55192a372dd8a9da
2011-01-26 12:47:49 -08:00
Don Garrett
91c39378e0 Add buildbot functionality to cbuildbot.
Change-Id: I1291d2f52122fe345c5927a7ef27e20d07e917d7

BUG=chromium-os:11229
TEST=(building locally, still in progress)

Review URL: http://codereview.chromium.org/6317014
2011-01-26 11:53:26 -08:00
Chris Sosa
f2ee5f6871 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=c418a8f

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=be787f3

Review URL: http://codereview.chromium.org/6277015
2011-01-26 11:38:14 -08:00
Anton Staaf
856799a47f Fix common.sh to work in it's new location at /usr/lib/crosutils.
If we are inside the chroot then we assume that the "gclient" root
is ~/trunk.  If we are outside the chroot we continue with the
previous search mechanism to find the "gclient" root.

Change-Id: Ia40de609ea596228fec2644ff3046e376b112b06

BUG=chromium-os:4230
TEST=run "src/scripts/cros_overlay_list --board tegra2 --variant seaboard" inside and outside the chroot.

Review URL: http://codereview.chromium.org/6265028
2011-01-26 11:23:50 -08:00
Chris Sosa
404bfdf073 Revert "Passes cache location to tests and runs the tests in parallel."
This reverts commit be787f3525.

Revert "Fix sudo again."

This reverts commit 0f411ec7d9.

TBR dgarrett

BUG=
TEST=

Review URL: http://codereview.chromium.org/6348022

Change-Id: I2fb9ca4967ff173c17840b96eb68b02ff2b7774a
2011-01-25 18:16:55 -08:00
Chris Sosa
0f411ec7d9 Fix sudo again.
TBR:dgarrett

Change-Id: Idf2c15b873c4ee6c7865978d62f0b134c149b66f

BUG=chromium-os:10723
TEST=NA

Review URL: http://codereview.chromium.org/6384012
2011-01-25 17:59:46 -08:00
Chris Sosa
be787f3525 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=c418a8f

Review URL: http://codereview.chromium.org/6277015
2011-01-25 17:16:56 -08:00
Chris Sosa
27729c7dbf Revert "Passes cache location to tests and runs the tests in parallel."
This reverts commit c418a8fce7.

TBR=open tree

Change-Id: I471d186fca9084fd18858998b4bcf8cb1de19f14
2011-01-25 15:12:39 -08:00
Darin Petkov
145205a3bd Don't black list gconf since it's back in.
BUG=chromium-os:11222
TEST=none

Change-Id: I3f400da70e9cada72bfa7e632a681b56488f48ed

Review URL: http://codereview.chromium.org/6358012
2011-01-25 14:44:52 -08:00
Chris Sosa
c418a8fce7 Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Review URL: http://codereview.chromium.org/6277015
2011-01-25 13:49:29 -08:00
Chris Sosa
3ee8b17d63 Don't prompt the build bot to delete its dir on error.
Change-Id: I9a4fc8ea0ed51a11a912f3d1c896579369fd8880

BUG=Tac0
TEST=Ran with USER=chrome-bot ./build_image and hit Ctrl+C

Review URL: http://codereview.chromium.org/6288012
2011-01-24 15:55:46 -08:00
Anton Staaf
9bcd84140a Add common function to determin board and variant values.
Change-Id: I9fe8b267a6fe96f3c4049d77cf866d0b6d36ecbe

BUG=None
TEST=setup_board --board tegra2 --variant seaboard

Review URL: http://codereview.chromium.org/6371008
2011-01-24 15:27:14 -08:00
Chris Sosa
637b55326b Passes cache location to tests and runs the tests in parallel.
As a warning, this is a pretty big change.  At a high-level,
this changes the harness to move the managing of the devserver from
image_to_live into the actual test harness.  Paths of the cache locations (for
archive_url) are taken when pre-generating the updates and stored
in a dictionary (maps "path_to_base->path_to_target" (or path for full updates)->
cache paths).

This change also has the tests run in parallel.  Because we now start
X number of VM's at once, each VM needs it's own pid file and ssh_port.
This logic was added as well as running the actual tests in parallel.

Change-Id: I1275d79740c50c2a8028489b43dcbbcf5bbd56c4

BUG=chromium-os:10723
TEST=Ran it ... a lot with -q but without a test_prefix (so full test suite).

Review URL: http://codereview.chromium.org/6277015
2011-01-24 14:48:02 -08:00
Mandeep Singh Baines
07f92099a4 cros_workon: allow a stop on a dead package
Previously, you could not stop working on a package if its ebuild had
been removed. This fixes this issue by skipping canonicalization if the
package name exactly matches a name in the workon file.

BUG=11214
TEST=See below.

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
(cros-chroot) msb@msb ~/trunk/src/scripts $ echo "=foo/bar-9999" >> ~/trunk/.config/cros_workon/x86-generic
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
foo/bar
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop foo/bar
!!! No packages matching 'foo/bar'
WARNING: error looking up package foo/bar
ERROR  : Error parsing package list

*** I made changes to cros_workon here

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
foo/bar
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop foo/bar
INFO   : Stopped working on 'foo/bar' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel

Change-Id: Id5cbd2b145b4d0fca96cfb245f1ac99e0b3cbdf3

Review URL: http://codereview.chromium.org/6379006
2011-01-24 14:04:35 -08:00
Mandeep Singh Baines
26998d4c6e cros_workon: remove logic for handling ~ in workon file
We stopped using ~ in the workon files many months ago.

BUG=n0ne
TEST=See below.

(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic start perf
Please run "repo sync" now.
INFO   : Started working on 'dev-util/perf' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel
dev-util/perf
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic stop perf
INFO   : Stopped working on 'dev-util/perf' for 'x86-generic'
(cros-chroot) msb@msb ~/trunk/src/scripts $ ./cros_workon --board x86-generic list
sys-kernel/chromeos-kernel

Change-Id: I61babd89073d749111be7257b2e8491f07ca52f2

Review URL: http://codereview.chromium.org/6268012
2011-01-24 13:46:52 -08:00
Darin Petkov
72444a2bf6 Blacklist gconf, orbit, libIDL so that they don't creep back in unless needed.
BUG=chromium-os:430
TEST=build_image x86-mario

Change-Id: I90ce6ea102a2c30f46b4e184211ba86a2cacc089

Review URL: http://codereview.chromium.org/6356006
2011-01-24 09:55:00 -08:00
Anush Elangovan
f3e7025a75 crosutils:Remove dead scripts
Change-Id: I666296627fc87910903b0a4c3f9bcfd7362daa41

BUG=n0ne
TEST=Verify they are not in the developer workflow

Review URL: http://codereview.chromium.org/6287010
2011-01-22 12:13:15 -08:00
Ken Mixter
60dabf1a79 crosutils: enable learning board type and setting localaccount
Change-Id: Ib2509f2f8f650e037cad173496930ec71eeb64ef

BUG=n0ne
TEST=various invocations though mostly --remote=IP --test=bvt

Review URL: http://codereview.chromium.org/4104004
2011-01-21 17:30:17 -08:00
Don Garrett
3343f56b77 Add a verbose option to RunCommandCaptureOutput. Not used yet, does not
dump output until after the command has finished, so not useful for
following 'live'.

Change-Id: Ia8562f5e6f8d7ed8af7e188faa68f5cdbba487c6

BUG=chromium-os:11164
TEST=None

Review URL: http://codereview.chromium.org/6296013
2011-01-21 16:06:51 -08:00
Mandeep Singh Baines
779babc3b2 cros_mark_as_stable: remove old kernel hack
This is no longer needed due to recent cleanup of the ebuild:

http://git.chromium.org/gitweb/?p=chromiumos-overlay.git;a=commit;h=2c58ec2cabfbd2658cc48b2c0cf74e6b5759b483

BUG=11124
TEST=See below.

$ export CROS_WORKON_LOCALNAME="kernel" CROS_WORKON_PROJECT="kernel" eval $(grep -E ^"^CROS_WORKON" kernel-9999.ebuild) && echo $CROS_WORKON_PROJECT $CROS_WORKON_LOCALNAME/$CROS_WORKON_SUBDIR
kernel "../third_party/kernel/files"/

Change-Id: Ib9b0d89b41753b490a9f1e73095ad106beefffa6

Review URL: http://codereview.chromium.org/6328005
2011-01-21 10:50:12 -08:00
Chris Sosa
b6d82e8bb7 Pre-generate updates with root user.
image_to_live runs dev_server with sudo so old cached entries are
owned by root rather than $USER.  Change to pre-generate also with
sudo.

Change-Id: I587f15953b37d4de439977e7dbac9fced175c173

BUG=chromium-os:10723
TEST=Ran it

Review URL: http://codereview.chromium.org/6380008
2011-01-20 13:00:08 -08:00
Darin Petkov
8a7c3acce7 Make sure iso-codes and libxklavier don't creep back into the image unless needed.
BUG=chromium-os:11063
TEST=x86-mario -- repo sync, build_packages, build_image

Change-Id: I5433438245ea8f3b75e1b617f837bbb47145662a

Review URL: http://codereview.chromium.org/6308011
2011-01-20 11:45:13 -08:00
Don Garrett
83d063b670 Pass along RunCommandException correctly. This is a minor
fix, but it leads to better error messages from ctest.

Change-Id: I624ad805ef037b022e6e67b56f0ed10ca05fe325

BUG=11096
TEST=Test currently in progress.

Review URL: http://codereview.chromium.org/6257007
2011-01-20 11:44:41 -08:00
Chris Sosa
a4cc3cd3ab Pre-generate updates for test harness in parallel.
First CL of many.  Thought I'd commit this before the others since
it sets stuff up for the other CL's (i.e. Thread Pool).

With this CL, all updates will be pre-generated before the test run.
This should improve some speeds since the two updates will be produced
at the same time rather than at the time of the sequential tests.

Change-Id: Iaf0a06f0d99c31d3d749e478fd2fb6efa0763a28

BUG=chromium-os:10723
TEST=Ran it with -q

Review URL: http://codereview.chromium.org/6264005
2011-01-20 10:23:54 -08:00