Commit Graph

1911 Commits

Author SHA1 Message Date
Tom Wai-Hong Tam
fb5ce169ee For the boards already have DB directories, remove the default DB.
The default DB is an all-pass DB. If no DB found, the hardware_Components test
falls back to the all-pass one and skip the real check. In order to prevent
skipping the check, remove the default DB in the boards already have DB
directories.

TEST=run "image_to_usb.sh --factory" and check the default DB removed
BUG=chrome-os-partner:1737

Change-Id: Ia25f2551a5eba3a95fe736e86bfe52c340f329a8

Review URL: http://codereview.chromium.org/5339011
2010-11-30 11:22:50 +08:00
Eric Li
53698c3865 Remove unused autotest scripts.
Change-Id: Ia627995d235732602c34494f11aa6ae7058209c3

BUG=9291
TEST=None

Review URL: http://codereview.chromium.org/5278013
2010-11-29 16:35:47 -08:00
Chris Masone
330375f692 [crosutils] Add confirmation warning to cros_workon_make --scrub
BUG=9717
TEST=run cros_workon_make --scrub and ensure that it only scrubs if the user types y or yes (case insensitive)

Change-Id: Ic1f8020fcca8bd57924391fcbf075d3e2adc5e4a

Review URL: http://codereview.chromium.org/5265009
2010-11-29 15:06:53 -08:00
Eric Li
6fbd3d123c Refactor run_remote_tests script.
What I did:
1. enter_chroot once and only once if necessary. The previous version would enter/exit chroot 3 times in worst case. And the entire logic happens inside chroot only, this has greatly simplified the overall workflow, and reduced the number of variables used. Shell script variables could be tricky.

2. Change variable type to test_type since type is a bash builtin.

3. get rid of {$TMP}/run_test.sh script, since it is not necessary any more.

4. get rid of rsync step from third_party/autotest/files to ${BUILD_DIR}, since it is not neccessary either.

overall, reduced ~40 lines of code.

All the change should be transparent to end users and there should be no regression changes at all.

w/wo emerge autotest
w/wo cros_workon
in/outside of chroot.

and all its combinations.

Change-Id: I9c1532e9cb6cc0e724d4b6d870723df3e2a147ec

BUG=9291
TEST=Run storageFio test since it need prebuild test and deps.

Review URL: http://codereview.chromium.org/5176009
2010-11-29 14:13:15 -08:00
Don Garrett
cd33866c89 Add RunCommandCaptureOutput as a helper method.
It's like RunCommand, but you can run the command, capture it's error code and output together.

This is to support tests that need to capture output of image_to_live, and to know if it succeeded.

Change-Id: If674b6d79697c0f0b5c96be9fc83adbed9b9893e

BUG=chromium-os:9502
TEST=Ran by hand

Review URL: http://codereview.chromium.org/5339006
2010-11-29 13:30:42 -08:00
Scott Zawalski
4b6485133f Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils 2010-11-29 13:21:09 -08:00
Chris Masone
5c5a95e865 [crosutils] Add script to help build incrementally
cros_workon_make provides a make-style interface to incrementally building
    cros_workon-enabled packages, appropriately setting up the toolchain for
    the target board beforehand.

    To incrementally build your package:
      cros_workon_make --board <board> <package>

    To re-run your package's configure steps and compile:
      cros_workon_make --board <board> <package> --reconf

    To incrementally build your package and tests, and run the tests:
      cros_workon_make --board <board> <package> --tests

    To incrementally build and install your package:
      cros_workon_make --board <board> <package> --install

    To remove ALL files in your package repo not known by git:
      cros_workon_make --board <board> <package> --scrub

    With the exception of --scrub, these flags all compose

BUG=6843
TEST=build workon packages in place

Change-Id: Ie219074127549e1e29adad6d6a03142ab74e0172

Review URL: http://codereview.chromium.org/5244001
2010-11-29 12:49:10 -08:00
Chris Sosa
564373521e Reconfigure to use ssh connection rather than use different manifest.
This also removes the rw_checkout var as it's not longer changes the affect of whether we use the ssh url or not.

Note that this replaces the other CL from last night because the other CL didn't work.  The other CL still pulled in the same manifest that has http: url's for each git repo.  I reverted that change last night after I noticed this.

Change-Id: I3d4ad2be6887ac2cf4ed2009bad9cae6dfdf5bbf

BUG=chromium-os:9509
TEST=Ran with cbuildbot --clobber and incremental

Review URL: http://codereview.chromium.org/5278010
2010-11-29 10:42:49 -08:00
repo sync
bce3668d75 Revert "Copying au-generator.zip file to the image directory"
This reverts commit a8107a22d6.

TEST=none
BUG=http://code.google.com/p/chromium-os/issues/detail?id=9639

Change-Id: I45c41dc6a3ffc22363bd9775c335fa87c0aa5174

TBR=
2010-11-24 15:00:43 -08:00
Chris Sosa
c58667b8c4 This CL adds the ability to Rev and Build Chrome using cros_mark_chrome_as_stable.
Other things:
Removing commit|clean|push command from cros_mark_chrome because it's unnecessary ... I'm just gonna use the same stabilizing branch as the other stable marker, so I can use the same clean / push from the other script.  This makes this change fit in much more nicely to cbuildbot.

Other changes:
Add ability for cros_mark_chrome_as_stable to communicate to calling script through stdout.
Make STABLE_BRANCH in cros_mark_as_stable public for above reason.
Removed push_options from cros_mark and accompanying change to cbuildbot as it isn't used anymore.
Made it easier to debug with cbuildbot (I ran cbuildbot A LOT of times to test this change so I felt the pain)...this includes:
  - only build when syncing
  - allow one to explicitly disable tests
  - use dryrun is options.debug is set

Change-Id: I413a2e81a99cdde2e4d9139561cd518245b9b346

BUG=chromium-os:8693
TEST=Ran cbuildbot with --notest --debug --nosync x86-pre-flight and
saw it go through correctly and dryrun push.  Ran cbuildbot with same and --chrome_rev=tot.  Ran with syncing and running tests too.

Review URL: http://codereview.chromium.org/5154008
2010-11-24 13:18:39 -08:00
Gaurav Shah
d02793a5d7 cros_make_image_bootable: Do a final sanity check on the rootfs by running e2fsck
This is a complement to the proposed fix for http://crosbug.com/9447, and I am getting it out first since it is a relatively simple change.

This change ensures that the rootfs on the image output by cros_make_image_bootable wasn't corrupted accidentally (for example, no boot.desc was provided and the defaults were incorrect for the image). This should catch rootfs errors that we end up discovering at delta AU time.

BUG=chromium-os:9578
TEST= Ran cros_make_image_bootable manually on an existing image with and without boot.desc. As expected, without boot.desc the output image rootfs had errors.

Also ran ./build_image - which worked fine too.

Change-Id: I4ed3a56634f37ab7d5ff2dc052ad607740356a40

Review URL: http://codereview.chromium.org/5216003
2010-11-24 12:48:14 -08:00
Kenneth Waters
b2d2212bb9 mod_for_factory: Fix factory images for tegra2
- Conditionally patch chrontel.conf
- Add a patch for nvrm to start on factory, so that X can start.

BUG=crosbug.com/p/1721
TEST=Built and run factory image for tegra2_seaboard

Change-Id: Ied87b6d959f940ef8e99e124ab419fdeea48aa26

Review URL: http://codereview.chromium.org/5126005
2010-11-24 12:29:40 -08:00
Raja Aluri
a8107a22d6 Copying au-generator.zip file to the image directory
Change-Id: Id4ed6af96e0b621f4ad36966fad45c887b991373

BUG=4015
TEST=Ran archiv_build.sh with the build_bot flow

Review URL: http://codereview.chromium.org/5305006
2010-11-24 11:22:55 -08:00
Thieu Le
ac13647eda Change _ArchiveTestResults to upload to Google Storage
BUG=chromium-os:8364
TEST=

Change-Id: Icecc8268fa2c12c8413caa2879785f00e4be5a0a

Review URL: http://codereview.chromium.org/4864001
2010-11-24 10:42:32 -08:00
Chris Sosa
444e3a6de0 Revert "Change url of manifest to use ssh one as opposed to mirrored repo."
This reverts commit 4847031faa.

TBR=Required for pushes to work.

Change-Id: I4f07407e518045ea77fa61942af58f57e68b5f8f
2010-11-24 00:54:48 -08:00
Nick Sanders
1c4026c7a7 Fix factory patching
BUG=7535
TEST=build factory, no errors, verify patches.

Change-Id: I480633cc7a0824cd2dfab82acd6a82f952cd7daf

Review URL: http://codereview.chromium.org/5332004
2010-11-23 22:03:25 -08:00
Scott Zawalski
323b95efd9 Created branch 0.9.128.B. Update CHROMEOS_VERSION_BRANCH=129
Change-Id: Idf83937b607ee1b61071b99976c1f337db47f69b
2010-11-23 18:58:45 -08:00
Nick Sanders
7f5e4b2d30 Fix typo
BUG=chrome-os-partner:1583
TEST=no

Change-Id: Iac591be8ce3ef1d8594a959f68f6cb7f114af2e4

Review URL: http://codereview.chromium.org/5314005
2010-11-23 16:30:17 -08:00
Chris Sosa
4847031faa Change url of manifest to use ssh one as opposed to mirrored repo.
Change-Id: I680e28bcafbfeb4f19e2404e2b28761e26111f7f

BUG=chromium-os:9509
TEST=Ran cbuildbot on my local builder checkout with both clobber and without.
It sync'd and built.

Review URL: http://codereview.chromium.org/5312002
2010-11-23 16:29:01 -08:00
Simon Glass
d73ec0e2a8 cros_image_to_target handles test images, less verbose
added --test option
removed superfluous output (e.g. from dd) unless --verbose given
added --debug option for when you really want that output
added use of pv for a nice progress bar

TEST=(run script several times)
BUG=chromium-os:9563

Change-Id: Ib9d89ad5649b6cb6d5db35f66f6a3fda1ada0c53

Review URL: http://codereview.chromium.org/5176002
2010-11-23 15:30:50 -08:00
Scott Zawalski
04e216d305 Created branch 0.9.126.B. Update CHROMEOS_VERSION_BRANCH=127
Change-Id: I4bedd5925ad3f94fc0799c2ff2187f0cc717b12f
2010-11-22 22:47:36 -08:00
J. Richard Barnette
23de818c2c Various minor bootperf improvements
Change-Id: I791fa01fcd2feb0c7b4c7e3d63cebc88d896c8ac

BUG=chromium-os:9459
BUG=chromium-os:9460
TEST=run the script, and check results with showbootdata or by manually inspecting the output directory
TEST=run "bootperf invalid-hostname", and see that the error message is useful

Review URL: http://codereview.chromium.org/5156008
2010-11-22 17:22:48 -08:00
Chris Sosa
98e73f154e Ignore packages that cannot be found for the target.
Change-Id: I1b08fe7fe292605543579af0df358cb2fcbf0b97

BUG=
TEST=Ran it with dev-utils/crosutils

Review URL: http://codereview.chromium.org/5281001
2010-11-22 14:36:41 -08:00
Chris Sosa
e4836188a8 Add ability for cbuildbot to only run unit tests for revved packages.
Change-Id: I6744aac09fb075f91f710f16343fab45b8dc8af9

BUG=chromium-os:7283
TEST=Ran it with cbuildbot through the unit tests phase and looked
at the file and saw it get parsed correctly.

Review URL: http://codereview.chromium.org/5124006
2010-11-22 13:44:51 -08:00
Darin Petkov
d9360f12c3 unit tests: no need to black list AU's unit tests any more
This will also make it so that AU's unit tests run on buildbot.

BUG=9435
TEST=new chroot, build_packages, ./cros_run_unit_tests

Change-Id: I4dbbcf1db4c1b1f3634202261b08b8f10a9a0ac6

Review URL: http://codereview.chromium.org/5145008
2010-11-22 09:50:59 -08:00
David McMahon
276887f7ba Created branch 0.9.124.B. Update CHROMEOS_VERSION_BRANCH=125
Change-Id: Iff8911cdde1eabaa4c3f3865b71ecd11b7696b63
2010-11-19 21:58:41 -08:00
Chris Sosa
ed210b40ff Add new chrome revving module to crosutils.
Have subsequent review for cbuildbot that calls this for the pfq.

This module  has 3 modes ... TOT, latest_release, sticky_release that describe the three different types of revs for chrome we will be supporting.

For tot, we grab the latest svn revision # from the chrome src tree, and rev to the corresponding ebuild i.e. 9.0.553.0_alpha-r1 with CROS_SVN_COMMIT=svn revision number.

For latest_release, we grab the latest release from the releases page, and create an ebuild (or rev a previously existing on with same version) and use the release candidate suffix _rc.

For sticky_release, we use much of the same logic as latest_release, however, we specifically look to rev _rc's in the sticky branch.

This change depends on http://codereview.chromium.org/5172003 for the cros_mark_as_stable changes.

Change-Id: Idc1f4cd905cc1dcb4c44422f6104760077a24b8d

BUG=chromium-os:8693
TEST=Ran cros_mark_as_stable with --packages="chromeos-base/chromeos-chrome" --chrome_version=0.8.65.0 --chrome_revision=67890 commit.  Re-ran unit-tests as well (though thinking about adding another unit test for chrome revving)

Review URL: http://codereview.chromium.org/4798001
2010-11-19 14:01:11 -08:00
Eric Li
6f209d1333 Remove the dependency to autotest_run.sh so I can get rid of it in next CL.
Change-Id: Ieaa2553612aefd6161785185350d495cbf0dad81

BUG=9291
TEST=Run storageFio test since it need prebuild test and deps.

w/wo emerge autotest
w/wo cros_workon
in/outside of chroot.
w/wo --used_emerged
w/wo --results_dir_root

and all its combinations.

Review URL: http://codereview.chromium.org/5212003
2010-11-19 10:43:47 -08:00
Chris Sosa
3e689730e4 The major change is refactoring to make functions more accessible for other modules.
Besides changing a lot of _ to not _, I added lots of docstrings, moved things around,
factored out the Marking component of the EBuildStableMarker (for use with other CL),
and fixed the version logic.

The versioning logic was too hacktastic.  So I took a note from David's changes to
take the information from pkgsplit rather than doing the ugly parsing I was doing before.
This is much more robust in the case of no _r*'s and _rc or _alpha*, etc.

This CL also adds the ability to test Push changes in 2 ways.  One using --dryrun which allows someone to call it by not actually push to the remote server and two, a unit test for the Push method.

Used in http://codereview.chromium.org/4798001/

BUG=chromiumos:8693
TEST=Ran unit tests and chrome mark as stable.  Will run some more tests.

Committed: http://chrome-svn/viewvc/chromeos?view=rev&revision=be485ce

Review URL: http://codereview.chromium.org/5172003

Change-Id: I6d1231c6f46d8cc2e5fb57d04f2d3417cfbfb4f8
2010-11-19 07:29:10 -08:00
David McMahon
f2d6e3581a Created branch 0.9.122.B. Update CHROMEOS_VERSION_BRANCH=123
Change-Id: I79df96994610de742e10c84cdc183c49a09a346b
2010-11-18 23:19:51 -08:00
Chris Sosa
c8d611583a Revert "The major change is refactoring to make functions more accessible for other modules."
This reverts commit be485ced43.

TBR=

Change-Id: I43d753d7e5171bba81ee39fab81a7b831b4711ae
2010-11-18 18:10:51 -08:00
Chris Sosa
be485ced43 The major change is refactoring to make functions more accessible for other modules.
Besides changing a lot of _ to not _, I added lots of docstrings, moved things around,
factored out the Marking component of the EBuildStableMarker (for use with other CL),
and fixed the version logic.

The versioning logic was too hacktastic.  So I took a note from David's changes to
take the information from pkgsplit rather than doing the ugly parsing I was doing before.
This is much more robust in the case of no _r*'s and _rc or _alpha*, etc.

This CL also adds the ability to test Push changes in 2 ways.  One using --dryrun which allows someone to call it by not actually push to the remote server and two, a unit test for the Push method.

Used in http://codereview.chromium.org/4798001/

BUG=chromiumos:8693
TEST=Ran unit tests and chrome mark as stable.  Will run some more tests.

Review URL: http://codereview.chromium.org/5172003

Change-Id: I4319dcd3a4235474ecfd61c680a5242bab5bd00b
2010-11-18 17:33:07 -08:00
Don Garrett
d0473d1e9f Don't pass "" to cros_run_vm_test if vm_graphics_flag isn't set.
This would not have been a problem if "--no_graphics" is used.

Change-Id: I3645391d25d4bb8618109ff5be0ca2fbe8e96a60

BUG=chromium-os:9373
TEST=Ran by hand

Review URL: http://codereview.chromium.org/5104006
2010-11-18 16:11:13 -08:00
Chris Sosa
9b054f0f88 Revert "The major change is refactoring to make functions more accessible for other modules."
This reverts commit 118629dae8.

Revert "Remove _ to fix tree."

This reverts commit a74ee71048.

Revert "Missed tracking branch to re-open tree."

This reverts commit 0b9f24e9be.

TBR=davidjames

Change-Id: Ic7057cd2a01e192ec78dd729a1f3eac7835b96c7
2010-11-18 15:57:20 -08:00
Chris Sosa
0b9f24e9be Missed tracking branch to re-open tree.
Change-Id: I2331cb6eda8c49111f30b62c42946952e450741f

TBR=davidjames
2010-11-18 15:31:52 -08:00
Chris Sosa
a74ee71048 Remove _ to fix tree.
Change-Id: I62a94f8d66ce9b133eda6c085da5e4957ff74796

BUG=
TEST=

Review URL: http://codereview.chromium.org/5138006
2010-11-18 15:05:45 -08:00
Chris Sosa
118629dae8 The major change is refactoring to make functions more accessible for other modules.
Besides changing a lot of _ to not _, I added lots of docstrings, moved things around,
factored out the Marking component of the EBuildStableMarker (for use with other CL),
and fixed the version logic.

The versioning logic was too hacktastic.  So I took a note from David's changes to
take the information from pkgsplit rather than doing the ugly parsing I was doing before.
This is much more robust in the case of no _r*'s and _rc or _alpha*, etc.

Used in http://codereview.chromium.org/4798001/

BUG=chromiumos:8693
TEST=Ran unit tests and chrome mark as stable.  Will run some more tests.

Review URL: http://codereview.chromium.org/5172003

Change-Id: Id6ef9a480591d1a28352f360c6d076564b43e318
2010-11-18 14:35:59 -08:00
Chris Sosa
2798f3c3cc Revert "Remove the dependency to autotest_run.sh so I can get rid of it in next CL."
This reverts commit 983fdb5a2d.  TBR to ericli

BUG=
TEST=

Review URL: http://codereview.chromium.org/5090006

Change-Id: Ibf9f94f814abacb4cdaaeb815f944bd943a0dd9a
2010-11-18 11:10:08 -08:00
Eric Li
983fdb5a2d Remove the dependency to autotest_run.sh so I can get rid of it in next CL.
Change-Id: I1032932b696929fccf97f911c555ec5a24f589d4

BUG=9291
TEST=Run storageFio test since it need prebuild test and deps.

w/wo emerge autotest
w/wo cros_workon
in/outside of chroot.

and all its combinations.

Review URL: http://codereview.chromium.org/5188002
2010-11-18 10:28:10 -08:00
Hung-Te Lin
df4fc212a8 crosutils: fix "umount: /tmp/XXX: not mounted" in build_image
The update_bootloaders needs to unmount file system first for syslinux to
manipulate the raw device file, but the real "umount+losetup -d" in
cleanup stage would cause failure.

This CL remounts partition again so that cleanup can be executed
successfully.

BUG=chromium-os:9278
TEST=Manually executed ./build_image;
 Before fix: seeing "umount: /tmp/esp.2q8fSn: not mounted" in last page.
 After fix: no such error.
 The output image is verified to be bootable successfully.

Change-Id: I19e2e062ad814e7bcd54777b5c3cee31f2b92e81

Review URL: http://codereview.chromium.org/5165001
2010-11-18 17:27:17 +08:00
David McMahon
24f6e35428 Created branch 0.9.120.B. Update CHROMEOS_VERSION_BRANCH=121
Change-Id: I4d991f0c320f71075d80196bbf96c4e1b18a8439
2010-11-17 23:22:55 -08:00
Hung-Te Lin
062947926e cros_utils: refine factory and imaging related scripts
Major changes are:
 - prefix functions in cros_image_common with 'image' to avoid naming conflicts
 - use awk to replace grep+sed+cut
 - use case to handle board name list
 - factory_setup.sh should return error if applying patch failed
 - refine for shell script coding style guide:
   * replace `` with $()
   * quote variables
   * replace "! -z" by "-n"
   * no space between redirection symbol (>) and target name (eg, >>filename)
   * 1> should be simply >
   * no trailing \ for && and ||

BUG=chrome-os-partner:1583
TEST=manually verified:
 ./image_to_usb.sh --factory # calls mod_image_for_test --factory, and works fine
 ./make_factory_package.sh --factory PATH_TO_IMAGE --release PATH_TO_IMAGE ...
  # factory payloads were created successfully

Change-Id: I6bb10bdfb12cbdb14e9816b3ad72dfe4b7b0472f

Review URL: http://codereview.chromium.org/5168001
2010-11-18 14:47:38 +08:00
Nick Sanders
711efd8aec Clean var formatting in mod_for_factory
BUG=chrome-os-partner:1583
TEST=built factory image

Change-Id: Icc15295ca3ce6113ea22a988e2e755ab513a43de

Review URL: http://codereview.chromium.org/5219001
2010-11-17 22:10:16 -08:00
Nick Sanders
f57f1166cd Trigger factory from udev-addon
Change-Id: I8a9df6ff7be3edb8160541409f15fa7b8ee7b725

BUG=7535
TEST=

Review URL: http://codereview.chromium.org/4259002
(cherry picked from commit 18897f619deaa8067c57dc7575c3de2445f58aa9)

Review URL: http://codereview.chromium.org/5116005
2010-11-17 21:55:02 -08:00
Don Garrett
a82ac9aba5 Add --payload option to take advantage of the new option for devserver.
Change-Id: Icdd0a809a2f5aeaedccb2ed421984d9f298f181b

BUG=chromium-os:8207
TEST=Ran by hand

Review URL: http://codereview.chromium.org/5103004
2010-11-17 18:20:24 -08:00
Mandeep Singh Baines
4ea330f007 build_image: honor USE flags from environment
BUG=n0ne
TEST=Ran the following command to test:

USE="-compat_wireless" ./build_image

Change-Id: I4b3fd12c1f62e1b2551045a5831a63d848fe2a3f

Review URL: http://codereview.chromium.org/5139003
2010-11-17 18:11:58 -08:00
Chris Sosa
684d5dbccf Add retries to pfq push.
Change-Id: Ie4632acf22bedb0c94de0cb3fe67b549fc2d0871

BUG=chromium-os:9323
TEST=Ran it and inserted exception for push_try < 3 and
mocked out push.

Review URL: http://codereview.chromium.org/5142003
2010-11-17 17:48:26 -08:00
Nick Sanders
a436eb8ef6 Add per board customization, clean up private autotests.
BUG=1583
TEST=actually builds

Change-Id: I6510f30faf3f3c2e88b4ea9c63985c09086e1a5d

Review URL: http://codereview.chromium.org/4482001
(cherry picked from commit afba119639afe0fb8206e58ead091f2efd114192)

Allow branch customization for factory

BUG=1583
TEST=removes superfluous files

Change-Id: I576fc0dd811f9c1ed6299a539e0e8a014b37bdc8

Review URL: http://codereview.chromium.org/4376001
(cherry picked from commit 08fdc9da26456c286254c250366bdfc738f8ed38)

No pagecycler for factory image

BUG=1583
TEST="build, no pagecycler in factory."

Change-Id: I43d23de5d518634697e17a32bcd94a43aad46aba

Review URL: http://codereview.chromium.org/4342002
(cherry picked from commit f3e98785f3ed3f4e87e4287ee3ec45e2fc737c89)

Review URL: http://codereview.chromium.org/5091002
2010-11-17 16:50:02 -08:00
David McMahon
765d7c2180 Created branch 0.9.118.B. Update CHROMEOS_VERSION_BRANCH=119
Change-Id: Ia2a698501ad1532f6a3936bdb9d97a639431afcc
2010-11-17 16:39:55 -08:00
Paul Stewart
f7597abb17 Use new stateful image builder
Also change download filenames

BUG=chromium-os:9308
TEST=Run script

Review URL: http://codereview.chromium.org/5149002

Change-Id: Id9ed150184559ab31274dc3b4f58bf9fe0a0f76c
2010-11-17 16:22:28 -08:00