Commit Graph

4592 Commits

Author SHA1 Message Date
Chris Sosa
e9b94eefd0 CBuildbot - Adds ability to only rev packages given by the sourcestamp.
The buildbot drops a source stamp (repo1.git@commit1 repo2.git@commit2 ...).
If CBuildbot finds the source stamp, it uses it and revs only those packages.
If this file is either missing or set to "None", it assumes a Force Build
has been pressed and keeps the old behavior (attempts to mark all).

TEST=Ran with 3 states of revisions file.
BUG=5006

Review URL: http://codereview.chromium.org/3163030

Change-Id: I226fd3bec642224b31ce51eee34d028043964943
2010-08-26 10:55:27 -07:00
Mandeep Singh Baines
fafb895a4c Fix prefligh buildbot
BUG=none
TEST=Ran it by hand and verified that the error message goes away.

Before this change there is an error about merge_branch already existing.

Change-Id: I8393da46d6bebf1f40d253863cfe4c28b76c1b8e

Review URL: http://codereview.chromium.org/3127036
2010-08-26 10:32:16 -07:00
Andrew de los Reyes
393266b499 AU: when generating payload, don't patch kernel by default
Normally, images are signed for USB boot and the HD boot patch is in
the stateful partition. Official image are resigned, and the kernel
partition needs no patch for HD boot. Since folks generating updates
generally don't need to patch, this CL turns off patching by default.

BUG=5975
TEST=Generated update payload

Review URL: http://codereview.chromium.org/3167035
2010-08-26 09:53:52 -07:00
Scott Zawalski
46bbd36ec8 Created branch 0.8.68.B. Update CHROMEOS_VERSION_BRANCH=69
Change-Id: I775d399a3ebe24caf5227406e7baf5a7025f0932
2010-08-25 23:04:25 -07:00
Mandeep Singh Baines
f30a06ab91 cros_mark_as_stable: delete merge_branch if it already exists
Fixes issue with pfbb where commits aren't getting squashed

BUG=6102
TEST=Ran the code.

Change-Id: Ibbcb8882ee13abf3a7c283bb0d248eef8db31cb8

Review URL: http://codereview.chromium.org/3141045
2010-08-25 19:05:45 -07:00
David James
1d5fc89649 Unblacklist graphics_WebGLConformance.
zbehan has fixed this test, so we can unblacklist it now.

BUG=chromium-os:5881
TEST=Checked that all autotests compile

Change-Id: I32c445018f270009bfc8751c6306c0fc53dcecbf

Review URL: http://codereview.chromium.org/3116026
2010-08-25 17:29:05 -07:00
Mandeep Singh Baines
038dc8f89d cros_workon: store cros_workon state outside of /build
This solves the problem of cros_workon list of packages being clobbered
by a new setup_board.

BUG=5641
TEST=Verified all cases work correctly.

1. Verified that a pre-existing list of workon packages continues to work.
2. Verified that the package.unmask symlink is created correctly.
3. Verified that a new package can be worked on.
4. Verified that an existing package continues to be worked on.

Change-Id: I566ac898ac4f74bdd5beb532c1ef0f70d4c02cec

Review URL: http://codereview.chromium.org/3151039
2010-08-25 17:21:14 -07:00
J. Richard Barnette
7aeb5592be Make cros_download_latest_image echo its newline to stderr
Change-Id: I1a28902308f3892aa936bb0376e4eb75259cbb8b
BUG=none
TEST=./image_to_usb.sh --to=/dev/sdb --test_image --from=$(./cros_download_latest_image)

Review URL: http://codereview.chromium.org/3110040
2010-08-25 16:09:25 -07:00
Mandeep Singh Baines
a87699b198 cbuildbot: fix to point to new url
BUG=6102
TEST=none

Change-Id: I69312fed2d0eb4934a964792b4af06160b8d8eb5

Review URL: http://codereview.chromium.org/3135049
2010-08-25 14:39:18 -07:00
Ryan Cairns
a1401f2f56 adds a flag to exit if a test fails
Change-Id: Ifd23ca19abaef24e30e0bbd9e751f8a0ea8cf667

Merge branch 'master' of ssh://gitrw.chromium.org:9222/crosutils into fail-on-exit

Change-Id: I4e6270cc401a1450a6f2de6bc156e2dabc6d4334

BUG=none
TEST=tested both success and failure cases with and without the flag

Review URL: http://codereview.chromium.org/3150036
2010-08-25 14:30:18 -07:00
Tan Gao
4515028a2d Issue 5871: support user-specified output image name in mod_image_for_recovery.sh
Change-Id: Ibd1990747d20b3f11a8bf9d5b558405067589d0e

BUG=chromium-os:5871
TEST=manually ran the script with and without --output flag and verified output
image took default name and user-specified name, respectively

Review URL: http://codereview.chromium.org/3155042
2010-08-25 12:51:07 -07:00
Paul Stewart
e7c459dcdc package_to_live script pushes binary emerge package to remote device
This script allows us to test packages on development boxes which
might be behind a firewall in a way that prevents use of "gmerge".
In this model, images are built locally and then pushed onto the
client.

TEST=run on wifi testbed
BUG=none

Review URL: http://codereview.chromium.org/3111018
2010-08-25 10:44:16 -07:00
Ken Mixter
8899d5a90b Store away breakpad symbols in debug.tgz
BUG=5355

Change-Id: I1f6dff3808c5bfaf4b7ed6ba75e4d19b196d749c

Review URL: http://codereview.chromium.org/3166029
2010-08-25 09:17:38 -07:00
Chris Masone
b8f2ace10f pam_google is no longer in the image, so we must create /etc/login_trust_root.pem from scratch
pam_google used to install /etc/login_trust_root.pem, and then this script would
modify it.  We no longer install pam_google, so we need to create this file
de-novo now.

BUG=None
TEST=build_image, then mod for test.  Check that /etc/login_trust_root.pem exists, contains one cert, and has the right permissions.  For maximum goodness, run login_LoginSuccess

Change-Id: I409ffeea4b30905cf9e0506650b67556fa5ec80e

Review URL: http://codereview.chromium.org/3185024
2010-08-24 22:01:39 -07:00
Olof Johansson
1f5e84d157 build_image: image_to_vm needs board arg
BUG=none
TEST=build_image + cut and paste image_to_vm in the output

Change-Id: I9def13a56d796c1f034c834a8429e909b45afa02

Review URL: http://codereview.chromium.org/3181038
2010-08-24 20:26:49 -05:00
Zdenek Behan
11ed876bf1 autotest: also unmask autotest-deps in build_autotest
TBR: olofj - fixing the bots

Change-Id: Ia040324c27c65426640f2406b995aeb6942bd8f6

Review URL: http://codereview.chromium.org/3117037
2010-08-24 14:47:32 -07:00
J. Richard Barnette
acdfa8f2e8 Fix cros_workon error complaints to be more descriptive
BUG=none
TEST=./cros_workon kernel

Review URL: http://codereview.chromium.org/3142032
2010-08-24 11:10:17 -07:00
Ryan Cairns
a7be5ffcc7 pass --board to mod_image_for_test
... again ...
Change-Id: If4c72eb5ff422a74130a62a10d5705f02849acfe

BUG=none
TEST=none

Review URL: http://codereview.chromium.org/3113029
2010-08-23 20:47:07 -07:00
Mandeep Singh Baines
63412de664 cros_workon: simplify by symlinking the keywords file to the unmask file
This is a refactoring change I want to do before I solve the problem
of cros_workon list of packages being clobbered by a new setup_board.

BUG=5641
TEST=Verified all cases work correctly.

1. Verified that a pre-existing list of workon packages continues to work.
2. Verified that the package.keywords symlink is created correctly.
3. Verified that a new package can be worked on.
4. Verified that an existing package continues to be worked on.

Change-Id: I566ac898ac4f74bdd5beb532c1ef0f70d4c02cec

pause

Change-Id: Ie2d96c897da13292f985d87adfaf3a416a614613

Review URL: http://codereview.chromium.org/3143035
2010-08-23 13:57:25 -07:00
Tan Gao
6dd020e552 Remove obsolete recovery script populate_recovery_payload.sh
Change-Id: Ic6a1c30486035a4756f5129372e9e1f30ba79708

Review URL: http://codereview.chromium.org/3162031
2010-08-23 13:29:27 -07:00
Tan Gao
7b6d5036f5 Issue 5183: reduce dev install shim size
Change-Id: I7722848872b1712b26c38ac8f163d450c5a08f6d

BUG=chromium-os:5183
TEST=manually built a dev install shim and verified it's bootable on agz device

Review URL: http://codereview.chromium.org/3158021
2010-08-23 08:17:48 -07:00
Will Drewry
537caa90c0 Clean up cros_make_image_bootable and image_to_vm
image_to_vm.sh was running chromeos-setimage.  This script
was not meant to be run outside of a CrOS environment, but
its use here predates the cros_make_image_bootable script.

The change converts the rehashing and imaging over to using
cros_make_image_bootable.  The vm image uses the usb boot target but defaults
the usb drive to sda3.

update_bootloaders is fixed to not clobber existing syslinux
templates.

cros_make_image_bootable flag override support was broken and this fixes it.

TEST=build a new image wtih rootfs checking and without and ensure both woth with image_to_vm.  Also make sure they still boot normally on available hardware.
BUG=chromium-os:5939

Review URL: http://codereview.chromium.org/3189018

Change-Id: Ib4ac25f1a76f25ac7ce4538614ba247df9caea91
2010-08-20 20:30:56 -05:00
Tom Wai-Hong Tam
bfafc9cfd2 Populate the GBB blob files to factory image.
We use the filename format gbb_${BOARD}_${HWID} for GBB blob files and
place them in the same directory of site_tests/factory_WriteGBB, but in
private git.

Actually, these files will be automatically put in the factory image.
This change is to remove those not belonging to the same board.

Also do some fixes and rename QualDbs stuffs.

TEST=run image_to_usb.sh and check the gbb files.
BUG=chrome-os-partner:789

Change-Id: I5913a14eb3ceef5abfdf1a87156faa6bb7dbd561

Review URL: http://codereview.chromium.org/3111014
2010-08-21 04:03:55 +08:00
Chris Sosa
a8a4803f4f Fix cbuildbot. Mistakenly used str.open instead of open
TEST=Test underway.

Review URL: http://codereview.chromium.org/3116029
2010-08-20 10:55:48 -07:00
Mandeep Singh Baines
2e9e668dc0 cbuildbot: fix typo
BUG=5937
TEST=none

Change-Id: I5b4a79fff4f3d263812e1dd0392e21ec3bede69d

Review URL: http://codereview.chromium.org/3175030
2010-08-20 08:08:43 -07:00
David James
ddc372597f Cleanup cycle cracking in parallel_emerge.
I've cleaned up the cycle cracking in parallel_emerge to hopefully be
significantly easier to understand. This also fixes some bugs.

Most significantly, this patch restores the dependency cracking so that it
actually cracks cycles that are against the emerge ordering, instead of
cracking everything but those dependencies. This was only broken temporarily
due to my fix for Bug 5795. Oops. Fortunately, this bug doesn't affect many
people, because make_chroot --fast is deprecated anyway.

TEST=make_chroot --fast, parallel_emerge -pe hard-host-depends
BUG=chromium-os:5795

Review URL: http://codereview.chromium.org/3184011
2010-08-19 23:43:12 -07:00
Daniel Erat
64541ede55 build: Make enable_localaccount.sh skip outdated packages.
This script would previously fail before getting to
make.conf.user if it couldn't access either of pam_google
and pam_offline.  Per cmasone, these packages are outdated
now and don't need to be updated.

BUG=none
TEST=ran the script

Change-Id: I5278c73562e580bdc90866c25c6b079b10b5e708

Review URL: http://codereview.chromium.org/3165039
2010-08-19 18:04:46 -07:00
Chris Sosa
81dae09de0 Add a flag to pick up timestamp of commits and print information if found and add noclobber option for easier testing.
TEST=Ran cbuildbot with file.

Review URL: http://codereview.chromium.org/3174021
2010-08-19 18:03:06 -07:00
Chris Sosa
d26c87d176 Buildbots should not need to push changes unless they are a pre flight buildbot.
TEST=Ran cbuildbot twice.
BUG=5907

Review URL: http://codereview.chromium.org/3110027
2010-08-19 16:20:51 -07:00
Chris Sosa
bca106d35e Update bash_completion to not use a temp file
TEST=Tested within chroot and using "repo start ooga b<tab>"

Change-Id: I372d13458fb89571db4cdd7561e91c68e1563941

Review URL: http://codereview.chromium.org/3191012
2010-08-19 16:18:42 -07:00
Anush Elangovan
5c81cd31e5 Temporarily blacklist WebGLConformance to open buildbot. zbehan has a permanent fix following up
Change-Id: I574e14770e95e7478949b93942b955718f0b941a

Review URL: http://codereview.chromium.org/3161031
2010-08-19 07:19:45 -07:00
Chris Sosa
1ee50d3ce2 Add repo sync all helper for non-pfq buildbots.
TEST=Ran script and re-ran cbuildbot to completion of sync.

Change-Id: I31fddca6f720fecb461a96c1ffa54d4923b3c1c4

Review URL: http://codereview.chromium.org/3166019
2010-08-18 21:25:05 -07:00
Chris Sosa
9a27b4099f Always re-configure to use ssh even on incremental checkouts
Change-Id: I0a729b14e34c61a8174edd63fb20066e0811128e

Review URL: http://codereview.chromium.org/3181025
2010-08-18 18:18:18 -07:00
Chris Sosa
a33a445a8d Don't mask out errors in cros_mark_as_stable
Change-Id: Ib6722b99008f8515aecc3f27896963291d197947

Review URL: http://codereview.chromium.org/3130031
2010-08-18 18:03:46 -07:00
Ken Mixter
fb0160fe6d Specify correct board in old flow
BUG=5766

Review URL: http://codereview.chromium.org/3165038
2010-08-18 16:23:03 -07:00
Chris Sosa
b34604c49a Change default tracking branch for new workflow
As I was writing a doc to describe how to manually uprev I decided
that this was a good time to change the default to be consistent
with the new workflow.

Change-Id: I18932f66004161303f22835ab3b4a8436995300a

Review URL: http://codereview.chromium.org/3125024
2010-08-18 15:12:37 -07:00
Kenneth Waters
cb39f9929b update_bootloaders.sh: Fix arm-generic build.
BUG=None
TEST=Passes bash -n

Review URL: http://codereview.chromium.org/3161029
2010-08-18 14:35:22 -07:00
Ken Mixter
8798fe99f3 Make sync_build_test and build_autotest support workon.
BUG=5766

Review URL: http://codereview.chromium.org/3148016
2010-08-18 14:05:08 -07:00
Darin Petkov
5ad2cb5d03 Add repo bash_completion under chroot.
BUG=5807
TEST=enter_chroot, tried repo bash completion

Change-Id: Ic90c7bd7748fb8c79b212f465326867bbdca9c80

Review URL: http://codereview.chromium.org/3110024
2010-08-18 14:01:56 -07:00
Sean O'Connor
d52c5ea1bc Make enter_chroot spew logs to stderr.
It's sometimes useful to run a command in chroot and redirect/pipe stdout. Any objections to having enter_chroot send its chatter to stderr?

Review URL: http://codereview.chromium.org/3160024
2010-08-18 21:18:23 +02:00
Kenneth Waters
eca76464c7 make_image: Install u-boot scripts to ESP partition.
BUG=1150
TEST=Built image for tegra2_dev_board, and x86-generic

Review URL: http://codereview.chromium.org/3109018
2010-08-18 11:17:01 -07:00
Darin Petkov
6944c5dd68 Handle tilde expansion in cros_workon tab completion.
BUG=5623
TEST=tried ~/trunk/src/scripts/cros_workon

Change-Id: I72aaf5d538ef53b06a4e454935528db0731f03c7

Review URL: http://codereview.chromium.org/3156025
2010-08-18 09:57:34 -07:00
Sean O'Connor
88a33da077 cros_extract_deps -j writes JSON, sorted by package name.
Rationale: Consumers of this output should not have to eval() python
code in order to use the output. Also potentially useful for dumping
out of buildbot for consumption by other web-based tools.

Review URL: http://codereview.chromium.org/3148022
2010-08-18 18:46:00 +02:00
Will Drewry
12f14ce889 build_image: default to using verified rootfs for x86
This change enables root filesystem integrity checking for all x86
builds by default.  All mod_image_for_* work with this and the
factory_install.  In addition, the BVT tests all pass running on
a dm-verity root.

[I will send a mail to the chromium-os-dev once this lands with instructions on how to build with it and how to turn it off (chromeos-setimage) on an installed machine.]

Once this is functioning, I will start migrating the build/install process over to use the UUID-based boot.

TEST=built x86-generic, mod'd for test, installed, ran suite_BuildVerify
BUG=chromium-os:5100

Review URL: http://codereview.chromium.org/3143025

Change-Id: Ib23962b7a5e034ef6aea31b4361944ba894700c6
2010-08-17 17:27:16 -05:00
Will Drewry
d253badb6c build_image: make sure the factory_image size is propagated
Verified rootfs-based factory installers fail because the ROOT_SIZE_BYTES is
updated, but the information is not propagated to the boot.desc which
cros_make_image_bootable uses.  The result is that mod_image_for_test
incorrectly appends the rootfs hash even though it is correctly computed.

Random note:
build_kernel_image uses dumpe2fs to compute the size, but
cros_make_image_bootable uses the supplied size.  These shouldn't
diverge though the partition size should accomodate the addition of the
hashes.
TODO(wad) Add checking of sizes in cros_make_image_bootable

TEST=x86-generic build image with --enable_rootfs_verification and --factory_install; then put in a machine and it no longer spewed dm-verity hash errors and the root hash checked successfully!
BUG=chromium-os:5100

Review URL: http://codereview.chromium.org/3155025

Change-Id: I174e3661b80d83b25f3af95ff1eb77f634a7e797
2010-08-17 14:09:41 -05:00
Tan Gao
843b70acf4 Issue 5183: Create a developer shim for release builds
Change-Id: I14cd9dc365093c0450210d7853ad5f67ffa0ddd0

BUG=chromium-os:5183
TEST=1) manually built a dev install shim and verified it's only bootable when dev switch is ON

Review URL: http://codereview.chromium.org/3153001
2010-08-17 09:41:48 -07:00
David James
e122814469 parallel_emerge: Crack all counter-plan dependencies.
Previously, parallel_emerge only broke counter-plan dependencies if they were
mutually cyclic. This doesn't work, because these deps might be involved in
an unrelated cycle.

To fix this, we break all counter-plan dependencies that are involved in any
cycle. This fixes make_chroot --fast, which currently fails with a deadlock.

Besides the above, I've also added additional cycle-checking to the install
plan generation code so that cyclic dependencies are caught earlier. I also
cleaned up FindCyclesAtNode to be a bit more understandable -- I wasn't 100% sure
that it was actually correct so I cleaned it up so that it was easier for me to
understand that it is in fact correct. Not sure that this part fixes any bugs,
but it's easier for me to analyze the behavior of FindCyclesAtNode now.

TEST=make_chroot --fast (Note that make_chroot --fast is deprecated, but it's
     good to fix the cycle cracking anyway.)
BUG=chromium-os:5795

Review URL: http://codereview.chromium.org/3156018
2010-08-16 21:30:50 -07:00
Scott Zawalski
5717746db7 Created branch 0.8.66.B. Update CHROMEOS_VERSION_BRANCH=67
Change-Id: Id6246d0e316160e83652b74358c79420070456f0
2010-08-16 17:11:44 -07:00
Andrew de los Reyes
4db8bd0738 Factory install: unbreak
BUG=None
TEST=None

Review URL: http://codereview.chromium.org/3169016
2010-08-16 16:02:03 -07:00
Andrew de los Reyes
6faff36229 AU: make mk_memento_images not change rootfs
Also, enforce use of cros_generate_update_payload to generate images.

BUG=5771
TEST=Ran ./cros_generate_update_payload to make full update

Review URL: http://codereview.chromium.org/3135024
2010-08-16 15:24:04 -07:00