Commit Graph

66 Commits

Author SHA1 Message Date
David James
4dd4c54ccb Fix race condition by using different symlinks for factory images.
Both the tests and archive_build read and write the latest symlink.
This CL fixes a race condition in archive_build by moving away from
using the latest symlink in archive_build.

BUG=chromium-os:18967
TEST=Run release cbuildbot archive_build on x86-mario-release.
     Verify it completes successfully and that latest symlink
     is unchanged now.

Change-Id: Ia32d20903f3ef74e360944fbabdd9834c0edb99a
Reviewed-on: http://gerrit.chromium.org/gerrit/5746
Reviewed-by: David James <davidjames@chromium.org>
Tested-by: David James <davidjames@chromium.org>
2011-08-11 12:44:02 -07:00
David James
27064994fa Use pbzip2 in archive_build, if it is available.
BUG=chromium-os:16502
TEST=Run cbuildbot run of archive stage with official build.

Change-Id: I03898404dd27d6930c4a01bd9826796ddb07a4cd
Reviewed-on: http://gerrit.chromium.org/gerrit/5445
Reviewed-by: Zdenek Behan <zbehan@chromium.org>
Tested-by: David James <davidjames@chromium.org>
2011-08-06 18:58:44 -07:00
Nick Sanders
daebdee972 Add HWID bundle into buildbot output
Add bundle to factory_shim/hwid

BUG=chromium-os:16734
TEST=archive_build, with and without hwid present

Change-Id: I70eeca5ce9cd99d229081a92af5bc0c3c997dce7
Reviewed-on: http://gerrit.chromium.org/gerrit/5189
Reviewed-by: Rong Chang <rongchang@chromium.org>
Tested-by: Nick Sanders <nsanders@chromium.org>
2011-08-03 23:16:41 -07:00
David James
5ee38905e5 Don't rm $OUTDIR during archive_build.sh.
BUG=chromium-os:18382
TEST=Run sample buildbot run.

Change-Id: Ib6e81e9ec4b90b8f089da6de50bee1accafec9dd
Reviewed-on: http://gerrit.chromium.org/gerrit/4978
Reviewed-by: Chris Sosa <sosa@chromium.org>
Tested-by: David James <davidjames@chromium.org>
2011-07-29 09:41:46 -07:00
Brian Harring
d5d5dbffa1 Fix/standardize exiting if common.sh can't be found
The problem here is that most were doing their exiting w/in a subshell;
exit within a subshell kills the subshell, not the parent.  Not all scripts
were using set -e (which would pick up the failing subshell); as such
just rewriting them to remove the potential via eliminateing the subshelling.

Beyond that, removed a couple of custom (working, although non-standard)
approaches, and removed a duplicate common.sh sourc'ing w/in mk_memento_images.sh

TEST=force 'find_common_sh' to fail, note the scripts fails to exit
BUG=none

Change-Id: Ia1108a091a6399ad6aedd3cade4a107f4411686c
Reviewed-on: http://gerrit.chromium.org/gerrit/3905
Reviewed-by: Brian Harring <ferringb@chromium.org>
Tested-by: Brian Harring <ferringb@chromium.org>
2011-07-22 12:06:59 -07:00
David James
8b3234a504 Accept change identifier as an argument.
This allows the buildbot to calculate the change identifier and pass it into
archive_build. This makes it easier for us to parallelize the archive_build
step.

BUG=chromium-os:12220
TEST=Verify this argument works. Verify archive_build works without the argument
     too.

Change-Id: I6b757cc7795fb6f2f24a400502fe6f70416ab44f
Reviewed-on: http://gerrit.chromium.org/gerrit/4440
Reviewed-by: Chris Sosa <sosa@chromium.org>
Tested-by: David James <davidjames@chromium.org>
2011-07-21 10:43:28 -07:00
David James
bb5f9a9b5e Fix LATEST file to appear in the right place.
BUG=chromium-os:17722
TEST=Run sample archive_build with --debug mode and verify location of gsutil.

Change-Id: Idf39bfc9a80cdcd5f25d63f4839e9168f593adfd
Reviewed-on: http://gerrit.chromium.org/gerrit/4264
Reviewed-by: Chris Sosa <sosa@chromium.org>
Tested-by: David James <davidjames@chromium.org>
2011-07-18 13:25:33 -07:00
Nick Sanders
119677f3b9 Add netboot output to factory bundle
* kernel, initrd, legacy firmware

BUG=chrome-os-partner:3667
TEST=archive_build.sh

Change-Id: I54b11067624e1c626cb6f059d4b8a52602c5837c
Reviewed-on: http://gerrit.chromium.org/gerrit/2028
Tested-by: Nick Sanders <nsanders@chromium.org>
Reviewed-by: Hung-Te Lin <hungte@chromium.org>
Reviewed-by: Rong Chang <rongchang@chromium.org>
2011-06-21 17:13:19 -07:00
Chris Sosa
e1b5bfad0e Cp testtarball to outdir and upload from there.
This solves this issue where if we don't upload to gsutil and instead
just archive locally we still have the test tarball.

BUG=chromium-os:16014
TEST=Ran with no gsutil option set and a tarball file.

Change-Id: I5e14801f7b0a58f589a400278274fb566e580bea
Reviewed-on: http://gerrit.chromium.org/gerrit/1921
Reviewed-by: Chris Masone <cmasone@chromium.org>
Tested-by: Chris Sosa <sosa@chromium.org>
2011-06-01 16:39:10 -07:00
Peter Mayo
32125c5645 Archive build uses commands that may need to reassemble and re-emerge components. This gets it to pass USE flags in case some of the components are desired in a non-default configuration.
Change-Id: I3d096ec63510e470aad25de8da1112be28a5bfca

BUG=78345
TEST=Manual runs.

Review URL: http://codereview.chromium.org/6881112
2011-05-02 11:37:12 -04:00
Scott Zawalski
c1bb3c8bac Add in a gsutil_append_latest bool option to avoid appending ChromeOS-Hash-B#
to the output of images uploaded to Google Storage. This is a stop gap solution
until I migrate all builders to uploading with the new structure.

BUG=NA
TEST=Ran on a finished buildbot to ensure the proper behaviour

Review URL: http://codereview.chromium.org/6749018
2011-03-25 16:56:32 -07:00
Nick Sanders
4ed0b8680a Rebuild image for factory
BUG=chrome-os-partner:2442
TEST=run locally - not barf

Change-Id: I0d63227253177d6e6314ae315eaec8ca85f26212

Review URL: http://codereview.chromium.org/6626040
2011-03-06 15:21:42 -08:00
Chris Sosa
b885b80a33 Remove old logic ... and don't needlessly modifiy dev image.
Change-Id: I9b4047f2f124875553542df73e16cba6be41c561

BUG=chromium-os:chromium-os:8364
TEST=Ran it with pfq options.

Review URL: http://codereview.chromium.org/6527001
2011-02-16 15:33:11 -08:00
Chris Sosa
c04833cb5b Add tarball option and print out what gsutil would do to make it easier to debug.
Change-Id: I041053a017ee0aabbbeb30b4753bf9594e8d1d83

BUG=chromium-os:8364
TEST=Ran it manually here.

Review URL: http://codereview.chromium.org/6508011
2011-02-14 11:31:14 -08:00
Chris Sosa
89e9244910 Print out full path to archive url.
Change-Id: I6df0244d786794107c7d166c882c3585837c48a5

BUG=chromium-os:8364
TEST=Visually

Review URL: http://codereview.chromium.org/6512004
2011-02-11 17:42:55 -08:00
David James
2b2f19fc2e Update archive_build.sh to use new location of prebuilt.py.
BUG=chromium-os:11171
TEST=none

Change-Id: I1ae54be5fd0e1606ca2690399c465f667e4be922

Review URL: http://codereview.chromium.org/6286051
2011-02-02 10:35:42 -08:00
Greg Spencer
798d75f3be This starts to fix the scripts so that they load from /usr/lib/crosutils
from within the chroot.

It also fixes a number of style issues.

It changes the meaning of cros_workon "list-all" to list all available
packages, and adds "list-live" to list all live packages.

It changes things that load chromeos-common.sh from the installer to
load it from /usr/lib/installer.

BUG=chromium-os:4230
TEST=synced, rebuilt chroot, made packages, made images, built chrome
from source, and wrote an image to a USB stick.

Review URL: http://codereview.chromium.org/6240018

Change-Id: I90c34420af1a64020402bafef8e9e77f56837c02
2011-02-01 22:04:49 -08:00
Yasuhiro Matsuda
27c473d6c7 Fix the path of chromeos_version.sh in archive_build.sh
Change-Id: I16fd83aef4cfc11245a95af66813f7689386949b

TBR=djmm
BUG=chromium-os:9714, chromium-os:10354
TEST=none

Review URL: http://codereview.chromium.org/5884001
2010-12-15 17:35:54 +09:00
Raja Aluri
aeb1048742 Moving generating au-generator.zip file to build_image.
Change-Id: Id4ed6af96e0b621f4ad36966fad45c887b991373

BUG=None
TEST=Ran a fresh build_packages and build_image for x86-generic.

Review URL: http://codereview.chromium.org/5689004
2010-12-10 13:03:09 -08:00
David James
3146eaa74e Fix typo where host prebuilts aren't getting updated.
archive_build.sh has code to archive host prebuilts, but the code isn't working because of a typo in archive_build.sh.

The typo: $FLAGS_board is misspelled as $FLAGS_BOARD.

BUG=chromium-os:10148
TEST=Ran prebuilt.py with --sync-host option

Change-Id: I50129b1fdfb931b1c076a064b970d7d943f556ac

Review URL: http://codereview.chromium.org/5724001
2010-12-09 09:37:14 -08:00
repo sync
bce3668d75 Revert "Copying au-generator.zip file to the image directory"
This reverts commit a8107a22d6.

TEST=none
BUG=http://code.google.com/p/chromium-os/issues/detail?id=9639

Change-Id: I45c41dc6a3ffc22363bd9775c335fa87c0aa5174

TBR=
2010-11-24 15:00:43 -08:00
Raja Aluri
a8107a22d6 Copying au-generator.zip file to the image directory
Change-Id: Id4ed6af96e0b621f4ad36966fad45c887b991373

BUG=4015
TEST=Ran archiv_build.sh with the build_bot flow

Review URL: http://codereview.chromium.org/5305006
2010-11-24 11:22:55 -08:00
Scott Zawalski
7333e2b4c4 Update prebuilt.py call to use the _proper_ variable for finding the build root.
BUG=8603
TEST=Tested where GCLIENT_ROOT points to on rm and x86

Review URL: http://codereview.chromium.org/4363001
2010-11-02 18:01:14 -07:00
Scott Zawalski
27dbab06f2 Update prebuilt.py call to reference proper external path
BUG=NA
TEST=Ran on a full buildbot run to verify paths

Review URL: http://codereview.chromium.org/4282002
2010-11-02 00:46:37 -07:00
Scott Zawalski
2eb6dfb872 Fix flag boolean 2010-10-29 11:11:41 -07:00
Scott Zawalski
3b0c6d8f83 Since archive_build is also called by cbuild we need to hide the
prebuilt call behind a flag.
2010-10-29 11:07:42 -07:00
Scott Zawalski
720364bf56 Update relative path to be 4 directories deep since archive_build's cwd
is abused throughout the script and this is where end up at when prebuilt
is called

BUG=8389
TEST=Ran from the directory archive_build actually runs from.

Review URL: http://codereview.chromium.org/4119017
2010-10-29 10:40:57 -07:00
Scott Zawalski
695adf144a Update archive_build to push prebuilts to Google storage land.
Enabled host prebuilt upload on the x86-generic target.

BUG=NA
TEST=Tested on an x86-generic build to ensure it uploads as expected

Review URL: http://codereview.chromium.org/4128014
2010-10-28 16:56:00 -07:00
J. Richard Barnette
e1010d8cb2 Fix two very broken tests for null strings in archive_build.sh
Change-Id: I7c5d251ab1ae020c3ae8a10ca017c34a02eff893

BUG=None
TEST=./archive_build.sh --test_mod
TEST=./archive_build.sh --test_mod --from=../build/images/x86-generic
TEST=./archive_build.sh --board=x86-generic --gsutil_archive=/tmp --gsutil=echo
TEST=./archive_build.sh --board=x86-generic --gsutil_archive=/tmp --gsutil=echo --gsd_gen_index=echo

Review URL: http://codereview.chromium.org/4153001
2010-10-26 11:21:47 -07:00
Nick Sanders
ad0599f00c Workaround chrome-bot's special case wackiness.
BUG=4547
TEST="untestable - the failure can only occur on chrome-bot, which I don't have access to "

Change-Id: Ia90eaa7c673f16533dbc397adf7f76e6404c6d2b

Review URL: http://codereview.chromium.org/3978005
2010-10-22 21:15:02 -07:00
Ken Mixter
9b07a8ed9d Revert "Allow build of shim"
This reverts commit 9a9ba1f769.

BUG=
TEST=

Review URL: http://codereview.chromium.org/4048002

Change-Id: I69d55a29bee690ac374c82a48fa718afe44dbaa1
2010-10-22 17:09:28 -07:00
Nick Sanders
9a9ba1f769 Allow build of shim
BUG=4547
TEST="run archive build"
Change-Id: I716fbd2f648b8e5137ee515aaed7be89a6af8f37

Review URL: http://codereview.chromium.org/3828015
2010-10-22 11:11:08 -07:00
Ken Mixter
8899d5a90b Store away breakpad symbols in debug.tgz
BUG=5355

Change-Id: I1f6dff3808c5bfaf4b7ed6ba75e4d19b196d749c

Review URL: http://codereview.chromium.org/3166029
2010-08-25 09:17:38 -07:00
Scott Zawalski
ec6421c21a Currently we pass in the path that is outside of the chroot to a script that runs inside of the chroot. We need to make sure we pass the path that is in the chroot to the mod_image_for_recovery.sh.
Review URL: http://codereview.chromium.org/3014048
2010-08-02 12:31:35 -07:00
David McMahon
7f2951d993 Add do_recovery_mod() to create recovery image
Review URL: http://codereview.chromium.org/3020037
2010-07-29 14:37:06 -07:00
Zelidrag Hornung
151112ce00 Add checkpoints to archive_build
Review URL: http://codereview.chromium.org/2806088
2010-07-29 10:32:26 -07:00
Zelidrag Hornung
e6532bc3dd Added output to tar command so it does not cause timeout to kick in.
Review URL: http://codereview.chromium.org/3076012
2010-07-28 11:34:29 -07:00
Ken Mixter
25d48c4dcd Use gsutil to archive debug.tgz too
BUG=4263

Review URL: http://codereview.chromium.org/2866036
2010-07-01 11:20:42 -07:00
Ken Mixter
aba0429e24 Archive debug artifacts - take two
Review URL: http://codereview.chromium.org/2852033
2010-06-30 12:38:53 -07:00
bradnelson
51a2e575b5 Fixing yet another path mistake.
BUG=None
TEST=None
TBR=djmm

Merge branch 'master' of ssh://chromiumos-git/crosutils

Fixing typo

BUG=None
TEST=None
TBR=djmm

Merge branch 'master' of ssh://chromiumos-git/crosutils

Fixing command line to work with file acls.

Merge branch 'gsd'

Merge branch 'master' into gsd

Fixing typo in command line.

Refactoring gsutil archiving into a function. Adding optional gsd_generate_index step.

Adding ACL option to archive_build.sh

Review URL: http://codereview.chromium.org/2881005
2010-06-30 05:13:18 -07:00
bradnelson
2303fa1d0f Fixing typo
BUG=None
TEST=None
TBR=djmm

Merge branch 'master' of ssh://chromiumos-git/crosutils

Fixing command line to work with file acls.

Merge branch 'gsd'

Merge branch 'master' into gsd

Fixing typo in command line.

Refactoring gsutil archiving into a function. Adding optional gsd_generate_index step.

Adding ACL option to archive_build.sh

Review URL: http://codereview.chromium.org/2803030
2010-06-30 04:51:26 -07:00
bradnelson
ed7f1122d6 Fixing command line to work with file acls.
Merge branch 'gsd'

Merge branch 'master' into gsd

Fixing typo in command line.

Refactoring gsutil archiving into a function. Adding optional gsd_generate_index step.

Adding ACL option to archive_build.sh

Review URL: http://codereview.chromium.org/2847036
2010-06-30 01:44:45 -07:00
bradnelson
8046594c0e Adding ACL option to archive_build.sh
Review URL: http://codereview.chromium.org/2804030
2010-06-29 18:12:08 -07:00
robotboy
b49136dc8a TBR: Fix tree breakage. Ken's commit added sudo calls to archive_build.sh. 2010-06-29 15:03:37 -07:00
Ken Mixter
428e195dbe Add debug.tgz debug info archive as buildbot artifact
BUG=4263

Review URL: http://codereview.chromium.org/2852022
2010-06-29 12:42:51 -07:00
bradnelson
7fcb19234b Adding option to archive to google storage for developers.
Review URL: http://codereview.chromium.org/2834016
2010-06-22 20:37:01 -07:00
Nick Sanders
07eac9ef47 Change file permissions on factory.zip
Review URL: http://codereview.chromium.org/2714005
2010-06-16 04:19:39 -07:00
Chris Sosa
bfabd932e9 Do not delete src_image if --notest_mod is set.
TEST=From an already built image dir, ran archive_build with --notest_mod
set and verified the image had chromiumos_base_image.bin and chromiumos_image.bin.

Review URL: http://codereview.chromium.org/2111015
2010-05-21 09:54:46 -07:00
Nick Sanders
5fa0950681 add optional facory builds to archive_build
Review URL: http://codereview.chromium.org/2084013
2010-05-20 20:37:14 -07:00
Chris Sosa
d44550272c Cleanup of adding pristine image and fixing of symlinks in developer image.
TEST=Tested with building a new image, looking in the output directory, running
the image and running vi.

Review URL: http://codereview.chromium.org/2075019
2010-05-20 10:14:06 -07:00