Commit Graph

28179 Commits

Author SHA1 Message Date
Sean O'Connor
d41bbf4fd5 devserver support for update images from buildbot.
Remove implicit sudo from gpt partition packing scripts.

Misc cleanup and fixes included.

Review URL: http://codereview.chromium.org/1633018
2010-04-16 13:50:40 -07:00
Ken Mixter
d5c4b17da5 Revert "Retry on build_image failures and make sbt more aggressive by default"
This reverts commit 7c3272657eb2e3a106090c5ab57f16ba5ba21ffe.

Review URL: http://codereview.chromium.org/1594035
2010-04-16 10:11:02 -07:00
Ken Mixter
c223ba1e0c Retry on build_image failures and make sbt more aggressive by default
As with build_packages, only retries by default if you passed --jobs
even though build_image will indeed spuriously fail with only one job.
sync_build_test now uses jobs=#cores by default for both package and
image building.  Eventually will also use this for gclient sync'ing
once that is better vetted.

Review URL: http://codereview.chromium.org/1564035
2010-04-16 09:08:26 -07:00
Mike Truty
c5f1d31034 Add ssh cleanup to avoid leaving running agents around when imaging problems.
Review URL: http://codereview.chromium.org/1609025
2010-04-14 16:11:22 -07:00
Darin Petkov
835ea28436 Add generate_test_report to the hwqual package.
Will remove it from the autotest repo in a separate CL.

Review URL: http://codereview.chromium.org/1576035
2010-04-14 12:58:20 -07:00
Chris Sosa
3d9a10b393 Fix install mask and move dev_mode to true when dev packages are installed
Review URL: http://codereview.chromium.org/1553028
2010-04-13 15:00:46 -07:00
Andrew de los Reyes
23fbe7dde4 Tracker/Spreadsheet sync: tool to sync tracker issues
This can be useful for working with issues in a spreadsheet and making
bulk updates to tracker issues.

See known issues in the file for important known issues.

Review URL: http://codereview.chromium.org/1566037
2010-04-13 13:32:03 -07:00
Eric Li
ac2de13847 Refine image_to_live script to log all output from devserver.
Review URL: http://codereview.chromium.org/1572034
2010-04-13 13:19:08 -07:00
Bill Richardson
ba9682ac08 Change default grub.cfg to support fast-boot from EFI BIOS
Review URL: http://codereview.chromium.org/1518025
2010-04-13 13:02:32 -07:00
Eric Li
740d837451 Add iperf and netpipe into autotest prebuild test lists.
Now they should be built for both x86 and arm board.

Review URL: http://codereview.chromium.org/1621006
2010-04-13 10:07:15 -07:00
David McMahon
a2a9a2b5a8 Update CHROMEOS_VERSION_MINOR=7, Post R6.
Review URL: http://codereview.chromium.org/1645002
2010-04-12 18:22:56 -07:00
Jie Sun
5ade331b45 add install to arm platform
now we could install to mmcblk0.
for vogue, we even change the uboot environment.
on Samsung, you had to use 'chromeos-install --skip_src_removable' because mmcblk1 is not removable somehow.

Review URL: http://codereview.chromium.org/1618013
2010-04-12 17:04:36 -07:00
Chris Sosa
3ccf7410ea Add local dir's to path. SSH and SU respect paths in etc environment
Review URL: http://codereview.chromium.org/1650001
2010-04-12 16:00:17 -07:00
robotboy
9891221b6e Add a safe_unmount function and use it in enter_chroot.
The safe_unmount function first tries a regular unmount,  If that
fails it warns and tries a lazy unmount.  If the lazy unmount fails
it dies.

Both unmounts take the -d option in case the mount is a loop device.

BUG=None
TEST=Entered and exited multiple chroots

Review URL: http://codereview.chromium.org/1593021
2010-04-12 14:08:14 -07:00
David McMahon
ad9c20327d Run hwqual on test_mod=true as it has dependencies on test_mod=true.
Review URL: http://codereview.chromium.org/1553025
2010-04-12 12:21:35 -07:00
tedbo
373c3903c2 Add sudo_clobber and sudo_append functions so that we can "echo"
and "cat" stuff and pipe it to something that can write to a
file as root. For example:

echo "foo" | sudo_append /tmp/bar

will append "foo" to the file /tmp/bar as root. While

echo "foo" | sudo_clobber /tmp/bar

will truncate /tmp/bar and then write "foo" to the file.

Review URL: http://codereview.chromium.org/1610021
2010-04-12 10:52:40 -07:00
Chris Masone
30fa208c87 Tool for mounting USB sticks formatted with --statefuldev
sosa@'s statefuldev change, which installs all developer packages on
the stateful partition and has put /var there as well, means that we
can no longer just mount the rootfs on a usb stick and emerge packages
onto/off of the removeable device.  We now need to mount the stateful
partition as well, and also bindmount from /var on the rootfs to /var
on the stateful partition.  All portage state is stored there, among
other things.

Review URL: http://codereview.chromium.org/1644001
2010-04-12 08:59:05 -07:00
Eric Li
36e192758f Pass chroot flag into enter_chroot.
This is something missing from the original run_remote_tests script.

Review URL: http://codereview.chromium.org/1589022
2010-04-10 11:58:43 -07:00
Daniel Erat
35aa57a305 build: Suppress stupid question in image_to_usb.sh.
No point in asking the user if they're sure they want
to modify the image for testing when they asked us to
modify it for testing in the first place.

BUG=none
TEST=tried it

Review URL: http://codereview.chromium.org/1520031
2010-04-09 18:51:08 -07:00
Andrew de los Reyes
8d94f49f0d New Full AU Format w/ support for kernel partition.
The old format was: gzip(root filesystem). The new format is:
gzip(kernel parition length + kernel partition + root filesystem). The
length is 8 bytes (uint64 big endian).

This CL fixes the updater and the update generator to support the new
format.

Review URL: http://codereview.chromium.org/1520028
2010-04-09 16:07:37 -07:00
Jie Sun
96e2b09b24 current mkimage are build in u-boot package and copied to sys-root ( a x86 binary).
move mkimage to hard-host-depends and remove dependency from u-boot to kernel.
this will make use of mkimage on target possible in the future.

Review URL: http://codereview.chromium.org/1613008
2010-04-09 11:05:49 -07:00
Bill Richardson
a81df76a06 Replace "mount -o loop" with explict losetup use in build_image.
This fixes the loop device leak. The problem is that inside the chroot, we
have /etc/mtab as a symlink to /proc/mounts. That works most of the time,
but if you mount something using "-o loop", it isn't cleaned up correctly
when you umount it. To avoid that, we either have to replace the /etc/mtab
symlink with an empty file when we create the chroot, or we have to make
sure that we never execute a "mount -o loop" command from within the chroot.
If we use an empty /etc/mtab file, the builds work fine, but then we can't
see any mounted partitions that the host creates outside the chroot (such as
USB keys), which causes other problems. Bleah.

Review URL: http://codereview.chromium.org/1594020
2010-04-09 08:12:05 -07:00
Chris Sosa
1e5fe62f92 Fix build image
Review URL: http://codereview.chromium.org/1622015
2010-04-08 20:51:53 -07:00
Chris Masone
b9f7230dcd Fix permissions on fake root cert that is injected for login testing. It was getting 0600
Review URL: http://codereview.chromium.org/1626007
2010-04-08 16:05:32 -07:00
Andrew de los Reyes
e7a04adc83 Factory Installer.
Change build_image to support building a factory install image. Also,
a shell script and startup script to run the factory installer.

Change software_update startup script to detect if it's a factory
install and abort if so.

BUG=2378,2379,2380
TEST=Tested factory install worked on device.
Wrapper script to perform factory install at boot.

AU: New arg to install on non-boot device partition. This is used to
install in the factory. Also, switch to shflags for argument parsing.

Review URL: http://codereview.chromium.org/1556022
2010-04-08 15:58:17 -07:00
Chris Sosa
503efe1f65 Add /usr/local/lib to readlibs for test_image and move ldconfig higher for sful
Review URL: http://codereview.chromium.org/1618007
2010-04-08 10:05:46 -07:00
Chris Sosa
4bffb8be6a Fix symlinks for gmergefs on stateful and keep other stateful items installed from build_image
Review URL: http://codereview.chromium.org/1561014
2010-04-07 17:23:54 -07:00
Darin Petkov
dab00363f1 Fix 'autotest' defaults -- i.e., fail when tests fail to build,
just like build_autotest. This unmasks some test build failures that
are currently happenning.

Review URL: http://codereview.chromium.org/1582017
2010-04-07 17:16:54 -07:00
Eric Li
941893f111 Enable default board in the new build_autotest script.
Review URL: http://codereview.chromium.org/1582019
2010-04-07 17:00:36 -07:00
Eric Li
f93158db51 Filter out test directory which has only control files.
Review URL: http://codereview.chromium.org/1627006
2010-04-07 15:34:01 -07:00
Jie Sun
6795867104 fix a sudo issue
Review URL: http://codereview.chromium.org/1549025
2010-04-07 14:34:04 -07:00
Eric Li
7a4c081107 remove build_autotest.sh and change run_remote_tests.sh to use new autotest script.
This change should go with

http://codereview.chromium.org/1545014

together.

Review URL: http://codereview.chromium.org/1603004
2010-04-07 12:51:05 -07:00
Bill Richardson
8b3bd10b91 Create EFI System Partition on USB image during build.
The EFI System Partition is a special disk partition where EFI BIOS expects
to find the platform-specific bootloader. We need this in order to work on
the BIOS/kernel handoff. It's not needed for the final ChromeOS image and it
isn't useful for legacy BIOS systems, so right now it only makes any difference on x86
devices with development BIOSes.

This change creates the partition for ARM builds as well; it has no effect
there, either.

Review URL: http://codereview.chromium.org/1513019
2010-04-06 15:00:10 -07:00
robotboy
e450333e3f Set the bootargs in the MBR script.
This is one less thing to change when setting up a Voguev210 and if
we need to change anything later we won't have to reconnect all of
them to debug boards.

BUG=None
TEST=Build and boot a Voguev210 image.

Review URL: http://codereview.chromium.org/1596010
2010-04-05 17:26:46 -07:00
Chris Masone
35a83f99e4 Apparently, we have to have a rootfs big enough to hold all dev and test tools too.
I need a couple extra tools for testing purposes (about 10MB).  I'd love to not add space to the rootfs for these.  But...talking to sosa, it doesn't seem there's any other way.

Review URL: http://codereview.chromium.org/1576018
2010-04-05 16:51:53 -07:00
Chris Sosa
317d8eb3fd Better handling of fuse in chroot
Review URL: http://codereview.chromium.org/1582011
2010-04-05 15:45:28 -07:00
rginda
9f90710f3b A pair of scripts to make it easier to run and debug 32 bit executables on 64 bit systems
For Example:

  # run the 32 bit binary located ad ../platform/foo/a.out
  $ run_32bit.sh ../platform/foo/a.out

  # run a.out from the current directory, and pass it the --verbose=3 command line option
  $ ../../scripts/run_32bit.sh -- a.out --verbose=3

  # debug a.out from the current directory, include ../v8 in the library search path
  $ LIB_PATHS='../v8/' ../../scripts/debug_32bit.sh a.out

run_32bit.sh runs a 32bit executable, debug_32bit.sh starts up gdb so that it's ready to
debug a 32bit target.  Both scripts work from in or out of the chroot.

If you're running from outside the chroot, you can pass a --chroot command line option to
locate the chroot, otherwise a default is computed through the normal mechanism.

Pass the 32 bit target as the parameter to either of these scripts.  If you need to provide
additional parameters to your command, then you should use -- to signify the end of *_32bit.sh
parameters.

These could be useful to people developing parts of chromeos that can be easily isolated
from the rest of the system.  If your code doesn't NEED to run on a chromeos device it
can be a bit easier to try it out on your owm machine during dev/test.

Review URL: http://codereview.chromium.org/1131002
2010-04-05 15:22:44 -07:00
Eric Li
78d6232543 Darin proposed a way to run common.sh inside a python process and now I can get rid the bash wrapper around autotest.py.
The content of autotest.py is copied into autotest and I am leaving autotest.py inside the CL for now since its much easier to review the diff.

After got LGTM, I will git rm autotest.py and only submit autotest.

Review URL: http://codereview.chromium.org/1584013
2010-04-05 14:18:32 -07:00
Chris Sosa
c7b65a46b4 TBR: Forgot quote 2010-04-02 14:17:55 -07:00
Chris Sosa
6bc771a50b TBR: Sorry fix for build again 2010-04-02 14:15:53 -07:00
Chris Sosa
7138f0a79b TBR:Fix build. Shouldn't do fuse stuff if fuse isn't installed on host 2010-04-02 14:12:05 -07:00
Chris Sosa
aa1a7fd63d Adds gmergefs. A method of remoting to a target and pushing new
packages using emerge from the host

Review URL: http://codereview.chromium.org/1515011
2010-04-02 14:06:29 -07:00
Antoine Labour
e9e585f330 Add a --to option to build_image
That way we can directly build an image onto a usb stick/sd card without a separate step.
Also, add mounting of /sys into the chroot that is needed by build_gpt on a block device.

Review URL: http://codereview.chromium.org/1521012
2010-04-01 15:57:57 -07:00
Andrew de los Reyes
cd78944051 test-fixet: Automated VMWare test of AutoUpdate
Fully automated test that uses vmplayer to test updating from
dev-channel -> image-under-test -> rollback to dev-channel.

Also, change to vmware image generation so that vmware images are
generated with two 1-GiB sized root partitions

Review URL: http://codereview.chromium.org/1512001
2010-04-01 15:24:21 -07:00
Eric Li
cad2b49f8a fix a typerr in bach_complete.
Review URL: http://codereview.chromium.org/1576011
2010-04-01 13:07:10 -07:00
Chris Sosa
6c47714d93 Only mod image for test if necessary
Review URL: http://codereview.chromium.org/1606004
2010-04-01 10:51:33 -07:00
Ken Mixter
ce175d58d6 Make mod_image_for_test work with default args. Before the GPT change, by default mod_image_for_test would modify the result of your build.
Review URL: http://codereview.chromium.org/1572012
2010-04-01 10:08:11 -07:00
Bill Richardson
6dcea16492 Clean up temporary files and directories, add utilities.
Remove the temporary rootfs.image file and others that are left by build_image and related scripts. Also added tool to emit scripts that can pack and unpack the combined disk image.

Review URL: http://codereview.chromium.org/1567013
2010-03-31 19:20:24 -07:00
Andrew de los Reyes
faefea3359 VMWare/VirtualBox: Fix (broke earlier today w/ GPT switchover)
Review URL: http://codereview.chromium.org/1535008
2010-03-31 17:18:48 -07:00
Eric Li
3d13cd1bdb New autotest wrapper script and bash complete support.
A new command line script was introduced in this CL named autotest, which is intend to replace both build_autotest.sh and run_remote_tests.sh in the future.

This change list should be reviewed with
http://codereview.chromium.org/1513006
http://codereview.chromium.org/1595001

all together.

autotest --board x86-generic --build=all will build all client tests.

autotest --board x86-generic --build=unioxbench,ltp will build enlisted client tests.

autotest --board x86-generic -c client/tests/sleeptest/control -m 12.34.56.78 ...

will invoke autoserv inside emerge-x86-generic cross-compiling env, and do a prebuild of the client test before it got pushed onto client host.

you could also:

1. bash complete the directory/file name from autotest directory after -c or -s args.
2. supply any autoserv commandline args transparently.

Note: replace build_autotest.sh/run_remotes_test.sh is only a future plan. When all the three CLs got pushed, no existing use cases should be broken.

I need to change:
1. build_packages script from third_party/chromiumos-overlay/chromeos/scripts/build_packages.
2. add "enable_server_precompile: False " to third_party/autotest/files/global_config.ini

to activate it.

Review URL: http://codereview.chromium.org/1595001
2010-03-31 11:47:22 -07:00