Commit Graph

1728 Commits

Author SHA1 Message Date
Chris Sosa
b2f24a8d82 Adds ebuild support to build_autotest
Review URL: http://codereview.chromium.org/604013
2010-02-11 13:40:18 -08:00
Chris Sosa
431a7904ef Repatch
Review URL: http://codereview.chromium.org/596051
2010-02-10 17:19:24 -08:00
Andrew de los Reyes
c9317eac02 Chroot: allow multiple simultaneous entry.
Change enter_chroot.sh to keep a list of open PIDs (enter_chroot.sh
instances) in chroot/var/lock, and use flock on that file to support
atomic operations to it.

When entering chroot, append the PID to the lock file.

When exiting chroot, clear out current PID and any dead
PIDs/duplicates. If the lock file is empty, only then clean up the
mounts.

Note that I have a little bit of code duplication: the number 200,
which is a manually numbered fd in bash, seemed impossible to place
inside a variable. If you know how to do it, please let me know.

Review URL: http://codereview.chromium.org/584010
2010-02-10 13:16:36 -08:00
David McMahon
b7eb3a2be6 Add a warning to users trying to run old build scripts.
Add an exception for chrome-bot user for continuous builders.

Review URL: http://codereview.chromium.org/595009
2010-02-09 14:07:40 -08:00
David McMahon
b6fb706f38 Re-use .h code for both files. Add a license header.
Review URL: http://codereview.chromium.org/594006
2010-02-09 11:44:09 -08:00
Ken Mixter
d00425ef50 Support multiple chroots
this is necessary for portage-based builds which change the
chroot.  You must pass --chroot to the run_remote_tests in this
case.

Review URL: http://codereview.chromium.org/588010
2010-02-08 19:26:07 -08:00
Chris Masone
fdda89f49f move enable_localaccount.sh, make pam_offline use it
After this, we can update the buildbot and then land http://codereview.chromium.org/586006/show to remove the old version.

Review URL: http://codereview.chromium.org/591001
2010-02-08 13:11:31 -08:00
Ken Mixter
8a4af3a999 Make run_remote_tests also update the chroot autotest
Don't punish the good people trying to write python-only autotests by
requiring them to sit through a long build_autotest run to test
every change.  run_remote_tests and build_autotest both update
the chroot copy now.

Review URL: http://codereview.chromium.org/578027
2010-02-05 19:22:35 -08:00
Ken Mixter
1cca01402a Enable building autotests in test loop and sbt script
Review URL: http://codereview.chromium.org/556060
2010-02-01 19:05:54 -08:00
Sean O'Connor
9969ce9238 Make run_remote_test's use of ssh-agent more predictable.
Review URL: http://codereview.chromium.org/560005
2010-02-01 17:10:03 -08:00
David McMahon
797abfd825 Created branch release_30. Update CHROMEOS_VERSION_BRANCH=31 2010-01-29 11:19:14 -08:00
Darin Petkov
7470bca027 Provide an option to allow custom/local setup control file.
Review URL: http://codereview.chromium.org/553142
2010-01-28 15:21:17 -08:00
Chris Sosa
efd86f694c Add check for dpkg info and mkdir if it doesn't exist
Review URL: http://codereview.chromium.org/551177
2010-01-27 13:26:04 -08:00
Sean O'Connor
a6db82ed3e Cleanup and merge autotest wrappers.
Review URL: http://codereview.chromium.org/546137
2010-01-27 12:11:08 -08:00
David McMahon
224c7fda0c Add mechanism to support 'official' repositories and packages for releases. 2010-01-26 18:33:35 -08:00
Darin Petkov
2857eea2bc Export GCLIENT_ROOT from make_autotest
so that tests have access to the source/build trees during setup.
For example, gl_APICheck requires access to OpenGL headers.

Review URL: http://codereview.chromium.org/555111
2010-01-26 17:22:04 -08:00
Tim Gardner
c7e05719c5 kernel: use debian build infrastructure to build kernels.
This patch depends on kernel build infrastructure
mentioned in http://codereview.chromium.org/543194/show

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/553075
2010-01-26 15:05:10 -07:00
Ken Mixter
c0921383c0 Improvements for to continuous test loop.
Run a basic check on a buildbot grabbed image to make sure it has a
kernel installed in it.

Better failure recovery.

Review URL: http://codereview.chromium.org/553063
2010-01-25 11:02:32 -08:00
Colin Watson
35431dc239 Handle some special-case naming for chromiumos-build
chromiumos-build gets less confused if we refer to the package name
e4fsprogs-git rather than the directory name e2fsprogs (which is also a
different source package downloadable from Ubuntu).

Don't bother trying to build ibus-anthy, ibus-chewing, or ibus-hangul on
anything other than i386 for now.  They aren't easily cross-buildable
and we can live without input methods.

Review URL: http://codereview.chromium.org/554063
2010-01-25 16:51:59 +00:00
Colin Watson
e550bbd5ae Don't build packages inside destination directory
chromiumos-build's destination directory shouldn't be a build directory;
as advised in chromiumos-build(1), this can cause it to think that
failed builds were actually successful.  Build downloaded source
packages in src/build/ARCHITECTURE/external/ instead.

While we're here, rename the configuration file to a more visible name.

Review URL: http://codereview.chromium.org/548137
2010-01-25 16:35:10 +00:00
Colin Watson
2c3e57fd0a Create the pkgs dir if it does not already exist
Patch Contributed By: Nasser Grainawi <nasser@codeaurora.org>

Review URL: http://codereview.chromium.org/551126
2010-01-25 16:00:55 +00:00
tedbo
3700cd8c0c Some changes to be able to build an armel-based rootfs.
Review URL: http://codereview.chromium.org/554056
2010-01-22 16:39:36 -08:00
Andrew de los Reyes
cb68f29229 Build: allow package lists to be filtered by arch.
This is copied from lminier@ in his patch "Rewrite local repository
generation".

Review URL: http://codereview.chromium.org/548109
2010-01-22 14:54:42 -08:00
Tim Gardner
dd45d3272f Revert "kernel: Use the debian infrastructure to construct kernel config files"
This is causing some kernel version package issues. Revert until I can
figure out the right fix.

This reverts commit 6eda4bc874427041c5a2eab794eb72284e9dcee7.
2010-01-22 14:40:11 -07:00
Chris Sosa
73de2358c0 Adds script to mod image for test to enable new login manager on test images
Review URL: http://codereview.chromium.org/555039
2010-01-22 13:33:25 -08:00
Tim Gardner
9ee75d90a3 kernel: Use the debian infrastructure to construct kernel config files
This is the first step towards abandonding make-kpkg. The next
step is to remove the kernel config files under
$(KERNEL_DIR)/files/Config, thereby requiring the use
of config files in $(KERNEL_DIR)/files/debian.chrome/config

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/549135
2010-01-22 12:43:21 -07:00
Colin Watson
aaedee7f36 Various image build improvements for ARM
Add an --arch option to build_image.sh, passed to install_packages.sh.
Use it to set APT::Architecture.

Add --mirror2/--suite2 options to build_image.sh, and --server2/--suite2
options to install_packages.sh (differing option names to match options
that were there already).  This allows some of the packages to be pulled
from ports.ubuntu.com rather than from local_packages, like this:

  ./build_image.sh --arch armel --mirror2 http://ports.ubuntu.com/ubuntu-ports --suite2 karmic

Copy only .debs from local_packages, not whatever other junk might be
lying around there.

Use copy: rather than file: for local_packages, so that the files will
be copied into the apt cache directory for the benefit of
dpkg_no_scripts.sh.

Review URL: http://codereview.chromium.org/554031
2010-01-22 17:57:28 +00:00
Tim Gardner
1bd60cdedf Split the binary and source mirror defaults
(This was orignally reveiwed in the wrong place:
http://codereview.appspot.com/193057/show)

Many local mirrors (such as mine) only contain mirrors
of the binary packages, sufficient to create a debootstrap
chroot. Source packages, the sum of which, can be quite large and
are not typically mirrored locally. This patch allows one
to create a chroot with overrides to the desired mirrors, e.g.,

./make_chroot.sh --replace --mirror http://mirror.rtg.net/ubuntu

In this example all of the binaries come from my local mirror, all source
packages come from $DEFAULT_DEV_MIRROR.

./make_chroot.sh --replace --mirror_src http://archive.ubuntu.com/ubuntu

Here the source packages are pulled from the Ubuntu archive whereas the
binaries come from $DEFAULT_DEV_MIRROR.

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/545169
2010-01-22 09:46:32 -07:00
Ken Mixter
45319e9ad0 Add a script to simplify some common developer workflows.
Here are some example ways to use the script (from comments)

sync_build_test.sh
  syncs, recreates local repo and chroot, builds, and masters an
  image in the checkout based on your current directory, or if you
  are not in a checkout, based on the top level directory the script
  is run from.

sync_build_test.sh --image_to_usb=/dev/sdb -i
  same as above but then images USB device /dev/sdb with the image.
  Also prompt the user in advance of the steps we'll take to make
  sure they agrees.

sync_build_test.sh --top=~/foo --nosync --remote 192.168.1.2
  builds and masters an image in ~/foo, and live updates the machine
  at 192.168.1.2 with that image.

sync_build_test.sh --top=~/newdir --test "Pam BootPerfServer" \
     --remote=192.168.1.2
  creates a new checkout in ~/newdir, builds and masters an image
  which is live updated to 192.168.1.2 and then runs
  two tests (Pam and BootPerfServer) against that machine.

sync_build_test.sh --grab_buildbot=LATEST --test Pam --remote=192.168.1.2
  grabs the latest build from the buildbot, properly modifies it,
  reimages 192.168.1.2, and runs the given test on it.

Review URL: http://codereview.chromium.org/548094
2010-01-21 14:58:40 -08:00
Colin Watson
d4ecbea68c Remove duplication in chromiumos-build invocation
Review URL: http://codereview.chromium.org/555032
2010-01-21 22:10:09 +00:00
Steve VanDeBogart
844d5abb1d Maintainer script for flash
Fix chrome packaging (wrong symlink for plugin directory)
Pass architecture (ARCH) down from install_packages.sh
Remove tar from prod package list

Review URL: http://codereview.chromium.org/555027
2010-01-20 21:50:35 -08:00
Steve VanDeBogart
8cb7443cad Update maintainer script template
Review URL: http://codereview.chromium.org/543146
2010-01-20 21:39:29 -08:00
Eric Li
ce1ce9740a This is a resubmit. The original CL was lost due to local disk crashes.
Review URL: http://codereview.chromium.org/551087
2010-01-20 17:01:44 -08:00
rginda
40043a0997 integrate pam_offline with the build and packaging system
after this cl, pam_offline will be built by default, included in the image,
and configured as the pam authority for xscreensaver.

Review URL: http://codereview.chromium.org/554021
2010-01-20 13:42:32 -08:00
Bill Richardson
10d27c2540 Rewrite make_chroot.sh to use local mirrors directly.
Use our karmic mirror for creating the build chroot, removing the need for
make_local_repo.sh and the repo_list_*.txt files. If a local repo exists
when build_chroot.sh is run it will be used, but it's no longer necessary.

This change does not remove make_local_repo.sh or the repo_list_*.txt files.

Review URL: http://codereview.chromium.org/548083
2010-01-20 13:38:50 -08:00
tedbo
89fae0eff4 Fix when referencing --with_dev_pkgs flag. Doh!
Review URL: http://codereview.chromium.org/548092
2010-01-20 12:02:24 -08:00
tedbo
7237f473fb Add --with_dev_pkgs option to build_image.sh to pull in developer debug packages.
This defaults to TRUE when building an image.

This CL moves some developer-only packages from package-list-prod.txt to
package-list-debug.txt and adds support for a comma-separated list of
package lists to build_image.sh.

Actually, I'd like to rename package-list-dev.txt to package-list-build.txt
and package-list-debug.txt to package-list-dev.txt but maybe in another CL.

Also there is a patch from lool that we should grab some stuff from that
can filter the package lists by build architecture. Eventually we will
likely add target-specific package lists as well.

With this change, build_image.sh --nowith_dev_pkgs will build an image
that does not contain niceties such as xterm.

Review URL: http://codereview.chromium.org/549107
2010-01-20 10:34:33 -08:00
Satoru Takabayashi
8d2a034fa0 Build and package candidate_window in addition to chrome.
candidate_window is used for entering text in CJK languages.
See the design doc of "Chromium OS Text Input" for details:
http://sites.google.com/a/chromium.org/dev/chromium-os/chromiumos-design-docs/text-input

TEST=Ran "build_chrome.sh" and confirmed that candidate_window is included in chrome-chromeos.zip

Review URL: http://codereview.chromium.org/543105
2010-01-20 19:12:25 +09:00
Andrew de los Reyes
79d99a83c3 ARM build: replacement postinst for netbase
Review URL: http://codereview.chromium.org/545130
2010-01-19 22:56:27 -08:00
tedbo
ac0346a9dd Move set of bootstrap /dev devices to /lib/chromiumos/devices.
Rather than pull the initial set from /lib/udev/devices, we
move them to /lib/chromiumos/devices.

We also whitelist the udev maintainer script since we don't need
to have it create devices in /lib/udev/devices and we also do not
need it to create the persistent rules files.

Review URL: http://codereview.chromium.org/552056
2010-01-19 19:41:02 -08:00
Chris Sosa
a49e77f70b Wrong command entered here. Need absolute path
Review URL: http://codereview.chromium.org/552058
2010-01-19 18:40:55 -08:00
Steve VanDeBogart
bf201ba640 Fix the creation of .list files for dpkg with maintainer scripts
Remove explicit use of sh to run custom maintainer postinst scripts.

Review URL: http://codereview.chromium.org/542135
2010-01-19 17:14:05 -08:00
Chris Sosa
8a09a05ef0 Modifies archived build to include a test image in the zip file
Review URL: http://codereview.chromium.org/542131
2010-01-19 16:05:36 -08:00
Ken Mixter
57d2a6bd12 Add functionality required for perf dashboard.
image_to_live.sh - fix problem where errorvalue is non-zero even when
  reimage was successful.
run_remote_tests.sh - add ability to stow build description in the
  autotest database so we can track the exact build for which
  tests succeed/fail.

Review URL: http://codereview.chromium.org/547018
2010-01-18 10:58:25 -08:00
Steve VanDeBogart
8174ba0782 Move is_whitelisted to the common script so that all users get the previous fix
Fix typo to enable preinst scripts to run

Review URL: http://codereview.chromium.org/542097
2010-01-15 19:45:30 -08:00
Steve VanDeBogart
6a76c4d9b4 Change the replacement dpkg to respect comment lines in package.whitelist
Review URL: http://codereview.chromium.org/543099
2010-01-15 16:54:29 -08:00
Eric Li
3a704ffee4 Rework run_autotest.sh to support server side control files.
The idea here is to remove flag processing inside this wrapper script and pass on all flags into autoserv.

I've tested with server/site_tests/system_BootPerfServer and a client side tests.

Both work fine.

Review URL: http://codereview.chromium.org/536081
2010-01-15 15:47:43 -08:00
Daniel Erat
af9c8deafe build: Add gnupg and x11-utils to prod package list.
apt-get can't verify signatures without GPG, which
leads to devserver scripts breaking.  xwininfo and
xprop are useful for debugging X issues.

Review URL: http://codereview.chromium.org/542079
2010-01-15 10:09:11 -08:00
Eric Li
4ff32f64b9 Enhance autotest run inside chroot.
Review URL: http://codereview.chromium.org/542068
2010-01-15 10:08:16 -08:00
Ken Mixter
88aaf818cb Reenable upstart now that we can build it reliably.
Review URL: http://codereview.chromium.org/551021
2010-01-14 17:05:49 -08:00