5075 Commits

Author SHA1 Message Date
David McMahon
b7eb3a2be6 Add a warning to users trying to run old build scripts.
Add an exception for chrome-bot user for continuous builders.

Review URL: http://codereview.chromium.org/595009
2010-02-09 14:07:40 -08:00
David McMahon
b6fb706f38 Re-use .h code for both files. Add a license header.
Review URL: http://codereview.chromium.org/594006
2010-02-09 11:44:09 -08:00
Ken Mixter
d00425ef50 Support multiple chroots
this is necessary for portage-based builds which change the
chroot.  You must pass --chroot to the run_remote_tests in this
case.

Review URL: http://codereview.chromium.org/588010
2010-02-08 19:26:07 -08:00
Chris Masone
fdda89f49f move enable_localaccount.sh, make pam_offline use it
After this, we can update the buildbot and then land http://codereview.chromium.org/586006/show to remove the old version.

Review URL: http://codereview.chromium.org/591001
2010-02-08 13:11:31 -08:00
Ken Mixter
8a4af3a999 Make run_remote_tests also update the chroot autotest
Don't punish the good people trying to write python-only autotests by
requiring them to sit through a long build_autotest run to test
every change.  run_remote_tests and build_autotest both update
the chroot copy now.

Review URL: http://codereview.chromium.org/578027
2010-02-05 19:22:35 -08:00
Ken Mixter
1cca01402a Enable building autotests in test loop and sbt script
Review URL: http://codereview.chromium.org/556060
2010-02-01 19:05:54 -08:00
Sean O'Connor
9969ce9238 Make run_remote_test's use of ssh-agent more predictable.
Review URL: http://codereview.chromium.org/560005
2010-02-01 17:10:03 -08:00
David McMahon
797abfd825 Created branch release_30. Update CHROMEOS_VERSION_BRANCH=31 2010-01-29 11:19:14 -08:00
Darin Petkov
7470bca027 Provide an option to allow custom/local setup control file.
Review URL: http://codereview.chromium.org/553142
2010-01-28 15:21:17 -08:00
Chris Sosa
efd86f694c Add check for dpkg info and mkdir if it doesn't exist
Review URL: http://codereview.chromium.org/551177
2010-01-27 13:26:04 -08:00
Sean O'Connor
a6db82ed3e Cleanup and merge autotest wrappers.
Review URL: http://codereview.chromium.org/546137
2010-01-27 12:11:08 -08:00
David McMahon
224c7fda0c Add mechanism to support 'official' repositories and packages for releases. 2010-01-26 18:33:35 -08:00
Darin Petkov
2857eea2bc Export GCLIENT_ROOT from make_autotest
so that tests have access to the source/build trees during setup.
For example, gl_APICheck requires access to OpenGL headers.

Review URL: http://codereview.chromium.org/555111
2010-01-26 17:22:04 -08:00
Tim Gardner
c7e05719c5 kernel: use debian build infrastructure to build kernels.
This patch depends on kernel build infrastructure
mentioned in http://codereview.chromium.org/543194/show

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/553075
2010-01-26 15:05:10 -07:00
Ken Mixter
c0921383c0 Improvements for to continuous test loop.
Run a basic check on a buildbot grabbed image to make sure it has a
kernel installed in it.

Better failure recovery.

Review URL: http://codereview.chromium.org/553063
2010-01-25 11:02:32 -08:00
Colin Watson
35431dc239 Handle some special-case naming for chromiumos-build
chromiumos-build gets less confused if we refer to the package name
e4fsprogs-git rather than the directory name e2fsprogs (which is also a
different source package downloadable from Ubuntu).

Don't bother trying to build ibus-anthy, ibus-chewing, or ibus-hangul on
anything other than i386 for now.  They aren't easily cross-buildable
and we can live without input methods.

Review URL: http://codereview.chromium.org/554063
2010-01-25 16:51:59 +00:00
Colin Watson
e550bbd5ae Don't build packages inside destination directory
chromiumos-build's destination directory shouldn't be a build directory;
as advised in chromiumos-build(1), this can cause it to think that
failed builds were actually successful.  Build downloaded source
packages in src/build/ARCHITECTURE/external/ instead.

While we're here, rename the configuration file to a more visible name.

Review URL: http://codereview.chromium.org/548137
2010-01-25 16:35:10 +00:00
Colin Watson
2c3e57fd0a Create the pkgs dir if it does not already exist
Patch Contributed By: Nasser Grainawi <nasser@codeaurora.org>

Review URL: http://codereview.chromium.org/551126
2010-01-25 16:00:55 +00:00
tedbo
3700cd8c0c Some changes to be able to build an armel-based rootfs.
Review URL: http://codereview.chromium.org/554056
2010-01-22 16:39:36 -08:00
Andrew de los Reyes
cb68f29229 Build: allow package lists to be filtered by arch.
This is copied from lminier@ in his patch "Rewrite local repository
generation".

Review URL: http://codereview.chromium.org/548109
2010-01-22 14:54:42 -08:00
Tim Gardner
dd45d3272f Revert "kernel: Use the debian infrastructure to construct kernel config files"
This is causing some kernel version package issues. Revert until I can
figure out the right fix.

This reverts commit 6eda4bc874427041c5a2eab794eb72284e9dcee7.
2010-01-22 14:40:11 -07:00
Chris Sosa
73de2358c0 Adds script to mod image for test to enable new login manager on test images
Review URL: http://codereview.chromium.org/555039
2010-01-22 13:33:25 -08:00
Tim Gardner
9ee75d90a3 kernel: Use the debian infrastructure to construct kernel config files
This is the first step towards abandonding make-kpkg. The next
step is to remove the kernel config files under
$(KERNEL_DIR)/files/Config, thereby requiring the use
of config files in $(KERNEL_DIR)/files/debian.chrome/config

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/549135
2010-01-22 12:43:21 -07:00
Colin Watson
aaedee7f36 Various image build improvements for ARM
Add an --arch option to build_image.sh, passed to install_packages.sh.
Use it to set APT::Architecture.

Add --mirror2/--suite2 options to build_image.sh, and --server2/--suite2
options to install_packages.sh (differing option names to match options
that were there already).  This allows some of the packages to be pulled
from ports.ubuntu.com rather than from local_packages, like this:

  ./build_image.sh --arch armel --mirror2 http://ports.ubuntu.com/ubuntu-ports --suite2 karmic

Copy only .debs from local_packages, not whatever other junk might be
lying around there.

Use copy: rather than file: for local_packages, so that the files will
be copied into the apt cache directory for the benefit of
dpkg_no_scripts.sh.

Review URL: http://codereview.chromium.org/554031
2010-01-22 17:57:28 +00:00
Tim Gardner
1bd60cdedf Split the binary and source mirror defaults
(This was orignally reveiwed in the wrong place:
http://codereview.appspot.com/193057/show)

Many local mirrors (such as mine) only contain mirrors
of the binary packages, sufficient to create a debootstrap
chroot. Source packages, the sum of which, can be quite large and
are not typically mirrored locally. This patch allows one
to create a chroot with overrides to the desired mirrors, e.g.,

./make_chroot.sh --replace --mirror http://mirror.rtg.net/ubuntu

In this example all of the binaries come from my local mirror, all source
packages come from $DEFAULT_DEV_MIRROR.

./make_chroot.sh --replace --mirror_src http://archive.ubuntu.com/ubuntu

Here the source packages are pulled from the Ubuntu archive whereas the
binaries come from $DEFAULT_DEV_MIRROR.

Signed-off-by: Tim Gardner <tim.gardner@canonical.com>

Review URL: http://codereview.chromium.org/545169
2010-01-22 09:46:32 -07:00
Ken Mixter
45319e9ad0 Add a script to simplify some common developer workflows.
Here are some example ways to use the script (from comments)

sync_build_test.sh
  syncs, recreates local repo and chroot, builds, and masters an
  image in the checkout based on your current directory, or if you
  are not in a checkout, based on the top level directory the script
  is run from.

sync_build_test.sh --image_to_usb=/dev/sdb -i
  same as above but then images USB device /dev/sdb with the image.
  Also prompt the user in advance of the steps we'll take to make
  sure they agrees.

sync_build_test.sh --top=~/foo --nosync --remote 192.168.1.2
  builds and masters an image in ~/foo, and live updates the machine
  at 192.168.1.2 with that image.

sync_build_test.sh --top=~/newdir --test "Pam BootPerfServer" \
     --remote=192.168.1.2
  creates a new checkout in ~/newdir, builds and masters an image
  which is live updated to 192.168.1.2 and then runs
  two tests (Pam and BootPerfServer) against that machine.

sync_build_test.sh --grab_buildbot=LATEST --test Pam --remote=192.168.1.2
  grabs the latest build from the buildbot, properly modifies it,
  reimages 192.168.1.2, and runs the given test on it.

Review URL: http://codereview.chromium.org/548094
2010-01-21 14:58:40 -08:00
Colin Watson
d4ecbea68c Remove duplication in chromiumos-build invocation
Review URL: http://codereview.chromium.org/555032
2010-01-21 22:10:09 +00:00
Steve VanDeBogart
844d5abb1d Maintainer script for flash
Fix chrome packaging (wrong symlink for plugin directory)
Pass architecture (ARCH) down from install_packages.sh
Remove tar from prod package list

Review URL: http://codereview.chromium.org/555027
2010-01-20 21:50:35 -08:00
Steve VanDeBogart
8cb7443cad Update maintainer script template
Review URL: http://codereview.chromium.org/543146
2010-01-20 21:39:29 -08:00
Eric Li
ce1ce9740a This is a resubmit. The original CL was lost due to local disk crashes.
Review URL: http://codereview.chromium.org/551087
2010-01-20 17:01:44 -08:00
rginda
40043a0997 integrate pam_offline with the build and packaging system
after this cl, pam_offline will be built by default, included in the image,
and configured as the pam authority for xscreensaver.

Review URL: http://codereview.chromium.org/554021
2010-01-20 13:42:32 -08:00
Bill Richardson
10d27c2540 Rewrite make_chroot.sh to use local mirrors directly.
Use our karmic mirror for creating the build chroot, removing the need for
make_local_repo.sh and the repo_list_*.txt files. If a local repo exists
when build_chroot.sh is run it will be used, but it's no longer necessary.

This change does not remove make_local_repo.sh or the repo_list_*.txt files.

Review URL: http://codereview.chromium.org/548083
2010-01-20 13:38:50 -08:00
tedbo
89fae0eff4 Fix when referencing --with_dev_pkgs flag. Doh!
Review URL: http://codereview.chromium.org/548092
2010-01-20 12:02:24 -08:00
tedbo
7237f473fb Add --with_dev_pkgs option to build_image.sh to pull in developer debug packages.
This defaults to TRUE when building an image.

This CL moves some developer-only packages from package-list-prod.txt to
package-list-debug.txt and adds support for a comma-separated list of
package lists to build_image.sh.

Actually, I'd like to rename package-list-dev.txt to package-list-build.txt
and package-list-debug.txt to package-list-dev.txt but maybe in another CL.

Also there is a patch from lool that we should grab some stuff from that
can filter the package lists by build architecture. Eventually we will
likely add target-specific package lists as well.

With this change, build_image.sh --nowith_dev_pkgs will build an image
that does not contain niceties such as xterm.

Review URL: http://codereview.chromium.org/549107
2010-01-20 10:34:33 -08:00
Satoru Takabayashi
8d2a034fa0 Build and package candidate_window in addition to chrome.
candidate_window is used for entering text in CJK languages.
See the design doc of "Chromium OS Text Input" for details:
http://sites.google.com/a/chromium.org/dev/chromium-os/chromiumos-design-docs/text-input

TEST=Ran "build_chrome.sh" and confirmed that candidate_window is included in chrome-chromeos.zip

Review URL: http://codereview.chromium.org/543105
2010-01-20 19:12:25 +09:00
Andrew de los Reyes
79d99a83c3 ARM build: replacement postinst for netbase
Review URL: http://codereview.chromium.org/545130
2010-01-19 22:56:27 -08:00
tedbo
ac0346a9dd Move set of bootstrap /dev devices to /lib/chromiumos/devices.
Rather than pull the initial set from /lib/udev/devices, we
move them to /lib/chromiumos/devices.

We also whitelist the udev maintainer script since we don't need
to have it create devices in /lib/udev/devices and we also do not
need it to create the persistent rules files.

Review URL: http://codereview.chromium.org/552056
2010-01-19 19:41:02 -08:00
Chris Sosa
a49e77f70b Wrong command entered here. Need absolute path
Review URL: http://codereview.chromium.org/552058
2010-01-19 18:40:55 -08:00
Steve VanDeBogart
bf201ba640 Fix the creation of .list files for dpkg with maintainer scripts
Remove explicit use of sh to run custom maintainer postinst scripts.

Review URL: http://codereview.chromium.org/542135
2010-01-19 17:14:05 -08:00
Chris Sosa
8a09a05ef0 Modifies archived build to include a test image in the zip file
Review URL: http://codereview.chromium.org/542131
2010-01-19 16:05:36 -08:00
Ken Mixter
57d2a6bd12 Add functionality required for perf dashboard.
image_to_live.sh - fix problem where errorvalue is non-zero even when
  reimage was successful.
run_remote_tests.sh - add ability to stow build description in the
  autotest database so we can track the exact build for which
  tests succeed/fail.

Review URL: http://codereview.chromium.org/547018
2010-01-18 10:58:25 -08:00
Steve VanDeBogart
8174ba0782 Move is_whitelisted to the common script so that all users get the previous fix
Fix typo to enable preinst scripts to run

Review URL: http://codereview.chromium.org/542097
2010-01-15 19:45:30 -08:00
Steve VanDeBogart
6a76c4d9b4 Change the replacement dpkg to respect comment lines in package.whitelist
Review URL: http://codereview.chromium.org/543099
2010-01-15 16:54:29 -08:00
Eric Li
3a704ffee4 Rework run_autotest.sh to support server side control files.
The idea here is to remove flag processing inside this wrapper script and pass on all flags into autoserv.

I've tested with server/site_tests/system_BootPerfServer and a client side tests.

Both work fine.

Review URL: http://codereview.chromium.org/536081
2010-01-15 15:47:43 -08:00
Daniel Erat
af9c8deafe build: Add gnupg and x11-utils to prod package list.
apt-get can't verify signatures without GPG, which
leads to devserver scripts breaking.  xwininfo and
xprop are useful for debugging X issues.

Review URL: http://codereview.chromium.org/542079
2010-01-15 10:09:11 -08:00
Eric Li
4ff32f64b9 Enhance autotest run inside chroot.
Review URL: http://codereview.chromium.org/542068
2010-01-15 10:08:16 -08:00
Ken Mixter
88aaf818cb Reenable upstart now that we can build it reliably.
Review URL: http://codereview.chromium.org/551021
2010-01-14 17:05:49 -08:00
Ken Mixter
de780c41c3 Record the production rootfs size for tracking with autotest
Review URL: http://codereview.chromium.org/536057
2010-01-14 15:29:22 -08:00
Will Drewry
d2f8c15613 Bump gtest to 1.4.0 and add gmock 1.4.0
Review URL: http://codereview.chromium.org/536056
2010-01-14 14:10:08 -08:00
Colin Watson
a2400d48ca Native build import script
Add a script to import all binary packages for a given source package
from ports.ubuntu.com, convert and install them using 'chromiumos-build
--convert', and write out a fake .changes file so that chromiumos-build
doesn't try to re-import them.  Use it like this:

  ./import_native_build.sh anthy libchewing

For the moment, there are a number of source packages that won't
cross-build successfully but that can be imported from native Ubuntu
builds, and this wraps up the process of doing so.

Review URL: http://codereview.chromium.org/543059
2010-01-14 20:49:12 +00:00