mirrors/flatcar-scripts
1
0
Fork 0
mirror of https://github.com/flatcar/scripts.git synced 2025-08-09 22:16:58 +02:00
Code Issues Packages Projects Releases Wiki Activity
image build and composition scripts for Flatcar Container Linux
1,080 Commits 621 Branches 391 Tags 160 MiB
Shell 93%
Python 6.9%
0addea30fd
Go to file
David James 0addea30fd Print status messages in parallel_emerge about jobs that are longer than 2 mins. 
Currently, if a build is slow, you only get debug output after an hour.
This is to allow for uncluttered output. If output is too cluttered, it's hard
to distinguish regular output from errors.

The problem with this approach is that it's often hard to debug why the build
is slow. Now that Chrome builds by default, it takes over an hour to build,
and people see little indication as to why. You can show the output with
build_packages --showoutput, but that is often too verbose and clutters the
output too much.

Here's an example log snippet that is hard to debug:

Pending 2, Ready 0, Running 1, Retrying 0, Total 22 [Time 5m20.5s Load 3.69 3.04 2.66]
Pending 2, Ready 0, Running 1, Retrying 0, Total 22 [Time 5m25.5s Load 3.40 2.99 2.65]
... yada yada yada ...
Pending 2, Ready 0, Running 1, Retrying 0, Total 22 [Time 45m32.9s Load 1.00 1.18 2.95]

From the above output, we see that a package is building for a long time, but
we don't know what package. We should output the package name every two minutes
at least so people know what package is taking so long. That's what this change
implements.

BUG=chromium-os:8575
TEST=Confirmed new status appear for regular build_packages. Confirmed
     build_packages --showoutput is unchanged.

Change-Id: Ie18b23ac7a8a6e2c24b43ec3691606c7da5e43cb

Review URL: http://codereview.chromium.org/4318003
2010-11-02 14:52:23 -07:00
bin Adding both for branch preflight 2010-11-01 22:43:19 -07:00
chromite Added option for including priority/milestone to cros_changelog. 2010-10-29 14:50:15 -07:00
lib Fix equals in RunCommand's in cbuildbot. 2010-10-21 10:54:02 -07:00
mod_for_factory_scripts scripts: Remove bogus patch to software-update.conf 2010-10-22 09:47:36 -04:00
mod_for_test_scripts [crosutils] Remove test-image-specific change of core_pattern 2010-10-22 12:28:51 -07:00
upgrade.d upgrade_chroot: create an upgrade script 2010-09-24 16:23:29 -07:00
.gitignore ignore: tmp files and .pyc files 2010-09-09 14:25:33 -07:00
archive_build.sh Update prebuilt.py call to reference proper external path 2010-11-02 00:46:37 -07:00
archive_hwqual Move RunCommand, and Info/Warning/Die into common pylib 2010-08-30 11:05:50 -07:00
autotest Unblacklist graphics_WebGLConformance. 2010-08-25 17:29:05 -07:00
autotest_lib.sh fix autotest scripts for board variants 2010-03-23 21:16:33 -07:00
autotest_run.sh autotest_run: kill the destructive stuff that's pwning the autotest installation 2010-08-06 11:26:23 -07:00
autotest_workon autotest: create a candidate script for replacement ebuild test (running the tests) 2010-07-26 18:02:29 -07:00
bash_completion Update bash_completion to not use a temp file 2010-08-19 16:18:42 -07:00
binhost_clobber.py Adding in script to clobber build packages that shouldn't be cached. 2010-03-16 14:17:30 -07:00
build_autotest.sh autotest: unblacklist autotest ebuilds, stop cros_workon start'ing anything 2010-08-26 19:50:18 -07:00
build_gpt.sh build_image: Merge x86 and ARM where possible. 2010-09-30 14:20:34 -07:00
build_image Rootfs: increase size to 850MiB. 2010-11-01 18:27:53 -07:00
build_kernel_image.sh Notes: 2010-10-26 02:56:51 -07:00
build_packages Add symlinks to new build scripts. This obviates the need to run setup_source_tree.sh. 2010-02-19 14:54:50 -08:00
check_control_files.sh A simple script to check all control files for correctness. 2010-06-17 17:43:50 -07:00
check_deps Add more exceptions to check_deps to allow usage of icedtea. 2010-05-13 11:06:51 -07:00
chromeos_blacklist Add ability to blacklist packages from chromeos-base/chromeos. 2010-10-20 16:04:23 -07:00
chromeos_version.sh Created branch 0.9.110.B. Update CHROMEOS_VERSION_BRANCH=111 2010-11-01 18:54:55 -07:00
chromeos-common.sh Switch to GPT-format disk images. 2010-03-30 14:17:34 -07:00
clean_loopback_devices Adds a script to unmount any mount points in your boards image dir and free loopback devices 2010-04-29 14:05:30 -07:00
common.sh common.sh: switch out echo -ne for printf and fix incorrect offset 2010-10-20 18:11:24 -05:00
create_esp.sh build_image: Merge x86 and ARM where possible. 2010-09-30 14:20:34 -07:00
create_legacy_bootloader_templates.sh kernel cmdline: add dm_verity.dev_wait=1 2010-10-20 15:37:46 -05:00
cros_deps_diff add cros_deps_diff tool that creates dependency graph diffs 2010-07-08 14:52:37 -07:00
cros_download_latest_image Make cros_download_latest_image echo its newline to stderr 2010-08-25 16:09:25 -07:00
cros_extract_deps cros_extract_deps -j writes JSON, sorted by package name. 2010-08-18 18:46:00 +02:00
cros_generate_breakpad_symbols Utility to generate minidump symbols for developer diagnostics 2010-08-12 17:03:47 -07:00
cros_generate_deps_graphs Refactor the dot graph generation out of cros_generate_deps_graphs 2010-07-01 13:41:25 -07:00
cros_generate_update_payload Use delta_generator from chroot instead of from update_engine directory. 2010-10-26 16:42:04 -07:00
cros_mark_as_stable First cut at stable script 2010-07-13 15:34:11 -07:00
cros_mark_as_stable_blacklist autotest: unblacklist autotest ebuilds, stop cros_workon start'ing anything 2010-08-26 19:50:18 -07:00
cros_mark_as_stable_unittest.py Always pass board to cros_mark_as_stable. 2010-10-22 16:14:36 -07:00
cros_mark_as_stable.py Update cros_mark_as_stable to support working on only private overlays. 2010-11-01 16:22:35 -07:00
cros_mark_branch_as_stable Update all ebuilds to point to a branch or tag. 2010-10-11 15:04:08 -07:00
cros_run_unit_tests crosutils: make cros_run_unit_tests prepare before building tests 2010-10-14 13:23:44 -07:00
cros_show_stacks Script to generate post mortem of all crashes on device 2010-08-31 12:07:11 -07:00
cros_upgrade_chroot upgrade_chroot: create an upgrade script 2010-09-24 16:23:29 -07:00
cros_workon Change "cros_workon list" to show packages for all boards. 2010-11-02 11:23:00 -07:00
customize_rootfs Add symlinks to new build scripts. This obviates the need to run setup_source_tree.sh. 2010-02-19 14:54:50 -08:00
debug_32bit.sh A pair of scripts to make it easier to run and debug 32 bit executables on 64 bit systems 2010-04-05 15:22:44 -07:00
dot_helper.py Refactor the dot graph generation out of cros_generate_deps_graphs 2010-07-01 13:41:25 -07:00
emit_gpt_scripts.sh Pack and unpack scripts switched to bash 2010-07-19 10:37:06 -07:00
enable_localaccount.sh build: Make enable_localaccount.sh skip outdated packages. 2010-08-19 18:04:46 -07:00
enter_chroot.sh Added a function to update chroot sudoers automatically. 2010-10-19 14:49:39 -07:00
file_copy.py Changes to enable dev in stateful partition for usb and startup 2010-03-11 15:30:38 -08:00
fixup_image_for_qemu.py Changes to use the postinst --esp-part-file flag; postinst fixups removed 2010-07-21 02:04:59 +05:30
generate_test_report Make generate_test_reports a symlink to the py file so it can be imported. 2010-07-09 10:46:53 -07:00
generate_test_report.py Add direct flush calls to stderr / stdout. 2010-10-29 09:33:44 -07:00
get_latest_image.sh Add board option to au test harness so that this works for others without a default board and add ability to reference images without relative paths. 2010-10-04 18:19:29 -07:00
get_package_list Add ability to blacklist packages from chromeos-base/chromeos. 2010-10-20 16:04:23 -07:00
get_svn_repos.sh Enable get_svn_repos.sh to be run from src/scripts/. This script will be killed as soon as the autotest ebuild is fixed. 2010-07-15 15:19:04 -07:00
gflags.py Add gflags.py 2010-08-05 10:37:17 -07:00
gmergefs Fix modprobe prob in gmergefs and bring call script into scripts 2010-05-14 12:54:04 -07:00
image_hacks.sh chromite: initial version of image_hacks.sh 2010-09-16 19:14:40 -07:00
image_to_live.sh Add components to pass vm flag to dev server. 2010-10-28 23:46:20 -07:00
image_to_usb.sh crosutils: refine image_to_usb progress output and performance 2010-10-08 10:35:10 +08:00
image_to_virtualbox.sh VMWare [1/2]: Fix vmware image generation. 2010-03-10 16:09:46 -08:00
image_to_vm.sh Add sync after resize to avoid /dev/loop- is busy errors. 2010-10-25 15:10:26 -07:00
inherit-review-settings-ok Update WATCHLISTS and CRR 2010-06-10 01:36:40 -07:00
kernel_fetcher.sh kernel_fetcher.sh: use ro for rootfs.image 2010-10-20 18:58:05 -05:00
list_installed_packages.sh Start copying over source. 2009-10-09 20:56:14 +00:00
make_chroot Add symlinks to new build scripts. This obviates the need to run setup_source_tree.sh. 2010-02-19 14:54:50 -08:00
make_developer_script_runner.sh mod_image_for_recovery: supprt new recovery model 2010-11-01 17:34:14 -05:00
make_factory_package.sh Adding append to make_factory_package 2010-10-22 15:32:28 -07:00
make_relative_solution Create a tool to save a pinned dep file for the current sync. 2010-05-20 10:18:55 -07:00
mk_arm_sd_image.py Start copying over source. 2009-10-09 20:56:14 +00:00
mk_memento_images.sh Factory install: unbreak 2010-08-16 16:02:03 -07:00
mod_image_for_recovery.sh mod_image_for_recovery: supprt new recovery model 2010-11-01 17:34:14 -05:00
mod_image_for_test.sh Disable OEM partition mounting for test images. 2010-09-13 18:58:31 +04:00
mount_gpt_image.sh Fixing of the symlinks isn't being called because rootfs is being remounted ro. 2010-10-29 11:58:15 -07:00
parallel_emerge Print status messages in parallel_emerge about jobs that are longer than 2 mins. 2010-11-02 14:52:23 -07:00
prebuilt_unittest.py Add support for prebuilt uploading using rsync. 2010-10-25 16:41:50 -07:00
prebuilt.py prebuilt.py: fix variant detection regex 2010-10-29 09:50:23 -05:00
remote_access.sh Update scripts for vm's 2010-09-21 17:09:51 -07:00
resize_stateful_partition.sh mod_image_for_recovery: supprt new recovery model 2010-11-01 17:34:14 -05:00
run_32bit.sh A pair of scripts to make it easier to run and debug 32 bit executables on 64 bit systems 2010-04-05 15:22:44 -07:00
run_remote_tests.sh crosutil: No longer use autotest-0.0.1 in run_remote_tests even outside chroot 2010-10-18 13:34:29 -07:00
save_pinned_deps Add --allow-empty to the commit of the generated dep file. 2010-06-21 15:12:07 -07:00
serve_factory_packages.py Adding script to build and serve factory packages. 2010-10-29 11:38:06 -07:00
set_shared_user_password.sh Added restart_in_chroot_if_needed to common.sh. 2010-05-04 16:54:28 -07:00
setup_board Add symlinks to new build scripts. This obviates the need to run setup_source_tree.sh. 2010-02-19 14:54:50 -08:00
ssh_test.sh Wrapper script for remote_access.sh library. Used by Autotest updater. 2010-06-22 14:36:26 -07:00
start_devserver remove update_engine flag from start_devserver 2010-07-12 15:22:53 -07:00
sync_build_test.sh Fix grab-buildbot in sync_build_test by gsdizing it 2010-09-30 13:05:56 -07:00
sysroot_wrapper Add symlinks to new build scripts. This obviates the need to run setup_source_tree.sh. 2010-02-19 14:54:50 -08:00
test_cookie_pipe.py Don't crash if the cookie pipe doesn't exist. 2009-11-13 19:17:31 +00:00
test_image Add test_image script for checking that dependencies in image are sane 2010-03-02 15:28:58 -08:00
tracker_spreadsheet_sync tracker/spreadsheet tool: Improve tracker to spreadsheet migration. 2010-04-20 16:28:37 -07:00
tracker.sh Start of script for entering tracker reports. 2009-11-18 23:35:51 +00:00
unit_test_black_list.txt Adding blacklist support for unit tests and blacklisting currently failing tests. 2010-06-22 17:19:15 -07:00
update_bootloaders.sh build_image: Merge x86 and ARM where possible. 2010-09-30 14:20:34 -07:00
upload_symbols crosutils: Detect sym_upload errors by its stdout instead of return value 2010-10-07 17:54:04 -07:00
verify_rootfs_chksum.sh Issue 6821: script to verify rootfs integrity against value stored in kernel 2010-09-21 10:04:32 -07:00
WATCHLISTS Update WATCHLISTS and CRR 2010-06-10 01:36:40 -07:00