Commit Graph

2915 Commits

Author SHA1 Message Date
Michael Marineau
078ec6cf0d fix(build_packages): Don't redirect emerge output.
The stats upload has been removed so there is no longer a need to
capture the emerge output to parse the logged output. Remove a bit of
dead chromeos logic too.
2013-11-07 13:28:13 -08:00
Michael Marineau
500fe74856 fix(setup_board): Move to new toolchain_util.sh and eselect
The new toolchain utils define chost, portage profiles, and portage arch
per board. Replace the tricker logic from the old platform/dev repo and
switch to setting the profile with the standard eselect tool.

A few cleanups here and there, replacing echo with info and renames.
2013-11-07 13:28:13 -08:00
Michael Marineau
41099eef6f fix(board_options.sh): Move CHOST->ARCH mapping code.
Use the complete chost to portage arch mapping list from crossdev and
move the logic to toolchain_util.sh where it can be used by other
scripts.
2013-11-07 13:28:13 -08:00
Michael Marineau
b5816f7a8d fix(disk_layout_util.sh): Fix changing build_image's disk layout.
Previously the code in base_image_util.sh properly handled the disk
layout command line flag but the spaghetti code later on calls a
function from disk_layout_util.sh which only returned 'base' resulting
in a bit of a mess if something other than 'base' is used. Sync up the
two code paths to avoid that...
2013-11-07 13:28:13 -08:00
Michael Marineau
d5a19a0700 fix(toolchain_util.sh): Move cross-toolchain install code to common lib.
This will eventually be used by setup_board instead of the even more
complicated toolchain code provided by chromite.
2013-11-07 13:28:13 -08:00
Michael Marineau
e145b916f2 fix(catalyst.sh): Update catalyst build more aggressively.
Use 2*CPUs for the target load average but add load average throttling
to emerge in addition to make. Also work around how catalyst sets
FEATURES so we can disable extra locking for hopefully faster builds.
2013-11-07 13:28:13 -08:00
Michael Marineau
55a4517d65 fix(common.sh): Use $SCRIPT_NAME as the default log prefix.
Seems useful with all the scripts-calling-scripts-turtles but very few
scripts explicitly set a prefix.
2013-11-07 13:28:13 -08:00
Michael Marineau
986548722d fix(toolchain_util.sh): Move native->cross pkg translation to function
Will be useful in other places and seems better to hide the bash magic.
2013-11-07 13:28:13 -08:00
Michael Marineau
0ba3d9ea04 fix(get_board_chost): Accept a list of boards to get_board_* funcs 2013-11-07 13:28:13 -08:00
Michael Marineau
6778eeda83 fix(bootstrap_sdk): Remove toolchain build step, replaced by build_toolchains 2013-11-07 13:28:13 -08:00
Michael Marineau
9fbf30f670 Merge pull request #130 from marineam/fix-tag
fix(tag_release): Fix default SDK version
2013-11-07 13:02:12 -08:00
Michael Marineau
e290235b18 fix(tag_release): Fix default SDK version 2013-11-07 12:56:38 -08:00
Michael Marineau
95bf5bb29d Merge pull request #129 from marineam/python-exec
add(129.0.0_python_exec_transition.sh): gracefully upgrade python-exec
2013-11-07 12:48:54 -08:00
Michael Marineau
65b9977b80 add(129.0.0_python_exec_transition.sh): gracefully upgrade python-exec
We've had trouble with eclean and equery vanishing in our SDKs from time
to time. Although I don't know the root cause it seemed to be some
confusion in the ebuild environment, perhaps a mis-match between the
eclasses, profiles, and ebuilds. Updating all of those seemed to resolve
the issue and to make sure other environments are ok force a re-install
of portage and gentoolkit to clean things up.
2013-11-06 20:14:20 -08:00
Michael Marineau
571ebef01f Merge pull request #127 from marineam/fix-tag
fix(tag_release): Fix cleanup of old branch manifests.
2013-10-24 18:26:33 -07:00
Michael Marineau
ec62584f8a fix(tag_release): Fix cleanup of old branch manifests. 2013-10-24 11:33:19 -07:00
Michael Marineau
acfb1a961c Merge pull request #126 from marineam/turtle-chain
Turtle chain
2013-10-23 13:41:08 -07:00
Michael Marineau
9187adb7ca fix(catalyst_toolchains.sh): Fix error in doc comment 2013-10-23 12:07:39 -07:00
Michael Marineau
169cc17394 fix(build_toolchains): Fix simple logging typo 2013-10-23 12:02:25 -07:00
Michael Marineau
31d5ced3df fix(build_toolchains): Remove hard-coded portage profile 2013-10-23 11:58:19 -07:00
Michael Marineau
8ee5f00137 fix(common.sh): Stop collecting stats and uploading them to Google.
Just... no.. in so many ways. Kinda dumb it took me this long to delete
this little chunk of rather annoying code.
2013-10-23 11:39:08 -07:00
Michael Marineau
c503b0248b add(build_toolchains): New command to build cross and native target toolchains.
This replaces the cross-toolchain compile step in bootstrap_sdk and adds the
ability to build native toolchains using the cross toolchain. This is just
the first step towards actually providing the native toolchain in a container.
2013-10-23 11:07:01 -07:00
Michael Marineau
5d8237b2c6 Merge pull request #125 from marineam/snapshot
fix(copy_ami.sh): Share copied snapshots with Amazon marketplace
2013-10-20 14:14:19 -07:00
Michael Marineau
5b9c5ce3ec fix(copy_ami.sh): Share copied snapshots with Amazon marketplace
Now all the permissions should be correct everywhere!
2013-10-18 18:28:58 -07:00
Michael Marineau
4a06ea4904 Merge pull request #124 from marineam/release-reorg
Release reorg
2013-10-18 17:21:13 -07:00
Michael Marineau
955ad2990b fix(tag_release): Default to bumping the SDK version
This keeps the SDK version by default only one version behind the
current build version.
2013-10-18 16:56:31 -07:00
Michael Marineau
243ab47a87 add(tag_release): Switch to tagging releases off of master. 2013-10-18 16:55:24 -07:00
Michael Marineau
975894ee1a Merge pull request #123 from marineam/align
Align partitions
2013-10-17 20:13:43 -07:00
Michael Marineau
f6341fc31d fix(legacy_disk_layout.json): Omit unused partitions.
We don't need to reserve space on disk just to reserve partition
numbers. And now that partitions are aligned these blanks spots grew
from 512 bytes to 1MB which is not much but still silly.
2013-10-16 19:44:49 -07:00
Michael Marineau
03754b2d62 fix(cgpt.py): Add support for aligning partitions
When using anything other than classic spinning disks with 512 sectors
it is generally best to maintain some alignment with the underlying
physical sector or erase block size. The default alignment most
partitioning tools use these days is 1MB (2048 sectors). Also sometimes
qemu-img requires disk sizes to be aligned to 64KB.
2013-10-16 19:32:04 -07:00
Michael Marineau
ecca978053 fix(cgpt.py): Fix GPT reserved space calculations.
The existing code arbitrarily multiplies START_SECTOR by 512 converting
from blocks/sectors to bytes, but blocks was the correct unit to begin
with. Also the secondary GPT area is not considered but that was OK
because the bogus unit conversion oversized our disks by almost 16MB.

Instead of relying on bugs properly reserve 34 sectors at each end of
the disk. (Well, we could get away with only 33 at the end since it
doesn't have a MBR but meh.)
2013-10-16 18:30:46 -07:00
Michael Marineau
1e17818736 Merge pull request #122 from unclejack/build_library-vmx_utc_tz
fix(build_library): set tz to UTC in vmx template
2013-10-15 14:43:45 -07:00
unclejack
655c9de59e fix(build_library): set tz to UTC in vmx template
VMware is using the local time zone by default for the clock.
This changes the vmx template in vm_image_util.sh to set it to UTC
instead.
2013-10-15 23:14:11 +03:00
Michael Marineau
b7bbbf9e71 Merge pull request #121 from marineam/copy-updates
add(copy_ami): Move ami copying step to new script for easier testing
2013-10-14 19:50:38 -07:00
Michael Marineau
aecedce889 add(copy_ami): Move ami copying step to new script for easier testing
Fix some copying issues:
- Don't set AMI permissions until it is out of the pending state
- Set name and description properly
- Handle each region in parallel, mostly (these Java apps use lots of
  CPU for some reason so parallelism is limited, hence the sleeps).

Less important but also included here:
- Add run.sh and test_ami2.sh which are currently used in my release
  process. The alternate test script is used because the autotest stuff
  in the other script is broken right now.
2013-10-14 17:36:59 -07:00
polvi
af9c881f72 Merge pull request #120 from polvi/ami-all
feat(all-amis): add uploading off all ami regions
2013-10-14 15:18:31 -07:00
Alex Polvi
e124560678 sneak in some permission stuff 2013-10-14 15:17:25 -07:00
Alex Polvi
21b7575714 fix whitespace 2013-10-14 14:05:28 -07:00
Alex Polvi
19008a43a7 feat(all-amis): add uploading off all ami regions 2013-10-14 14:03:36 -07:00
polvi
1a27058858 Merge pull request #119 from polvi/oem-rackspace
feat(oem-rackspace): add rackspace as valid format option
2013-10-14 13:16:56 -07:00
Alex Polvi
dcfcb00f5e feat(oem-rackspace): add rackspace as valid format option 2013-10-13 19:56:39 -07:00
polvi
47fcc1da5c Merge pull request #117 from polvi/ami-test
initial multi region support
2013-10-10 13:20:16 -07:00
Michael Marineau
b4066aaf01 Merge pull request #118 from marineam/misc
misc updates
2013-10-10 11:55:11 -07:00
Michael Marineau
5adbfd8a32 fix(catalyst): Move catalyst scripts from lib to build_library.
Just seems like a better place for them.
2013-10-10 11:47:09 -07:00
Michael Marineau
456af72625 fix(setup_board): Remove unused support for special amd64-host boards.
This was some scheme for building packages using the SDK profile instead
of the normal target board profiles. We use catalyst instead so remove
this dead code. Ordering cleaned up slightly as well.
2013-10-10 11:46:58 -07:00
Alex Polvi
908d3368ba initial multi region support 2013-10-09 16:24:57 -07:00
Michael Marineau
505ef86bbd Merge pull request #116 from marineam/qemush
fix(qemu_template): Fix getopts usage in qemu wrapper script.
2013-10-09 11:10:34 -07:00
Michael Marineau
c96af93ba6 fun(set_lsb_release): New code name for version 100 2013-10-08 18:43:26 -07:00
Michael Marineau
c6f20655db fix(qemu_template): Fix getopts usage in qemu wrapper script.
Previously shifts were added into the getopts loop to work around
differences between different sh implementations but that causes getopts
to end the loop early. Instead use an intermediate variable to work
around inconsistent OPTIND behavior and explicitly check for the --
separator. Tested in bash, dash, and ash.
2013-10-08 13:35:10 -07:00
Brandon Philips
aa44885d8c Merge pull request #115 from philips/fixup-pxe-instructions
fix(build_library): fix the pxe image instructions
2013-10-01 20:53:54 -07:00