Commit Graph

4 Commits

Author SHA1 Message Date
Michael Marineau
deb3824dee fix(update_distfiles): Set temporary directory
Provide an alternate directory for in-progress downloads to avoid
uploading any by accident.
2013-06-26 14:07:16 -04:00
Michael Marineau
a25f12bbc4 fix(update_distfiles): Add option to control gsutil's parallelism
gsutil can be hard to follow when parallel upload/downloads are enabled.
"I see it is transferring something, but what?" So this provides an
option to disable that for debugging purposes.
2013-06-26 11:44:16 -04:00
Michael Marineau
96186e3c47 fix(update_distfiles): Add --download option to for incremental updates
Temporary workaround until we have a version of emirrordist that can
operate directly on remote storage. Download the entire mirror (if it
isn't already local) so emirrordist can make an incremental update.

Not great but it will do for now.
2013-06-26 11:19:59 -04:00
Michael Marineau
133f2d3d8b add(update_distfiles): New script to build and upload a distfiles mirror
This script wraps emirrordist to scan all ebuilds and fetch every
SRC_URI to construct a distfiles mirror. It can then optionally upload
to storage.core-os.net via gsutil.

Note: This is a work-in-progress, emirrordist expects to operate on a
complete mirror on the local filesystem but maintaining a complete local
copy of everything is burdensome. Before this is truly practical a
modified version of emirrordist will be needed to either accept a list
of already-uploaded files it can assume are OK or operate on the cloud
storage system directly.
2013-06-24 02:00:01 -04:00