Commits
User selector
Commit History
Commits on Jun 14, 2016
Retry idempotent I/O operations on GCS timeout
Show description for 68f85e3authored andcommittedFix is_service_runner to detect endpoints ending with /
Show description for 5ff2c3ecommitted
Commits on Jun 10, 2016
Add autoscaling pipeline options
Show description for 2f9e11cauthored andcommitted
Commits on May 31, 2016
Adds support for reading custom sources using DataflowPipelineRunner.
Show description for 574a29eauthored andcommittedUse worker harness container corresponding to SDK version
Show description for d931cddauthored andcommitted
Commits on Apr 29, 2016
Enable support for all supported counter types
Show description for 5f104d4authored andcommittedModify --requirements_file behavior to cache locally packages
Show description for 5396bfccommitted
Commits on Apr 19, 2016
Implement aggregated_values for DirectPipelineRunner
Show description for 8484d34authored andcommittedAdd class Accumulator
Show description for 2bbd273authored andcommittedUpdates and simplifies logic related to progress reporting.
Show description for e958bbbauthored andcommittedUse a CounterFactory to create counters
Show description for 59a4566authored andcommittedAdd plumbing to pass a coder to the byte-size counter updater
Show description for 84fd2baauthored andcommittedMake sdk pipeline options available in the DoFn context
Show description for 7aca3a3authored andcommitted
Commits on Mar 24, 2016
Add support for deduplicating id_label in PubSubSource
Show description for c4e9656authored andcommittedClearer error message when SDK file cannot be found to stage
Show description for 08c56acauthored andcommittedBetter error messaging on missing gcloud
Show description for 695e522authored andcommitted
Commits on Mar 21, 2016
Reformat some doc strings to be acceptable to Pydocs Sphinx
Show description for 9bbc79eauthored andcommittedChange option names to: --worker_machine_type and --worker_disk_type
Show description for f7e98f0committed
Commits on Mar 16, 2016
Run batchworker do worker under cProfile
Show description for 164caa4authored andcommittedCythonize runners.common, worker.executor, and utils.counters
Show description for cfc6c76authored andcommittedAllow the sdk_location to point to a tarball as well as a directory
Show description for 4ffb9f5authored andcommittedAdd worker_harness_container_image option
Show description for b9b0cd2authored andcommittedAccept GCS paths as extra packages
Show description for ebb7049authored andcommitted
Commits on Mar 8, 2016
Display a warning only when pipeline option runner is not specified
Show description for e7fcf1eauthored andcommittedMany pickling fixes.
Show description for 19748caauthored andcommittedChange "is_streaming" pipeline option to "streaming"
Show description for 4bed375authored andcommittedSupport for staging SDK tarball downloaded from github
Show description for 5d73ef9committedValidate pipeline options at the time of pipeline creation.
Show description for b03d96fauthored andcommitted
Commits on Feb 25, 2016
Loading