Releases: DistributedScience/Distributed-CellProfiler
v2.2.0
What's Changed
Major changes:
run_batch_general.py has been overhauled to be a CLI tool with support for Cell Painting Gallery file structure. It is more granularly configurable. Changes made in #148 and #179
Support for AWS IAM assumed roles added in #177
Improved handling of CellProfiler-plugins and update to current CellProfiler-plugins organization in #172
Adds WORKSPACE_BUCKET to the config so that image files and metadata files can be read off different buckets in #167
Adds JOB_RETRIES to the config so that the number of retries before sending a job to DeadMessages is configurable in #169
Adds ALWAYS_CONTINUE to the config so that the flag can be passed to CellProfiler in #169
Adds ASSIGN_IP to the config and defaults to false so that EC2 spot fleet instances do not automatically get assigned a private IP address since AWS now charges for that feature in #182 and e2d444a
Minor changes:
Bugfixes in #153, #173
Updated example fleet files in #163 and #171
Better error reporting in #174
Better printing of usage metrics to per_instance logs in #175
As always, more and better documentation :)
Contributors
- @Zitong-Chen-16 made their first contribution in #163
- @emiglietta made their first contribution in #166
- @ErinWeisbart
- @bethac07
- @fefossa
Full Changelog: v2.1.0...v2.2.0
Contributors
Assets 2
Release 2.1
Includes improvements:
Addition of setup_AWS.py to automate AWS infrastructure setup
Addition of optional auto-monitor
Addition of auto-dashboard creation
Addition of auto-Deadletter queue creation
Improved handling of AWS credentials in
Minor changes including:
Printing monitor file name at the end of startCluster
Monitor prints more information about spot fleet metrics
v2.0.0rc2: Optionally download files to EBS rather than use S3FS (#116)
* First attempt at downloading files * fix string reading of metadata * remove files when you're done with them * my code runs too fast * use fields * make channels into a list * make directory for files to land in * port to python2
v2.0.0rc1: DCP2.0 (#104)
* Update run.py * Delete fabfile.py * Move previous fab functions into run.py * Debugging from lambda * tabs to spaces, issues/112 * issues/105 * issues/110, fix passing USE_PLUGINS * fix tabs to spaces in run.py * tab/space error in run_batch_general * issues/107 * issues/107 * add 'cheapest' mode to monitor * get credentials working * move machine type/price/date out of fleet file * move machine type/price/date out of fleet file * support running of monitor in cheapest mode * fix indentation in CHECK_IF_DONE * move cpDone * don't move done file, you still need to check it * don't move done file, you still need to check it * fix cmdstm for batch files * fixes to make log export work * python 3 support in run.py * move Python2 files to their own folder * pin watchtower to last python2 version * support for CellProfiler 4 * fix alarm time designation * Update README.md * Update requirements.txt * Update LICENSE * Add a bit about run_batch_general
v1.2.2: Clone and install requirements for CPPlugins (#91)
* Clone the plugins repo * Update Dockerfile * Add plugins directory to CP call * Add plugins to config * Add USE_PLUGINS * Fix -i bug in batchfiles, make plugins follow an input variable * Fix formatting of cmd lines * Space before --plugins * Rebase plugins use (#109) * Add userdata for each LaunchSpecification (#102) Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> * Batch files should be able to have input files too Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal>