915f1ef | Beth Cimini | 14 January 2021, 13:41:53 UTC | Update run.py (#122) | 14 January 2021, 13:41:53 UTC |
8ce77da | Beth Cimini | 13 November 2020, 20:19:37 UTC | Add Names to the volumes (#118) * Add Names to the volumes * Add Names to the volumes | 13 November 2020, 20:19:37 UTC |
6c59afc | Beth Cimini | 12 November 2020, 15:18:17 UTC | keep CSVs from overwriting one another | 12 November 2020, 15:18:17 UTC |
6563264 | Beth Cimini | 12 November 2020, 15:10:40 UTC | keep CSVs from overwriting one anohter | 12 November 2020, 15:10:40 UTC |
d29f39c | Beth Cimini | 12 November 2020, 14:41:06 UTC | keep CSVs from overwriting one anohter | 12 November 2020, 14:41:06 UTC |
b868abc | Beth Cimini | 12 November 2020, 14:33:02 UTC | keep CSVs from overwriting one anohter | 12 November 2020, 14:33:02 UTC |
f02cc6e | Beth Cimini | 10 November 2020, 19:58:50 UTC | be more selective in file deletion | 10 November 2020, 19:58:50 UTC |
8ba8a7b | Beth Cimini | 10 November 2020, 16:09:18 UTC | Pin pandas for CP3 | 10 November 2020, 16:09:18 UTC |
c4a9f83 | Beth Cimini | 10 November 2020, 15:59:50 UTC | Optionally download files to EBS rather than use S3FS (#116) * First attempt at downloading files * fix string reading of metadata * remove files when you're done with them * my code runs too fast * use fields * make channels into a list * make directory for files to land in * port to python2 | 10 November 2020, 15:59:50 UTC |
82dc8c6 | Beth Cimini | 09 November 2020, 22:05:49 UTC | fix some bugs related to a bad variable name in startCluster | 09 November 2020, 22:05:49 UTC |
dc6703e | Beth Cimini | 06 November 2020, 21:02:08 UTC | fix typo in shutil | 06 November 2020, 21:02:08 UTC |
d0c34ce | Beth Cimini | 06 November 2020, 20:58:53 UTC | Update run.py | 06 November 2020, 20:58:53 UTC |
115370a | Beth Cimini | 06 November 2020, 20:31:14 UTC | Remove DOCKER_BASE_SIZE now that it's auto-calculated | 06 November 2020, 20:31:14 UTC |
4f2897f | Beth Cimini | 06 November 2020, 20:04:20 UTC | Update config.py | 06 November 2020, 20:04:20 UTC |
1b52e5a | Beth Cimini | 05 November 2020, 21:15:37 UTC | DCP2.0 (#104) * Update run.py * Delete fabfile.py * Move previous fab functions into run.py * Debugging from lambda * tabs to spaces, issues/112 * issues/105 * issues/110, fix passing USE_PLUGINS * fix tabs to spaces in run.py * tab/space error in run_batch_general * issues/107 * issues/107 * add 'cheapest' mode to monitor * get credentials working * move machine type/price/date out of fleet file * move machine type/price/date out of fleet file * support running of monitor in cheapest mode * fix indentation in CHECK_IF_DONE * move cpDone * don't move done file, you still need to check it * don't move done file, you still need to check it * fix cmdstm for batch files * fixes to make log export work * python 3 support in run.py * move Python2 files to their own folder * pin watchtower to last python2 version * support for CellProfiler 4 * fix alarm time designation * Update README.md * Update requirements.txt * Update LICENSE * Add a bit about run_batch_general | 05 November 2020, 21:15:37 UTC |
338e7c6 | Beth Cimini | 03 November 2020, 15:20:49 UTC | Clone and install requirements for CPPlugins (#91) * Clone the plugins repo * Update Dockerfile * Add plugins directory to CP call * Add plugins to config * Add USE_PLUGINS * Fix -i bug in batchfiles, make plugins follow an input variable * Fix formatting of cmd lines * Space before --plugins * Rebase plugins use (#109) * Add userdata for each LaunchSpecification (#102) Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> * Batch files should be able to have input files too Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> | 03 November 2020, 15:20:49 UTC |
2520c42 | David Stirling | 03 November 2020, 15:18:33 UTC | Create run_batch_general.py (#108) | 03 November 2020, 15:18:33 UTC |
4f0a525 | Beth Cimini | 30 September 2020, 17:07:12 UTC | Update cp-worker.py | 30 September 2020, 17:07:12 UTC |
3d03417 | Beth Cimini | 23 June 2020, 03:36:40 UTC | Batch files should be able to have input files too | 23 June 2020, 03:36:40 UTC |
04a7f9d | Matthew Chess | 04 May 2020, 14:03:33 UTC | Add userdata for each LaunchSpecification (#102) Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> | 04 May 2020, 14:03:33 UTC |
c15d455 | Beth Cimini | 25 March 2020, 14:32:45 UTC | Check minimum file size, misc updates for 1.2.1 (#97) * Add min file size, bump DCP versions * Update Dockerfile * Update Makefile * Update Makefile * Update fabfile.py * Update cp-worker to check for a minimum file size If not specified, use 1 byte * Don't write bad code * Don't write bad code * Don't check alarms at midnight | 25 March 2020, 14:32:45 UTC |
fa2e17c | Beth Cimini | 09 January 2020, 21:02:20 UTC | Update DockerhubTag | 09 January 2020, 21:02:20 UTC |
917922c | Beth Cimini | 04 September 2019, 16:05:21 UTC | Downscale extra machines if you have them. (#95) * Update run.py * Update run.py * Update run.py * Only scale down, not up * Update run.py * Update run.py * Update run.py * Update run.py * Update run.py * Update run.py | 04 September 2019, 16:05:21 UTC |
ed81406 | Beth Cimini | 06 August 2019, 15:11:22 UTC | Update fabfile.py | 06 August 2019, 15:11:22 UTC |
f1bca1d | Beth Cimini | 06 August 2019, 15:08:26 UTC | Update fabfile.py | 06 August 2019, 15:08:26 UTC |
6c59499 | Beth Cimini | 08 November 2018, 00:00:24 UTC | Update Makefile | 08 November 2018, 00:00:24 UTC |
13ff142 | bethac07 | 07 November 2018, 23:59:01 UTC | Dockerfile fixes | 07 November 2018, 23:59:01 UTC |
068a552 | Beth Cimini | 07 November 2018, 23:57:59 UTC | Make worker compatible with either CP2 or CP3 (#88) * Test if pipeline is CP2 or CP3 * misc fixes | 07 November 2018, 23:57:59 UTC |
42ca1cb | Beth Cimini | 07 November 2018, 20:26:37 UTC | Update Dockerfile (#87) | 07 November 2018, 20:26:37 UTC |
d2bf589 | Beth Cimini | 07 November 2018, 20:26:01 UTC | Update cp-worker.py (#86) | 07 November 2018, 20:26:01 UTC |
4c5fd46 | cclauss | 07 November 2018, 20:24:57 UTC | Create .travis.yml (#82) | 07 November 2018, 20:24:57 UTC |
6e9135d | cclauss | 01 October 2018, 17:18:18 UTC | print() is a function in Python 3 (#81) | 01 October 2018, 17:18:18 UTC |
275902e | Shantanu Singh | 05 June 2018, 09:55:06 UTC | fabric 2.0 makes API breaking changes (#79) no module named fabric.api | 05 June 2018, 09:55:06 UTC |
d6887c1 | bethac07 | 12 January 2018, 17:02:28 UTC | Update amis (#73) * Update exampleFleet_us-east-1.json * Update exampleFleet_us-west-2.json | 12 January 2018, 17:02:28 UTC |
7e92373 | bethac07 | 12 January 2018, 16:52:24 UTC | Reorder steps of startCluster (#72) | 12 January 2018, 16:52:24 UTC |
7930ab1 | bethac07 | 11 January 2018, 03:42:11 UTC | Update cp-worker.py (#71) | 11 January 2018, 03:42:11 UTC |
7fc9838 | bethac07 | 11 January 2018, 03:13:02 UTC | Move logging to after CHECK_IF_DONE (#68) | 11 January 2018, 03:13:02 UTC |
b4e1396 | bethac07 | 11 January 2018, 03:03:43 UTC | Reload the monitor info before shutting down (#70) | 11 January 2018, 03:03:43 UTC |
3e4f633 | bethac07 | 11 January 2018, 03:00:24 UTC | Report errors and return if spot fleet config is bad (#69) | 11 January 2018, 03:00:24 UTC |
e1eaf95 | Ubuntu | 05 October 2017, 16:03:08 UTC | Mismatched metadata should be a warning, not a termination (pt2) | 05 October 2017, 16:03:08 UTC |
7769dfa | bethac07 | 05 October 2017, 14:59:33 UTC | Mismatched metadata should be a warning, not a termination | 05 October 2017, 14:59:33 UTC |
7da056f | bethac07 | 21 February 2017, 21:25:47 UTC | Typo | 21 February 2017, 21:25:47 UTC |
d72d24d | bethac07 | 21 February 2017, 21:24:29 UTC | Don't hardcode region in alarm call | 21 February 2017, 21:24:29 UTC |
7cf6a3a | bethac07 | 21 February 2017, 20:54:51 UTC | Update us-west-2 ami info | 21 February 2017, 20:54:51 UTC |
98df7ba | bethac07 | 21 February 2017, 19:58:58 UTC | Update example fleet files | 21 February 2017, 19:58:58 UTC |
f6c30d3 | bethac07 | 21 February 2017, 19:54:17 UTC | Designate exampleFleet as in the us-east-1 region. | 21 February 2017, 19:54:17 UTC |
cca0e25 | bethac07 | 21 February 2017, 14:55:07 UTC | List all top subdirectories in the bucket (for S3FS bug) | 21 February 2017, 14:55:07 UTC |
a78f49a | bethac07 | 21 February 2017, 14:30:05 UTC | Don't hardcode directory to list | 21 February 2017, 14:30:05 UTC |
f710acd | bethac07 | 21 February 2017, 14:09:04 UTC | Fix backwards compatibility to 1.0.0 | 21 February 2017, 14:09:04 UTC |
27433c4 | bethac07 | 17 February 2017, 17:33:50 UTC | Push copyright year. | 17 February 2017, 17:33:50 UTC |
8a02c11 | bethac07 | 17 February 2017, 16:34:11 UTC | Add flexibility to metadata input, structure of output (#59) * Add output_structure variable * Add output structure, flexible metadata input * Allow output structuring, support metadata dicts | 17 February 2017, 16:34:11 UTC |
bf5e000 | bethac07 | 13 February 2017, 20:58:36 UTC | Mount their bucket, not our bucket | 13 February 2017, 20:58:36 UTC |
c29dfb7 | bethac07 | 07 February 2017, 18:59:26 UTC | Add 'logging' back to instance-monitor (#58) | 07 February 2017, 18:59:26 UTC |
30af4e3 | bethac07 | 07 February 2017, 15:26:30 UTC | Allow configuration of docker base size (#56) * Use cloud-image-utils to create boothook * Update run.py * Update run.py * Add DOCKER_BASE_SIZE as a configurable variable * Update run.py | 07 February 2017, 15:26:30 UTC |
567f6b5 | bethac07 | 08 December 2016, 19:59:11 UTC | Create and destroy ECS clusters on demand (#50) * Create and destroy ECS clusters on demand | 08 December 2016, 19:59:11 UTC |
8f00100 | bethac07 | 07 December 2016, 16:06:58 UTC | Fix project tag | 07 December 2016, 16:06:58 UTC |
d76fbfe | bethac07 | 07 December 2016, 15:27:05 UTC | Merge pull request #48 from jccaicedo/issues/47 Wait after queue creation | 07 December 2016, 15:27:05 UTC |
7ab3b45 | bethac07 | 07 December 2016, 15:22:03 UTC | Update fabfile.py | 07 December 2016, 15:22:03 UTC |
db25a94 | bethac07 | 07 December 2016, 15:04:02 UTC | Merge pull request #46 from jccaicedo/issues/41 Remove duplicate logs | 07 December 2016, 15:04:02 UTC |
172fdca | bethac07 | 10 November 2016, 20:29:30 UTC | Switch from MIT to BSD license | 10 November 2016, 20:29:30 UTC |
f63b49a | bethac07 | 10 November 2016, 19:57:04 UTC | Avoid duplication of metadata entries | 10 November 2016, 19:57:04 UTC |
ad50a3c | bethac07 | 04 November 2016, 17:25:34 UTC | Update monitor for changes in visible AND in-process | 04 November 2016, 17:25:34 UTC |
2e17bd6 | bethac07 | 03 November 2016, 21:59:42 UTC | Send per instance logs to the same S3 folder | 03 November 2016, 21:59:42 UTC |
97e8c8e | bethac07 | 03 November 2016, 16:47:05 UTC | Reverse order of log export and resource release. | 03 November 2016, 16:47:05 UTC |
2de557b | bethac07 | 03 November 2016, 15:45:53 UTC | Allow specification of which pieces of metadata from the command line. | 03 November 2016, 15:48:47 UTC |
4863827 | bethac07 | 02 November 2016, 20:59:53 UTC | Make CHECK_IF_DONE_BOOL case insensitive. | 02 November 2016, 20:59:53 UTC |
95cb3d2 | bethac07 | 02 November 2016, 20:43:57 UTC | Update config.py | 02 November 2016, 20:43:57 UTC |
52072c8 | bethac07 | 02 November 2016, 17:03:04 UTC | Remove unused "log group" param | 02 November 2016, 17:03:04 UTC |
17ef1be | bethac07 | 02 November 2016, 17:01:25 UTC | Update README.md | 02 November 2016, 17:01:25 UTC |
f7eaaf4 | bethac07 | 02 November 2016, 16:12:04 UTC | Remove duplicate logs | 02 November 2016, 16:48:29 UTC |
1ac7ecb | bethac07 | 02 November 2016, 16:03:10 UTC | Update config.py | 02 November 2016, 16:03:10 UTC |
166aa35 | bethac07 | 02 November 2016, 15:58:01 UTC | Merge pull request #40 from jccaicedo/issues/37 Remove queue, task definition, service at end | 02 November 2016, 15:58:01 UTC |
2252ea5 | bethac07 | 02 November 2016, 15:32:14 UTC | Remove queue, task definition, service at end | 02 November 2016, 15:56:29 UTC |
185212e | bethac07 | 02 November 2016, 14:11:56 UTC | Merge pull request #39 from jccaicedo/issues/30 Add per-instance logging, fix EBS volumes | 02 November 2016, 14:11:56 UTC |
88112c8 | bethac07 | 24 October 2016, 15:31:34 UTC | Add reminder of minimum EBS volume size. | 02 November 2016, 14:06:20 UTC |
0d5788c | bethac07 | 13 October 2016, 21:57:49 UTC | Fix EBS blocking | 02 November 2016, 14:05:52 UTC |
790f65c | bethac07 | 13 October 2016, 21:56:56 UTC | Fix mapping | 19 October 2016, 19:58:39 UTC |
2d5c45e | bethac07 | 13 October 2016, 20:57:08 UTC | Change commands to log | 19 October 2016, 19:58:22 UTC |
3ea20d0 | bethac07 | 13 October 2016, 20:48:23 UTC | Add sysstat | 19 October 2016, 19:58:19 UTC |
354ba24 | bethac07 | 13 October 2016, 20:09:39 UTC | Remove hard coding of EBS volume size | 19 October 2016, 19:58:18 UTC |
61839ad | bethac07 | 13 October 2016, 20:09:09 UTC | Add specification of EBS volume size | 19 October 2016, 19:58:17 UTC |
12f8cbd | bethac07 | 13 October 2016, 20:02:29 UTC | Add EBS vol size to config | 19 October 2016, 19:58:16 UTC |
b865aa3 | bethac07 | 13 October 2016, 13:29:06 UTC | Update AMI | 19 October 2016, 19:57:57 UTC |
d1b3714 | bethac07 | 12 October 2016, 22:22:21 UTC | Fix cluster specification | 19 October 2016, 19:57:40 UTC |
2e8096e | bethac07 | 12 October 2016, 22:05:46 UTC | Add logging to monitor | 19 October 2016, 19:57:18 UTC |
872294d | bethac07 | 12 October 2016, 21:46:45 UTC | Add instance monitor | 19 October 2016, 19:57:16 UTC |
5baec93 | bethac07 | 12 October 2016, 21:55:17 UTC | Add instance monitor file | 19 October 2016, 19:56:31 UTC |
56cf0eb | bethac07 | 12 October 2016, 21:54:51 UTC | Add an instance statistics monitor | 19 October 2016, 19:56:29 UTC |
99cf406 | bethac07 | 12 October 2016, 21:34:05 UTC | Add cluster name to env variables | 19 October 2016, 19:56:28 UTC |
25d6278 | bethac07 | 12 October 2016, 16:18:41 UTC | Add log configuration to the task files | 19 October 2016, 19:55:53 UTC |
6fc51e0 | bethac07 | 12 October 2016, 16:17:16 UTC | Add _perInstance log groups | 19 October 2016, 19:55:34 UTC |
609262a | bethac07 | 12 October 2016, 16:08:38 UTC | Remove user data specification from the fleet file | 19 October 2016, 19:55:33 UTC |
f38df25 | bethac07 | 12 October 2016, 16:07:28 UTC | Add use of ecs config file | 19 October 2016, 19:55:12 UTC |
46cb2e5 | bethac07 | 11 October 2016, 20:27:47 UTC | Merge pull request #34 from jccaicedo/issues/29 Add specification of cluster | 11 October 2016, 20:27:47 UTC |
c54c676 | bethac07 | 11 October 2016, 18:26:04 UTC | Add specification of cluster | 11 October 2016, 20:27:08 UTC |
3a59c2f | bethac07 | 11 October 2016, 20:17:10 UTC | Fix spacing issue in auto-name | 11 October 2016, 20:17:10 UTC |
e7150f3 | bethac07 | 11 October 2016, 19:05:43 UTC | Update cp-worker.py | 11 October 2016, 20:05:56 UTC |
f5e83d2 | bethac07 | 11 October 2016, 17:42:25 UTC | Highlight ability to launch to cheapest of several subnets | 11 October 2016, 17:42:25 UTC |
0f58d70 | bethac07 | 11 October 2016, 16:25:55 UTC | Merge pull request #33 from jccaicedo/issues/28 Tag instances as they are spawned | 11 October 2016, 16:25:55 UTC |
8cb5ad8 | bethac07 | 11 October 2016, 16:15:17 UTC | Tag instances as they are spawned | 11 October 2016, 16:24:43 UTC |