sort by:
Revision Author Date Message Commit Date
915f1ef Update run.py (#122) 14 January 2021, 13:41:53 UTC
8ce77da Add Names to the volumes (#118) * Add Names to the volumes * Add Names to the volumes 13 November 2020, 20:19:37 UTC
6c59afc keep CSVs from overwriting one another 12 November 2020, 15:18:17 UTC
6563264 keep CSVs from overwriting one anohter 12 November 2020, 15:10:40 UTC
d29f39c keep CSVs from overwriting one anohter 12 November 2020, 14:41:06 UTC
b868abc keep CSVs from overwriting one anohter 12 November 2020, 14:33:02 UTC
f02cc6e be more selective in file deletion 10 November 2020, 19:58:50 UTC
8ba8a7b Pin pandas for CP3 10 November 2020, 16:09:18 UTC
c4a9f83 Optionally download files to EBS rather than use S3FS (#116) * First attempt at downloading files * fix string reading of metadata * remove files when you're done with them * my code runs too fast * use fields * make channels into a list * make directory for files to land in * port to python2 10 November 2020, 15:59:50 UTC
82dc8c6 fix some bugs related to a bad variable name in startCluster 09 November 2020, 22:05:49 UTC
dc6703e fix typo in shutil 06 November 2020, 21:02:08 UTC
d0c34ce Update run.py 06 November 2020, 20:58:53 UTC
115370a Remove DOCKER_BASE_SIZE now that it's auto-calculated 06 November 2020, 20:31:14 UTC
4f2897f Update config.py 06 November 2020, 20:04:20 UTC
1b52e5a DCP2.0 (#104) * Update run.py * Delete fabfile.py * Move previous fab functions into run.py * Debugging from lambda * tabs to spaces, issues/112 * issues/105 * issues/110, fix passing USE_PLUGINS * fix tabs to spaces in run.py * tab/space error in run_batch_general * issues/107 * issues/107 * add 'cheapest' mode to monitor * get credentials working * move machine type/price/date out of fleet file * move machine type/price/date out of fleet file * support running of monitor in cheapest mode * fix indentation in CHECK_IF_DONE * move cpDone * don't move done file, you still need to check it * don't move done file, you still need to check it * fix cmdstm for batch files * fixes to make log export work * python 3 support in run.py * move Python2 files to their own folder * pin watchtower to last python2 version * support for CellProfiler 4 * fix alarm time designation * Update README.md * Update requirements.txt * Update LICENSE * Add a bit about run_batch_general 05 November 2020, 21:15:37 UTC
338e7c6 Clone and install requirements for CPPlugins (#91) * Clone the plugins repo * Update Dockerfile * Add plugins directory to CP call * Add plugins to config * Add USE_PLUGINS * Fix -i bug in batchfiles, make plugins follow an input variable * Fix formatting of cmd lines * Space before --plugins * Rebase plugins use (#109) * Add userdata for each LaunchSpecification (#102) Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> * Batch files should be able to have input files too Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> Co-authored-by: Matthew Chess <fuzzymath007@users.noreply.github.com> Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> 03 November 2020, 15:20:49 UTC
2520c42 Create run_batch_general.py (#108) 03 November 2020, 15:18:33 UTC
4f0a525 Update cp-worker.py 30 September 2020, 17:07:12 UTC
3d03417 Batch files should be able to have input files too 23 June 2020, 03:36:40 UTC
04a7f9d Add userdata for each LaunchSpecification (#102) Co-authored-by: Ubuntu <ubuntu@ip-10-236-94-254.ec2.internal> 04 May 2020, 14:03:33 UTC
c15d455 Check minimum file size, misc updates for 1.2.1 (#97) * Add min file size, bump DCP versions * Update Dockerfile * Update Makefile * Update Makefile * Update fabfile.py * Update cp-worker to check for a minimum file size If not specified, use 1 byte * Don't write bad code * Don't write bad code * Don't check alarms at midnight 25 March 2020, 14:32:45 UTC
fa2e17c Update DockerhubTag 09 January 2020, 21:02:20 UTC
917922c Downscale extra machines if you have them. (#95) * Update run.py * Update run.py * Update run.py * Only scale down, not up * Update run.py * Update run.py * Update run.py * Update run.py * Update run.py * Update run.py 04 September 2019, 16:05:21 UTC
ed81406 Update fabfile.py 06 August 2019, 15:11:22 UTC
f1bca1d Update fabfile.py 06 August 2019, 15:08:26 UTC
6c59499 Update Makefile 08 November 2018, 00:00:24 UTC
13ff142 Dockerfile fixes 07 November 2018, 23:59:01 UTC
068a552 Make worker compatible with either CP2 or CP3 (#88) * Test if pipeline is CP2 or CP3 * misc fixes 07 November 2018, 23:57:59 UTC
42ca1cb Update Dockerfile (#87) 07 November 2018, 20:26:37 UTC
d2bf589 Update cp-worker.py (#86) 07 November 2018, 20:26:01 UTC
4c5fd46 Create .travis.yml (#82) 07 November 2018, 20:24:57 UTC
6e9135d print() is a function in Python 3 (#81) 01 October 2018, 17:18:18 UTC
275902e fabric 2.0 makes API breaking changes (#79) no module named fabric.api 05 June 2018, 09:55:06 UTC
d6887c1 Update amis (#73) * Update exampleFleet_us-east-1.json * Update exampleFleet_us-west-2.json 12 January 2018, 17:02:28 UTC
7e92373 Reorder steps of startCluster (#72) 12 January 2018, 16:52:24 UTC
7930ab1 Update cp-worker.py (#71) 11 January 2018, 03:42:11 UTC
7fc9838 Move logging to after CHECK_IF_DONE (#68) 11 January 2018, 03:13:02 UTC
b4e1396 Reload the monitor info before shutting down (#70) 11 January 2018, 03:03:43 UTC
3e4f633 Report errors and return if spot fleet config is bad (#69) 11 January 2018, 03:00:24 UTC
e1eaf95 Mismatched metadata should be a warning, not a termination (pt2) 05 October 2017, 16:03:08 UTC
7769dfa Mismatched metadata should be a warning, not a termination 05 October 2017, 14:59:33 UTC
7da056f Typo 21 February 2017, 21:25:47 UTC
d72d24d Don't hardcode region in alarm call 21 February 2017, 21:24:29 UTC
7cf6a3a Update us-west-2 ami info 21 February 2017, 20:54:51 UTC
98df7ba Update example fleet files 21 February 2017, 19:58:58 UTC
f6c30d3 Designate exampleFleet as in the us-east-1 region. 21 February 2017, 19:54:17 UTC
cca0e25 List all top subdirectories in the bucket (for S3FS bug) 21 February 2017, 14:55:07 UTC
a78f49a Don't hardcode directory to list 21 February 2017, 14:30:05 UTC
f710acd Fix backwards compatibility to 1.0.0 21 February 2017, 14:09:04 UTC
27433c4 Push copyright year. 17 February 2017, 17:33:50 UTC
8a02c11 Add flexibility to metadata input, structure of output (#59) * Add output_structure variable * Add output structure, flexible metadata input * Allow output structuring, support metadata dicts 17 February 2017, 16:34:11 UTC
bf5e000 Mount their bucket, not our bucket 13 February 2017, 20:58:36 UTC
c29dfb7 Add 'logging' back to instance-monitor (#58) 07 February 2017, 18:59:26 UTC
30af4e3 Allow configuration of docker base size (#56) * Use cloud-image-utils to create boothook * Update run.py * Update run.py * Add DOCKER_BASE_SIZE as a configurable variable * Update run.py 07 February 2017, 15:26:30 UTC
567f6b5 Create and destroy ECS clusters on demand (#50) * Create and destroy ECS clusters on demand 08 December 2016, 19:59:11 UTC
8f00100 Fix project tag 07 December 2016, 16:06:58 UTC
d76fbfe Merge pull request #48 from jccaicedo/issues/47 Wait after queue creation 07 December 2016, 15:27:05 UTC
7ab3b45 Update fabfile.py 07 December 2016, 15:22:03 UTC
db25a94 Merge pull request #46 from jccaicedo/issues/41 Remove duplicate logs 07 December 2016, 15:04:02 UTC
172fdca Switch from MIT to BSD license 10 November 2016, 20:29:30 UTC
f63b49a Avoid duplication of metadata entries 10 November 2016, 19:57:04 UTC
ad50a3c Update monitor for changes in visible AND in-process 04 November 2016, 17:25:34 UTC
2e17bd6 Send per instance logs to the same S3 folder 03 November 2016, 21:59:42 UTC
97e8c8e Reverse order of log export and resource release. 03 November 2016, 16:47:05 UTC
2de557b Allow specification of which pieces of metadata from the command line. 03 November 2016, 15:48:47 UTC
4863827 Make CHECK_IF_DONE_BOOL case insensitive. 02 November 2016, 20:59:53 UTC
95cb3d2 Update config.py 02 November 2016, 20:43:57 UTC
52072c8 Remove unused "log group" param 02 November 2016, 17:03:04 UTC
17ef1be Update README.md 02 November 2016, 17:01:25 UTC
f7eaaf4 Remove duplicate logs 02 November 2016, 16:48:29 UTC
1ac7ecb Update config.py 02 November 2016, 16:03:10 UTC
166aa35 Merge pull request #40 from jccaicedo/issues/37 Remove queue, task definition, service at end 02 November 2016, 15:58:01 UTC
2252ea5 Remove queue, task definition, service at end 02 November 2016, 15:56:29 UTC
185212e Merge pull request #39 from jccaicedo/issues/30 Add per-instance logging, fix EBS volumes 02 November 2016, 14:11:56 UTC
88112c8 Add reminder of minimum EBS volume size. 02 November 2016, 14:06:20 UTC
0d5788c Fix EBS blocking 02 November 2016, 14:05:52 UTC
790f65c Fix mapping 19 October 2016, 19:58:39 UTC
2d5c45e Change commands to log 19 October 2016, 19:58:22 UTC
3ea20d0 Add sysstat 19 October 2016, 19:58:19 UTC
354ba24 Remove hard coding of EBS volume size 19 October 2016, 19:58:18 UTC
61839ad Add specification of EBS volume size 19 October 2016, 19:58:17 UTC
12f8cbd Add EBS vol size to config 19 October 2016, 19:58:16 UTC
b865aa3 Update AMI 19 October 2016, 19:57:57 UTC
d1b3714 Fix cluster specification 19 October 2016, 19:57:40 UTC
2e8096e Add logging to monitor 19 October 2016, 19:57:18 UTC
872294d Add instance monitor 19 October 2016, 19:57:16 UTC
5baec93 Add instance monitor file 19 October 2016, 19:56:31 UTC
56cf0eb Add an instance statistics monitor 19 October 2016, 19:56:29 UTC
99cf406 Add cluster name to env variables 19 October 2016, 19:56:28 UTC
25d6278 Add log configuration to the task files 19 October 2016, 19:55:53 UTC
6fc51e0 Add _perInstance log groups 19 October 2016, 19:55:34 UTC
609262a Remove user data specification from the fleet file 19 October 2016, 19:55:33 UTC
f38df25 Add use of ecs config file 19 October 2016, 19:55:12 UTC
46cb2e5 Merge pull request #34 from jccaicedo/issues/29 Add specification of cluster 11 October 2016, 20:27:47 UTC
c54c676 Add specification of cluster 11 October 2016, 20:27:08 UTC
3a59c2f Fix spacing issue in auto-name 11 October 2016, 20:17:10 UTC
e7150f3 Update cp-worker.py 11 October 2016, 20:05:56 UTC
f5e83d2 Highlight ability to launch to cheapest of several subnets 11 October 2016, 17:42:25 UTC
0f58d70 Merge pull request #33 from jccaicedo/issues/28 Tag instances as they are spawned 11 October 2016, 16:25:55 UTC
8cb5ad8 Tag instances as they are spawned 11 October 2016, 16:24:43 UTC
back to top