| ae02a8e | John Garza | 13 May 2021, 21:50:51 UTC | Merge pull request #2012 from johnegarza/skip_disk_querying Skip disk querying | 13 May 2021, 21:50:51 UTC |
| 352477d | johnegarza | 13 May 2021, 20:51:55 UTC | More relevant var name | 13 May 2021, 20:51:55 UTC |
| 7b5d91c | johnegarza | 13 May 2021, 20:38:08 UTC | Skip direct disk space queries when allocation path creation is skipped | 13 May 2021, 20:38:08 UTC |
| c2e9669 | John Garza | 11 May 2021, 23:14:19 UTC | Merge pull request #2011 from johnegarza/python3_gsutil_focal Call gsutil with python3 in Ubuntu 20.04 focal based images | 11 May 2021, 23:14:19 UTC |
| 2e4d2db | johnegarza | 11 May 2021, 22:55:56 UTC | Call gsutil with python3 in Ubuntu 20.04 focal based images | 11 May 2021, 22:55:56 UTC |
| 7c49c6d | John Garza | 10 May 2021, 21:45:19 UTC | Merge pull request #2010 from johnegarza/gcp_config_bucket_var Use env variables instead of hardcoding gcp bucket | 10 May 2021, 21:45:19 UTC |
| 47b3277 | johnegarza | 10 May 2021, 21:25:10 UTC | Use env variables instead of hardcoding gcp bucket | 10 May 2021, 21:25:10 UTC |
| 7ace67e | John Garza | 10 May 2021, 20:55:57 UTC | Merge pull request #2009 from johnegarza/update_commands Add an update env file command | 10 May 2021, 20:55:57 UTC |
| 4c04df1 | John Garza | 10 May 2021, 20:55:13 UTC | Merge pull request #2007 from johnegarza/config_skip_allocation_creation Skip allocation path creation for config files | 10 May 2021, 20:55:13 UTC |
| ba32611 | johnegarza | 06 May 2021, 21:39:09 UTC | fix number of tests | 06 May 2021, 21:39:09 UTC |
| 2a6b9b5 | johnegarza | 06 May 2021, 21:33:20 UTC | Add a basic test case | 06 May 2021, 21:33:20 UTC |
| 5361726 | johnegarza | 06 May 2021, 20:01:35 UTC | Keep language consistent | 06 May 2021, 20:01:35 UTC |
| e9b1dde | johnegarza | 05 May 2021, 22:11:20 UTC | Initial work to allow updating AnP environment files | 05 May 2021, 22:11:20 UTC |
| 0ee82ef | johnegarza | 05 May 2021, 21:38:59 UTC | Handle no-commit further upstream | 05 May 2021, 21:38:59 UTC |
| 141c293 | johnegarza | 05 May 2021, 21:14:58 UTC | Use spaces not tabs | 05 May 2021, 21:14:58 UTC |
| 167159c | johnegarza | 04 May 2021, 22:31:53 UTC | Make sure tests can create allocations | 04 May 2021, 22:31:53 UTC |
| 596c145 | johnegarza | 04 May 2021, 21:13:44 UTC | Retain CQID ability to directly write to filesystem | 04 May 2021, 21:13:44 UTC |
| bfe3dc4 | johnegarza | 04 May 2021, 20:50:30 UTC | Better var name and skip path creation for config items too | 04 May 2021, 20:50:30 UTC |
| 0ff0a89 | johnegarza | 03 May 2021, 23:20:34 UTC | Skip creating allocation dirs for env config | 03 May 2021, 23:20:34 UTC |
| 3c5eb40 | John Garza | 03 May 2021, 21:10:59 UTC | Merge pull request #2006 from johnegarza/fix_uploaded_config_name Fix uploaded file name | 03 May 2021, 21:10:59 UTC |
| 00c39e7 | John Garza | 03 May 2021, 20:49:03 UTC | Fix variables Co-authored-by: Thomas B. Mooney <mooney@wustl.edu> | 03 May 2021, 20:49:03 UTC |
| 8e1ce00 | John Garza | 03 May 2021, 20:48:03 UTC | Use join to construct uploaded file name Co-authored-by: Thomas B. Mooney <mooney@wustl.edu> | 03 May 2021, 20:48:03 UTC |
| 6a2f4a3 | johnegarza | 03 May 2021, 20:32:32 UTC | Fix uploaded file name | 03 May 2021, 20:32:32 UTC |
| 13cde6b | John Garza | 30 April 2021, 21:20:36 UTC | Merge pull request #2005 from johnegarza/basic_config_file_changes Basic config file changes | 30 April 2021, 21:20:36 UTC |
| 5b8093e | johnegarza | 29 April 2021, 22:39:08 UTC | Keep terminology consistent | 29 April 2021, 22:39:08 UTC |
| 8b24aea | johnegarza | 29 April 2021, 22:01:25 UTC | Inform the user that the file will not be immediately available | 29 April 2021, 22:01:25 UTC |
| 41dea8b | johnegarza | 29 April 2021, 20:31:30 UTC | Pass original name so update script can use it | 29 April 2021, 20:31:30 UTC |
| 3e2cf8b | Thomas B. Mooney | 28 April 2021, 20:51:31 UTC | Merge pull request #2002 from tmooney/anp_create_wanna_create AnP Create: Now with More Interactivity! | 28 April 2021, 20:51:31 UTC |
| 9dcc085 | Thomas B. Mooney | 28 April 2021, 17:00:57 UTC | Make the interactive menu item adding more interactive. The --no-config option or the --analysis-menu-item options bypass this prompt as per usual, so automated use of this command is still possible. | 28 April 2021, 20:45:52 UTC |
| 14ee58c | Thomas B. Mooney | 28 April 2021, 20:44:01 UTC | Merge pull request #2004 from tmooney/allocation_cleanup_knows_about_certificates Check for certificates for the production database connection. | 28 April 2021, 20:44:01 UTC |
| c35c81f | Thomas B. Mooney | 28 April 2021, 19:46:05 UTC | Check for certificates for the production database connection. | 28 April 2021, 20:14:24 UTC |
| 5a1a89a | Thomas B. Mooney | 28 April 2021, 19:19:51 UTC | Merge pull request #2003 from tmooney/testtracker_certs_in_conf Include certs in test-tracker server config. | 28 April 2021, 19:19:51 UTC |
| 21043d9 | Thomas B. Mooney | 28 April 2021, 18:53:46 UTC | Include certs in test-tracker server config. Once again not a useful file for the world at large, but helpful for us! | 28 April 2021, 18:53:46 UTC |
| 3b0215d | Thomas B. Mooney | 28 April 2021, 17:00:01 UTC | Print IDs instead of object hashes in list. Sure it's still inscrutable, but at least it's an inscrutable list of values someone might possibly be able to use. | 28 April 2021, 17:00:01 UTC |
| 4873a90 | johnegarza | 27 April 2021, 23:26:22 UTC | Basic change for the add-config-file cmd | 27 April 2021, 23:26:22 UTC |
| e9434f4 | johnegarza | 27 April 2021, 21:51:55 UTC | Restore old functionality for test cases | 27 April 2021, 21:51:55 UTC |
| 93757dc | Thomas B. Mooney | 23 April 2021, 18:22:15 UTC | Merge pull request #1999 from tmooney/usage_log_dsn Update connection string for usage log. | 23 April 2021, 18:22:15 UTC |
| 6d70e33 | Thomas B. Mooney | 22 April 2021, 22:30:57 UTC | Update connection string for usage log. It makes me sad this string is hardcoded here, but I guess updating it once every several years isn't so bad :) | 22 April 2021, 22:30:57 UTC |
| a82decc | johnegarza | 22 April 2021, 20:48:43 UTC | Minimum change to add env cmd that uploads to gcp instead of copying locally | 22 April 2021, 20:48:43 UTC |
| 44d575e | Thomas B. Mooney | 14 April 2021, 18:26:30 UTC | Merge pull request #1998 from tmooney/monitor_jobs_when_call_caching When call-caching is enabled, check the health of jobs. | 14 April 2021, 18:26:30 UTC |
| f4035f5 | Thomas B. Mooney | 14 April 2021, 15:16:23 UTC | When call-caching is enabled, check the health of jobs. Before we were letting jobs fail and manually running `script.submit` for replacement jobs in the event of LSF failure due to the high cost of starting a workflow from the beginning over such a trivial failure. With call-caching that cost is reduced, so it's better to have quicker notification of issues. | 14 April 2021, 15:16:23 UTC |
| f19d9c1 | Thomas B. Mooney | 12 April 2021, 20:00:27 UTC | Merge pull request #1997 from tmooney/use_filetest_access Enable ACL support for filetests. | 12 April 2021, 20:00:27 UTC |
| f2e6974 | Thomas B. Mooney | 24 March 2021, 18:42:19 UTC | Enable ACL support for filetests. Less performant, sure, but actually works with a lovely non-posix-compliant filesystem, too! See also: https://perldoc.perl.org/filetest | 24 March 2021, 18:42:19 UTC |
| 96de3cf | Thomas B. Mooney | 22 March 2021, 20:59:53 UTC | Merge pull request #1996 from tmooney/du_apparent_size Use the apparent size for allocations. | 22 March 2021, 20:59:53 UTC |
| 29930af | Thomas B. Mooney | 22 March 2021, 20:59:45 UTC | Merge pull request #1995 from tmooney/requeue_for_build_retry Add ability to queue rebuilds for CwlPipeline builds. | 22 March 2021, 20:59:45 UTC |
| 288c115 | Thomas B. Mooney | 17 March 2021, 19:57:21 UTC | Use the apparent size for allocations. With the fancy fancy cache layer we're using these days, the actual size of files that haven't been pulled into the cache is not detemrined correctly by `du`. But the apparent size is good enough! | 17 March 2021, 19:57:21 UTC |
| 7487982 | Thomas B. Mooney | 15 March 2021, 20:43:03 UTC | Add ability to queue rebuilds for CwlPipeline builds. This functions like `genome model build queue` but for restarting builds rather than creating new ones. Since we're moving away from supporting the queue for arbitrary users, this is set up to only allowing the queue of failed "production" builds. | 15 March 2021, 20:43:03 UTC |
| fc62358 | Thomas B. Mooney | 09 February 2021, 16:03:09 UTC | Merge pull request #1992 from tmooney/merge_with_liftover Need to liftOver each track individually. | 09 February 2021, 16:03:09 UTC |
| 9186b05 | Thomas B. Mooney | 09 February 2021, 16:02:00 UTC | Merge pull request #1994 from tmooney/volume_and_group_create Create commands for disk groups and volumes | 09 February 2021, 16:02:00 UTC |
| 617f61d | Thomas B. Mooney | 26 January 2021, 18:28:18 UTC | Add help/doc sections to new volume/group create commands. | 26 January 2021, 18:28:18 UTC |
| c87f212 | Thomas B. Mooney | 26 January 2021, 16:24:46 UTC | New command to help create volumes. | 26 January 2021, 16:24:46 UTC |
| 1f88462 | Thomas B. Mooney | 25 January 2021, 23:20:33 UTC | New command to facilitate creating disk groups. | 25 January 2021, 23:20:33 UTC |
| cb71a24 | Thomas B. Mooney | 01 December 2020, 19:59:37 UTC | Merge pull request #1990 from tmooney/possible_volumes Add true value to end of module. | 01 December 2020, 19:59:37 UTC |
| deb9ee3 | Thomas B. Mooney | 12 November 2020, 16:44:01 UTC | Merge pull request #1991 from tmooney/bqm_remote Make the "prod-builder" run_as configurable. | 12 November 2020, 16:44:01 UTC |
| 6e282f4 | Thomas B. Mooney | 12 November 2020, 16:43:39 UTC | Merge pull request #1993 from tmooney/move_cwlpipelines Use more UR-centric approach to test for owner class existence. | 12 November 2020, 16:43:39 UTC |
| 751dbc9 | Thomas B. Mooney | 09 November 2020, 19:20:02 UTC | Use more UR-centric approach to test for owner class existence. UR classes don't necessarily have defined perl module files, and we don't support auto-updating any non-UR classes, so this should be good enough! | 09 November 2020, 19:20:02 UTC |
| 2d3cf39 | Thomas B. Mooney | 27 October 2020, 20:23:23 UTC | Need to liftOver each track individually. This assumes that the two existing track names are the ones that exist for multi-tracked files. "Weird" tracks will not work right. | 27 October 2020, 20:23:23 UTC |
| ee980b3 | Thomas B. Mooney | 19 October 2020, 17:30:48 UTC | Merge pull request #1988 from tmooney/auto_remote_sync_admin Auto-connect production imports to remote volumes. | 19 October 2020, 17:30:48 UTC |
| 0d73a55 | Thomas B. Mooney | 15 October 2020, 19:02:13 UTC | Make the "prod-builder" run_as configurable. Now that we're operating on multiple clusters we've run into a situation where it'd be nice to distinguish between then with different "run_as" indications. This will let us change it when run on the new cluster while leaving it the same on the old. (Or someone enterprising could set the appropriate environment variable to setup for the "other" cluster for the one they're on!) | 15 October 2020, 19:02:13 UTC |
| 1584b35 | Thomas B. Mooney | 14 October 2020, 19:16:50 UTC | Add true value to end of module. | 14 October 2020, 19:16:50 UTC |
| f9d5142 | Thomas B. Mooney | 14 October 2020, 17:28:09 UTC | Merge pull request #1989 from tmooney/possible_volumes New command to help identify which volumes to mount. | 14 October 2020, 17:28:09 UTC |
| 072763f | Thomas B. Mooney | 14 October 2020, 14:48:54 UTC | Merge pull request #1983 from tmooney/prod-builder_for_wo_projects Stop hardcoding "apipe-builder" when determining applicable models | 14 October 2020, 14:48:54 UTC |
| 2a0beb1 | Thomas B. Mooney | 13 October 2020, 21:41:39 UTC | New command to help identify which volumes to mount. This command lists the possible volumes configured for an AnP. This could be used for a safe list of volumes to mount when launching a container to work with the AnP. | 13 October 2020, 21:41:39 UTC |
| 91121e8 | Thomas B. Mooney | 12 October 2020, 15:43:04 UTC | Keep dbh connection open on short-lived shellcmd runs. The one in the cleanup guard is especially important, since on a successful run it'll be running as the system shuts down. In that circumstance calling the disconnect process may fail. | 12 October 2020, 15:43:04 UTC |
| fed4496 | Thomas B. Mooney | 08 October 2020, 19:37:11 UTC | Auto-connect production imports to remote volumes. | 12 October 2020, 15:30:35 UTC |
| c6f04ff | Thomas B. Mooney | 30 September 2020, 15:41:21 UTC | Merge pull request #1984 from tmooney/import_data_from_lims_to_remote Support importing LIMS data into the system directly onto a remote volume. | 30 September 2020, 15:41:21 UTC |
| 1c318d9 | Thomas B. Mooney | 17 September 2020, 20:23:27 UTC | Support importing LIMS data into the GMS on a remote volume. | 24 September 2020, 20:31:29 UTC |
| 33b5387 | Thomas B. Mooney | 16 September 2020, 22:20:23 UTC | Make test more generic about users, too. | 24 September 2020, 14:27:14 UTC |
| 24f0ddf | Thomas B. Mooney | 22 September 2020, 21:29:00 UTC | Merge pull request #1986 from tmooney/ssl_for_dgidb Use HTTPS to connect to dgidb. | 22 September 2020, 21:29:00 UTC |
| a88cbb1 | Thomas B. Mooney | 22 September 2020, 21:28:51 UTC | Merge pull request #1985 from tmooney/splitpath_typo Fix typo: s/split_path/splitpath/. | 22 September 2020, 21:28:51 UTC |
| cfd78bf | Thomas B. Mooney | 22 September 2020, 17:16:11 UTC | Add testcase for updating instrument data bam path on allocation move. | 22 September 2020, 17:16:11 UTC |
| 54b3b2f | Thomas B. Mooney | 21 September 2020, 20:07:58 UTC | Use HTTPS to connect to dgidb. The new release of dgidb requires SSL. The HTTP version redirects. This code is pretty old and is likely a good candidate for outright removal, but these changes make the tests pass again (albeit mostly in a lame way). | 21 September 2020, 20:07:58 UTC |
| 2d85d58 | Thomas B. Mooney | 17 September 2020, 22:09:10 UTC | Fix typo: s/split_path/splitpath/. | 17 September 2020, 22:09:10 UTC |
| 41bb3fd | Thomas B. Mooney | 16 September 2020, 22:05:46 UTC | Stop hardcoding "apipe-builder" when determining applicable models We've locally been using a different production user for many years, so it'd be nice if this worked again! | 16 September 2020, 22:05:46 UTC |
| 8216cbc | Thomas B. Mooney | 15 September 2020, 21:11:07 UTC | Merge pull request #1981 from tmooney/allocation_transfer New command `genome disk allocation transfer`. | 15 September 2020, 21:11:07 UTC |
| b00190a | Thomas B. Mooney | 15 September 2020, 21:10:51 UTC | Merge pull request #1978 from tmooney/file_database_call_caching Cromwell Call Caching support | 15 September 2020, 21:10:51 UTC |
| 391184c | Thomas B. Mooney | 15 September 2020, 21:10:37 UTC | Merge pull request #1974 from tmooney/remove_extra_subcall Remove extra layer of method calls. | 15 September 2020, 21:10:37 UTC |
| 819df31 | Thomas B. Mooney | 31 August 2020, 17:24:05 UTC | Switch to xxh64 instead of fingerprint for call-caching. The "fingerprint" method only works with hard-links, but sometimes we have to resort to copying from the original storage to our working volume, which busts the cache since the original file metadata isn't maintained for the copy. | 31 August 2020, 17:24:05 UTC |
| 24bf893 | Thomas B. Mooney | 10 June 2020, 21:46:58 UTC | Mitigate having multiple workflows per build. The "right" answer here would be to link them to the corresponding Genome::Process. The issue right now is that the process is created *after* the workflow inputs are assigned, so we have no way to accurately determine the correct process for our current run. There are some strategies for trying to figure it out. For example: - look up our current LSF Job ID and check the database for a matching process. - look for the one process that is currently marked as "running" and die if there's a second one. For now this assumes only one process ever "succeeds" for a build and the build view displays all the workflows in an arbitrary order. | 11 August 2020, 15:39:39 UTC |
| 42b2262 | Thomas B. Mooney | 27 July 2020, 19:41:07 UTC | Merge pull request #1982 from tmooney/no_lsf_tmp_modifications Remove modifications of pre-provided LSF temp directory. | 27 July 2020, 19:41:07 UTC |
| 365caf9 | Thomas B. Mooney | 24 July 2020, 21:49:23 UTC | Remove modifications of pre-provided LSF temp directory. On the new cluster this directory is locked down so we lack permissions to change it. | 24 July 2020, 21:49:23 UTC |
| 6cae9c6 | Thomas B. Mooney | 23 July 2020, 19:43:45 UTC | Test execution of the command. We can make sure we updated the database entries, even if testing the rsync portion is impractical! | 23 July 2020, 19:43:45 UTC |
| 97cff7d | Thomas B. Mooney | 15 July 2020, 21:28:28 UTC | Make sure directory exists before attempting `rsync`. | 15 July 2020, 21:28:28 UTC |
| 4a5d6db | Thomas B. Mooney | 29 June 2020, 20:26:14 UTC | New `genome disk allocation transfer` for sending to a remote volume. | 15 July 2020, 21:18:12 UTC |
| 5705880 | Thomas B. Mooney | 29 June 2020, 20:24:20 UTC | Add instrument data to update_owner_for_move. I'm not a big fan of the way this one spot has to be added to for any potential allocation owner to get updated, but it works and it's fairly straightforward! So let's stick with it for now. | 29 June 2020, 20:24:20 UTC |
| b363008 | Thomas B. Mooney | 22 June 2020, 19:28:30 UTC | Merge pull request #1979 from tmooney/imported_data_more_tolerant_of_bam_paths Allow imported BAMs with arbitrary filenames | 22 June 2020, 19:28:30 UTC |
| 80f6afe | Thomas B. Mooney | 22 June 2020, 19:27:49 UTC | Merge pull request #1980 from tmooney/listdockerimages_t_truevalue `test-tracker` in `--track` mode requires tests to return a true value in order to pass. | 22 June 2020, 19:27:49 UTC |
| d0023c8 | Thomas B. Mooney | 18 June 2020, 18:14:10 UTC | `test-tracker` requires tests to return a true value in order to pass. But "skip" doesn't do that--it returns undef, so we'll add our own true value! | 18 June 2020, 18:14:10 UTC |
| aca76c9 | Thomas B. Mooney | 17 June 2020, 17:03:03 UTC | Try to find any single BAM in the directory if expected path not found. The "trusted data" importer makes it easier to import a BAM with any arbitrary filename. It should be fine to accept this as long as it's the only one. | 17 June 2020, 17:03:03 UTC |
| 1c5281f | Thomas B. Mooney | 17 June 2020, 17:01:10 UTC | Fix bug in no-allocation error message. See that comma there in the old version? That would eat the second half of the message! | 17 June 2020, 17:02:29 UTC |
| c4273f7 | Thomas B. Mooney | 16 June 2020, 19:30:44 UTC | Merge pull request #1976 from tmooney/describe_cwl_pipeline_pps New command to list docker images for a CWL pipeline build. | 16 June 2020, 19:30:44 UTC |
| ff6a3f7 | Thomas B. Mooney | 10 June 2020, 19:47:45 UTC | Don't regenerate config and labels on build restart. | 10 June 2020, 21:57:15 UTC |
| fddaad0 | Thomas B. Mooney | 10 June 2020, 19:39:48 UTC | Configuration option to enable cromwell call caching. | 10 June 2020, 19:39:48 UTC |
| 1d679cc | Thomas B. Mooney | 28 May 2020, 20:43:00 UTC | Merge pull request #1977 from tmooney/no_df_of_remote_volumes For now, don't try to `df` remote volumes. | 28 May 2020, 20:43:00 UTC |
| 3631187 | Thomas B. Mooney | 28 May 2020, 17:59:25 UTC | Merge pull request #1975 from tmooney/skip_copycat_linelength_tests Skip non-deterministic tests. | 28 May 2020, 17:59:25 UTC |
| 77daed3 | Thomas B. Mooney | 28 May 2020, 15:41:54 UTC | Also use physical path for remote volumes in volume lister. | 28 May 2020, 15:41:54 UTC |
| 1f5eaba | Thomas B. Mooney | 28 May 2020, 14:32:38 UTC | For now, don't try to `df` remote volumes. For volumes that are mounted via a cache layer, df doesn't work properly (among other non-compliant aspects of the filesystem). In our case we could possibly use SMB to connect to the remote server and find out the canonical used and total KB, but for now let's trust our database to be accurate. | 28 May 2020, 14:32:38 UTC |
| 45e459a | Thomas B. Mooney | 21 May 2020, 20:47:56 UTC | New command to list docker images for a CWL pipeline build. Someone was asking me what versions of things ran in a given model, and it seemed like there should be an easier way to answer this question! | 21 May 2020, 20:47:56 UTC |
| 1ceffce | Thomas B. Mooney | 21 May 2020, 17:12:06 UTC | Remove old debug statement. | 21 May 2020, 17:12:06 UTC |
| 6ec2901 | Thomas B. Mooney | 21 May 2020, 16:47:51 UTC | Merge pull request #1973 from tmooney/uuid_generator_for_disk_tables Use UUID generator for creating disk groups. | 21 May 2020, 16:47:51 UTC |
