Commit Graph
4152 Commits
Author SHA1 Message Date
John Chilton 29dfc3085b Track basename at the time of creation for datasets. 2019-04-20 08:18:39 -04:00
John Chilton 32604d9b03 Merge pull request #7745 from mvdbeek/dataset_search_api
Extend dataset search and add search API endpoint
2019-04-19 09:00:28 -04:00
mvdbeek e7b0867602 Make sure orm filters operate on correct model
In practice we use ParsedFiler.filter_type to discriminate
the different filter types. Filters that require the correct
model class for a specific query are now functions that take
a model_class and generate the correct filter.
2019-04-18 18:55:14 +02:00
mvdbeek 885d9d1766 Fix err_msg assertion 2019-04-17 16:30:24 +02:00
mvdbeek ae5e781edf Make TaggableFilterMixin use orm_filters
This is way more peformant and also doesn't give
weird results when a limit is used.
2019-04-17 16:03:27 +02:00
John Chilton 1e731b7c03 Add HDCA support to model persistence script. 2019-04-17 08:51:18 -04:00
John Chilton ca1b1fd854 Fix nested composite files during history import/export.
Fixes #3628
2019-04-17 08:49:09 -04:00
mvdbeek 4469b9cbc0 Split up test and test searching by tool id 2019-04-17 12:56:46 +02:00
Martin Cech 93da1fc0bd Merge pull request #7684 from jmchilton/build_objects_script
Script to populate datasets/libraries directly into an objectstore and model store.
2019-04-16 22:16:31 -04:00
mvdbeek 48d9eaf78f Add some basic dataset search testing 2019-04-16 19:31:36 +02:00
mvdbeek 95fe0ffcf5 Adjust DatasetsApiTestCase.test_index to status code 200
And modernize test setup by using DatasetPopulator.
2019-04-16 19:31:03 +02:00
Martin Cech 51cbf440bf Merge pull request #7755 from jmchilton/job_error_reporting
Report a couple common errors in dataset/job report.
2019-04-16 13:30:12 -04:00
John Chilton 44856a3f75 Report a couple common errors in dataset/job report.
Report if empty inputs were used or if the same input was used more than once, these were identified as common sources of potential errors across many tools. Neither of these are definite problems, but both could be depending on the tool and both happen frequently. Outline a few more ideas as TODOs in the code.
2019-04-16 10:24:28 -04:00
Marius van den Beek 7c233a9c2d Merge pull request #7754 from jmchilton/fix_for_docker_on_mac_kubernetes_test
Fix Kubernetes integration tests for Docker on Mac.
2019-04-16 16:20:53 +02:00
John Chilton 74bf94f445 Fix kubernetes integration tests for Docker on Mac. 2019-04-16 08:28:36 -04:00
John Chilton c33b4d4364 Merge pull request #7724 from mvdbeek/dependent_jobs
Unpause dependent jobs when resuming jobs
2019-04-15 14:16:47 -04:00
Nicola Soranzo 1b1f6e9cda Fix comments 2019-04-14 18:02:42 +01:00
Nicola Soranzo bfc7b68848 Merge branch 'release_19.01' into dev 2019-04-12 23:18:49 +01:00
Nicola Soranzo d545e88703 Add test case and use assertRaises()
Also remove temporary directory.
2019-04-12 12:41:48 +01:00
mvdbeek 0b8dec5af0 Make sure dependent jobs are being unpaused
Fixes https://github.com/galaxyproject/galaxy/issues/6926
2019-04-11 19:35:20 +02:00
John Chilton 9dfa5d7041 Merge pull request #5495 from jmchilton/batch_operation_optimize
Batch bulk hide and delete operations when multi-selected.
2019-04-11 09:01:32 -04:00
John Chilton d89749bad7 Bulk delete and hide operations. 2019-04-10 20:59:33 -04:00
Nicola Soranzo a12db037ca Merge branch 'release_19.01' into dev 2019-04-11 00:43:45 +01:00
John Chilton fc68cb8449 Script to populate datasets/libraries directly into an objectstore and model store.
The included script takes in an object store definition to write to, model store output target (e.g. tar file or directory or bagit file/directory format matching the new history exports added in 7367), and a bunch of files in defined via an upload-2.0-style YAML - and writes the physical files into the object store and writes persisted metadata into the model store. The supplied script describes the input format as do the new unit tests in test_model_discover.py.

Right now datasets for a history and whole libraries (including recursive folders and library datasets) can be described this way. These concepts have been extended to collections in #7058 but only in the context of discovering job outputs and writing them to an export model store current.

This script was created mostly by refactoring stuff out of output_collect.py that is used to create datasets during output discovery (i.e. parsing the same data out of galaxy.json files).
2019-04-10 11:01:09 -04:00
John Chilton 76b1bf3a85 Model store - configurable metadata file handling. 2019-04-10 10:58:28 -04:00
John Chilton 8657ad9afe Test case for copied_from chains that leave the history and come back. 2019-04-10 10:58:28 -04:00
Nate Coraor 8d5b155f1a Merge pull request #7694 from jmchilton/fix_pulsar_metadata
Fix pulsar remote metadata with metadata_strategy == 'directory'.
2019-04-10 09:02:31 -04:00
mvdbeek 4c9e4118f5 Restrict workflow invocation index to current user
If the user is not an admin.
Fixes https://github.com/galaxyproject/galaxy/issues/7710

An alternative would be to skip Accessibility / Ownership
exceptions, but given that we can just restrict the query
this seems like the better approach to me.
2019-04-10 11:13:59 +02:00
John Chilton da26bfdc75 Merge pull request #7683 from mvdbeek/implicit_conversion_for_collection_parameters
Implicit conversion for input collection parameters
2019-04-09 10:55:17 -04:00
Martin Cech 1075a0e6bc Merge pull request #7659 from jmchilton/format2_import_default
Allow import of format2 workflows by default for 19.05.
2019-04-09 10:50:45 -04:00
John Chilton 74a6615488 Fix pulsar with metadata_strategy == 'directory'. 2019-04-08 16:30:15 -04:00
Enis Afgan a8dc13da53 Merge pull request #7195 from machristie/keycloak-integration
Custos integration
2019-04-08 16:15:41 -04:00
mvdbeek 272a136970 Add test tools for implicit coversion of collection input 2019-04-08 18:33:57 +02:00
mvdbeek 54b9609896 Merge branch 'release_19.01' into dev 2019-04-08 18:29:11 +02:00
Martin Cech adfb7e65b3 Merge pull request #7682 from mvdbeek/fix_format_source_impicit_conversion
[19.01] Fix format_source for implicit conversion inputs and fasta.gz upload
2019-04-08 10:13:26 -04:00
Marius van den Beek 03b96f9eb3 Merge pull request #7650 from jmchilton/uuid_fixes
Fix composite data and metadata file handling for UUID object stores
2019-04-08 15:17:23 +02:00
Marius van den Beek 7ea8734796 Merge pull request #7367 from jmchilton/export_collections
Rework and Generalize History Import and Export
2019-04-08 14:24:45 +02:00
mvdbeek 966cad890e Fix fasta.gz uploads
This looks like it may probably broke with https://github.com/galaxyproject/galaxy/commit/fce2dd3ae801cd13a542388746b84f9cca2a4c48
2019-04-07 23:15:35 +02:00
mvdbeek 5f578d4108 Add double conversion test 2019-04-07 23:15:35 +02:00
mvdbeek 3e3d15a84b Add test that verifies ftype is being set correctly 2019-04-07 23:15:35 +02:00
John Chilton 9dbace05b0 Merge pull request #7657 from jmchilton/integration_testing_refactor
Refactor IntegrationTestCase to allow integration test functions.
2019-04-06 13:09:02 -04:00
Sveinung Gundersen 28cd9948b7 Fixed bug when removing other tags than the first from a dataset. A space was erroneously added in front of these tags. 2019-04-06 03:52:35 +02:00
John Chilton 55f58cb627 Make heartbeat unit tests a bit more robust. 2019-04-04 15:08:52 -04:00
John Chilton 4527293ce4 Refactor IntegrationTestCase to allow integration test functions.
I want to be able to make more integration tests like test_pulsar_embedded.py, where we just define a configuration and then some tool tests to run. In particular this will be useful for extended metadata testing of the most interesting tools.
2019-04-04 14:58:55 -04:00
Marcus Christie e6878a0936 Removed raw_token column, bumped migration number 2019-04-04 10:31:43 -04:00
John Chilton 4b13917d86 Allow import format2 workflows by default.
Setup forcing export of format2 workflows by default in next release. There should be a least one release between enabling them to be imported by default and exporting them by default anyway I think - so 19.09 workflows can still be used on slightly older Galaxy instances.
2019-04-04 09:15:30 -04:00
John Chilton 8aa7a62f85 Default test suite to store objects by UUID.
If we have to test one path or the other, test the slightly more exotic one.
2019-04-04 08:11:56 -04:00
Marcus Christie f9eda39a82 Fixing tests 2019-04-03 17:09:14 -04:00
Marcus Christie 62617d4c8a Merge branch 'keycloak-integration' into patch-5 2019-04-03 15:17:58 -04:00
Marcus Christie b14c487287 Simplified configuration based on provider name and realm 2019-04-03 15:12:35 -04:00