Commit Graph
231 Commits
Author SHA1 Message Date
mvdbeek d35414e546 Add test case for expression tool data output with bam pja 2023-09-09 14:53:56 +02:00
mvdbeek 0d3a39909d Add test for conditional step with nested tool state 2023-09-07 09:40:26 +02:00
mvdbeek 41dcd58f94 Add test case for nested subworkflow skip 2023-09-04 12:07:22 +02:00
mvdbeek 735f918683 Test mapping over in conditional invocation 2023-08-31 20:54:14 +02:00
John Chilton eea5fb1a53 Fix mapping parent workflow formal inputs to subworkflow informal replacement parameters. 2023-08-24 14:12:39 -04:00
mvdbeek 9c0db40592 Serialize copied_from_job_id attribute and test implicit hdca job consumption 2023-07-18 12:32:04 +10:00
John Davis 9eb1b1b98d Replace "unknown" str with a constant across code base 2023-06-08 17:14:24 -04:00
Marius van den Beek ec9f216b73 Merge pull request #15978 from mvdbeek/fix_recording_param_path
Record input datasets and collections at full parameter path
2023-06-04 17:47:51 +02:00
mvdbeek bece9ddfff Ensure unprefixed PJA rename references continue to work 2023-06-01 17:50:30 +02:00
mvdbeek 7aad0a4d43 Record input datasets and collections at full parameter path
This aligns with most other uses of visit_input_values and fixes the job
cache when data inputs are in nested conditionals.  Without the fix the
`name` attribute of `JobToInputDatasetAssociation` would not contain the
fully prefixed parameter. For trinity
(https://github.com/galaxyproject/tools-iuc/blob/72ae2e05f35098c4cb6dd4f038bff07fd36917ed/tools/trinity/trinity.xml#L195)
this would be `pool|left_input`, where `pool` is the outer conditional.
With this fix it would be `pool|inputs|left_input`, which matches what
we have in the tool state.
2023-06-01 17:50:30 +02:00
Marius van den Beek 9e377241bf Merge pull request #16149 from mvdbeek/dev
Merge 23.0 into dev
2023-05-26 09:32:29 +02:00
davelopez 5837ae49f1 Add test coverage for immutability check 2023-05-24 20:17:31 +02:00
mvdbeek 13e26671f1 Make sure rerun_remap_job_id works with DCEs
This does not test the HDA extraction, just shows that the remapping the
job output works.
2023-05-19 20:29:43 +02:00
pauldg 793b358b8d changed merge collections conflict param in test 2023-03-29 11:32:35 +02:00
pauldg 01782c0b74 Change which parameters are included.
Remove duplicate dataset entries in Collections
2023-03-29 11:32:35 +02:00
pauldg 9105ba3ea5 formatting 2023-03-29 11:32:35 +02:00
pauldg e2882dc54c Changes to tests according to ro-crate
metadata changes
2023-03-29 11:32:34 +02:00
mvdbeek 32abd51dcb Test anon can preview workflow 2023-03-01 17:13:48 +01:00
mvdbeek 091f0fb1d6 Merge branch 'release_22.05' into release_23.0 2023-02-15 16:14:30 +01:00
mvdbeek 2699f8c741 Fix unbound local error in sort collection tool
Fixes
```
UnboundLocalError: local variable 'sorted_elements' referenced before assignment
  File "galaxy/tools/__init__.py", line 1909, in handle_single_execution
    rval = self.execute(
  File "galaxy/tools/__init__.py", line 2005, in execute
    return self.tool_action.execute(
  File "galaxy/tools/actions/model_operations.py", line 83, in execute
    self._produce_outputs(
  File "galaxy/tools/actions/model_operations.py", line 108, in _produce_outputs
    tool.produce_outputs(
  File "galaxy/tools/__init__.py", line 3490, in produce_outputs
    for dce in sorted_elements:
```
in https://sentry.galaxyproject.org/share/issue/264aea1fd3994e5ba67ab80fcbd2c577/
2023-02-15 12:30:53 +01:00
Nicola Soranzo 30f60493c3 Format Python code with black 23.1.0
with manual fixes to 3 files to make them compatible with black 22.12.0 .

We need to keep black pinned at `<23` until we vendorise `packaging`, since
the new version of black depends on `packaging >=22.0` which is the version
where `LegacyVersion` (which we use for tool lineages) was removed.
2023-02-01 23:51:03 +00:00
mvdbeek 7eb3260e58 Fix workflow_id and history_id mixup 2023-02-01 12:32:55 +01:00
mvdbeek 8cc84d3ea5 Switch to dependencyless comp1 tool 2023-01-31 22:06:30 +01:00
mvdbeek 41a0cc1d2c Add test for subworkflow mapping over data_column input 2023-01-31 21:18:20 +01:00
mvdbeek 1edefe8b3d Fix test workflow input definitions 2023-01-30 13:00:31 +01:00
mvdbeek 7d659bc272 Test invalid expressions and expression results 2023-01-17 17:06:57 +01:00
mvdbeek e59ff1174d Backend for showing invocation failure/cancellation/warning reasons 2023-01-17 17:06:57 +01:00
mvdbeek a2c66272a7 Test and fix conditional subworkflow steps where subworkflow step produces additional mapping over without being directly connected to a workflow input 2023-01-17 17:06:54 +01:00
mvdbeek 9cdcde5251 Add subworkflow skip test when tool structure changes 2023-01-17 17:05:57 +01:00
mvdbeek 63549fe034 Stick with CWL syntax and CWL tooling to implement step skipping 2023-01-17 17:05:56 +01:00
mvdbeek bbfc689bfe Implement conditional subwokflow steps
for mapped over subworkflows and simple subworkflows
2023-01-17 17:05:56 +01:00
mvdbeek a633f1e76c Make sure we're not changing datatypes on skipped outputs 2023-01-17 17:05:55 +01:00
mvdbeek 20d92ad3ee Make new tests robust to job and step order
which seems to not be stable?!
2023-01-17 17:05:55 +01:00
mvdbeek c146f1771a Assert skipped state in tests 2023-01-17 17:05:53 +01:00
mvdbeek f087608f6a Fix up map_over of conditional output 2023-01-17 17:05:53 +01:00
mvdbeek b06444fb24 WIP: test map over and pick_value 2023-01-17 17:05:52 +01:00
mvdbeek 1f44e44873 Into map-over 2023-01-17 17:05:51 +01:00
mvdbeek 20f9b6feec Attempt to skip mapped-over steps 2023-01-17 17:05:11 +01:00
John Chilton 0a79d23150 Implement conditionals via boolean step parameter
For tool steps only right now. This side-steps user-defined javascript
expressions in favor of boolean input parameters.
2023-01-17 17:05:11 +01:00
pauldg c9f2fc298b added more assertions for advanced invocation 2023-01-11 09:37:22 +01:00
davelopez e627c32769 Fix linting + mypy 2023-01-11 09:37:17 +01:00
pauldg b19ee2f2d5 added more assertions about collections 2023-01-11 09:35:15 +01:00
pauldg 190a49a7a0 added api test with collections and parameters 2023-01-11 09:35:09 +01:00
Anup Kumar d76cd3cc99 remove non-functional API test for now 2022-12-19 15:32:36 -05:00
Anup Kumar 01e9975e06 add sleep 2022-12-19 15:32:36 -05:00
Dannon Baker c514951984 Update API test for new recommendations model. 2022-12-19 15:32:36 -05:00
John Chilton 59044511f5 Merge branch 'fixup_refactoring_types' into trs-url-import 2022-12-12 10:20:27 -05:00
John Chilton 8ff9fe2610 Implement initial GA4GH DRS Support.
- Implement APIs for serving Galaxy's public datasets as DRS objects.
- Implement support in galaxy.files.uris for DRS URIs so that upload, etc... can use DRS URIs from other data repositories.

The ways this can be improved are endless:

- New object ID patterns can be implemented to allow access to composite data, metadata files from a bundle view of datasets.
- New object ID patterns can be implemented to allow access to collections as bundles of datasets.
- More auth types and AccessMethods could be implemented for loading datasets from clients.
- Some sort of scheme for providing authenticated URLs to non-public data could be implemented to provide access to more of Galaxy's data if user's can implement.

Despite all these limitations - I think having the guts in like this provide useful points for interested parties to go and add functionality to enable their desired usecases.
2022-12-08 10:07:11 -05:00
Finn Bacall 3c98bcffa3 Formatting 2022-12-05 13:02:59 +00:00
Finn Bacall 2e705eaf9f Test source_metadata contents 2022-12-05 13:02:59 +00:00