Commit Graph
693 Commits
Author SHA1 Message Date
John Chilton f035d642ce Merge pull request #6844 from jmchilton/compressed_types_and_extra_files
Infrastructure/API Support for Composite Uploads/Downloads
2018-11-01 10:57:09 -04:00
Dannon Baker 51273658fb Merge remote-tracking branch 'upstream/dev' into unified_webpack4 2018-10-30 11:06:24 -04:00
mvdbeek d80e4bd0a1 Fix test logic 2018-10-30 09:27:25 +01:00
mvdbeek 48bdc97fce Verify state of uploaded datasets and download datasets to verify that the file is intact after upload 2018-10-30 09:27:25 +01:00
John Chilton 09e6b1dcde Eliminate some mutable defaults in populators.py. 2018-10-29 09:41:31 -04:00
John Chilton f0bf1694c5 Tweak testing toward being a bit more robust. 2018-10-26 14:02:16 -04:00
jra001k 9319ddf989 Rename "Test Dataset".
Rename test dataset from "Test Dataset" to "Test_Dataset" to prevent CWL error below:
<--
if not ACCEPTLIST_RE.match(f["basename"]):
    raise WorkflowException("Invalid filename: '%s' contains illegal characters" % (f["basename"]))
--->
This error occur when running the test below:
test/api/test_workflows_cwl.py:CwlWorkflowsTestCase.test_simplest_wf
2018-10-26 14:02:00 -04:00
John Chilton 4919805f81 Merge pull request #6924 from natefoo/quiesce-handler
Be more precise with the job runner worker thread join timeout and improve documentation
2018-10-26 09:48:33 -04:00
Marius van den Beek dda297c408 Merge pull request #6776 from jmchilton/gxformat2_integration
Allow API import/export of format 2 workflows.
2018-10-26 14:10:33 +02:00
Nate Coraor e7156bdd23 Restore monitor_thread_join_timeout to 5 for tests 2018-10-25 14:55:25 -04:00
John Chilton e3bc005a86 Implement API endpoint for indexing extra files in a dataset. 2018-10-24 09:55:25 -04:00
Nicola Soranzo 949dcfdbc3 Do not log exceptions twice
`logging.exception()` already adds the the exception information after
the supplied message.

Also: the `message` attribute of `Exception` class has been dropped in
Python 3, always use `str(e)`.

xref. https://github.com/galaxyproject/galaxy/issues/1715
2018-10-24 12:57:05 +01:00
Dannon Baker 84ae932e8b Add back extra link to base.css for selenium testing (and assumedly other deployments which have custom mappings?). We need to drop all these extra handles eventually, to consolidate the interface to single endpoints with chunked bundles. 2018-10-17 21:04:29 -04:00
mvdbeek 20526ceb50 Share ssh key generation across tests
Closes https://github.com/galaxyproject/galaxy/issues/6860
2018-10-14 18:08:17 +02:00
John Chilton c779e125b7 Allow uploading unparsed YAML when importing format 2 workflows.
Avoid re-arranging dictionaries when JSON is being handled for instance.
2018-10-12 13:41:13 -04:00
John Chilton cdd1520434 Rework most test workflows to label maps for step definitions 2018-10-12 13:41:13 -04:00
John Chilton 14978355ee Support for de-duplicated workflow import. 2018-10-12 13:41:06 -04:00
John Chilton b0334c0c06 Add CWL-style doc keyword to format2 workflows, map to annotations. 2018-10-12 13:41:06 -04:00
John Chilton 00625839b3 Allow downloading Galaxy workflows as format 2 workflows. 2018-10-12 13:41:06 -04:00
John Chilton feddcfaa5a Allow upload format 2 workflows to Galaxy. 2018-10-12 13:41:06 -04:00
John Chilton a8843ece34 Allow CWL-style id map for workflow inputs 2018-10-09 08:18:29 -04:00
John Chilton 8ba76c9704 Switch to CWL-style format 2 workflow output definitions. 2018-10-09 08:18:29 -04:00
John Chilton 1e2080242c Toward newer style gxformat2 definitions. 2018-10-09 08:18:29 -04:00
John Chilton 10dae9461d Fixes for specifying test_data as a parameter to run_workflow. 2018-10-09 08:18:29 -04:00
John Chilton 18b4274e65 Import gxformat2 as an external dependency. 2018-10-06 09:39:20 -04:00
John Chilton 3e774713a9 Fill in needed state defaults when importing manually curated workflows. 2018-09-24 09:38:34 -04:00
John Chilton 50019e503a Refactor method for running format 2 workflows into populators.py for reuse. 2018-09-24 09:38:34 -04:00
Nicola Soranzo 0c931235af Change all remaining old-style classes to new style 2018-09-17 12:26:07 +01:00
John Chilton 8f979b4da1 Workflow replacement parameters polish.
- Selenium test case demonstrating their use in simple workflows.
- API test demonstrating they work with nested workflows from the run perspective.
- Update run variant of workflow to_dict to parse out replacement parameters to display on the backend and tweak the client to just accept these.
- Parse out replacement parameters for subworkflows recursively, include in new run output attribute - nested workflow replacement parameters work now.
- Selenium test case demosntrating subworkflow replacement parameters are rendered and used when submitted.
2018-09-07 11:22:20 -04:00
John Chilton fc75d4f9fb Test case - verify step parameters replace after workflow invoke pauses. 2018-09-06 14:43:22 -04:00
John Chilton 7806a84d1c Implement runtime parameters in nested workflows. 2018-09-06 14:43:22 -04:00
John Chilton 6a266a19a9 More tests for runtime workflow parameters. 2018-09-06 09:02:55 -04:00
Nicola Soranzo ad02c53154 Fix many links 2018-09-03 14:34:13 +01:00
Marius van den Beek 0e69ca8bfb Merge pull request #6545 from jmchilton/rule_builder_use_group_tags
Allow Consuming Tags in the Apply Rules Tool
2018-08-26 11:17:14 +02:00
Marius van den Beek 2560919bd0 Merge pull request #6620 from jmchilton/job_recovery_test
Integration test for job recovery.
2018-08-25 16:51:16 +02:00
mvdbeek f6a55ee2ee Tweak conda_* setting in test driver
Thanks @nsoranzo!
2018-08-23 20:45:24 +02:00
Dannon 43dbfdc7b1 Merge pull request #6632 from mvdbeek/testing_framework_improvements
Testing framework improvements
2018-08-23 14:24:43 -04:00
mvdbeek 23cfb46001 Allow setting CONDA_PREFIX using GALAXY_TEST_CONDA_PREFIX in testing 2018-08-23 14:57:31 +02:00
Helena Rasche 53b8f08752 Merge pull request #6568 from jmchilton/dataset-permissions-api-2
Unified dataset permission API.
2018-08-22 15:04:28 +00:00
John Chilton 626195335e Integration test for job recovery (before and after handler has picked it up). 2018-08-21 15:17:12 -04:00
Nicola Soranzo df8abbe3ef Prefer unicodify() for binary-to-text conversion
which supports non-utf-8 encodings.
2018-08-21 12:35:05 +01:00
mvdbeek 7559b90a69 Setup a simple pytest tool test 2018-08-16 14:08:45 +02:00
mvdbeek c430d4a650 Fix selenium test setup 2018-08-16 11:16:57 +02:00
mvdbeek dd7e4c601a Deal with docker localhost quirks 2018-08-14 14:56:07 +02:00
mvdbeek 293ce5a472 py3: Fix mules test cases
We're now just copying the current python path. Also the handler names
have actually changed, I think this hasn't been updated after a late
change (it is now as it should be, based on the documentation).
2018-08-14 14:56:07 +02:00
John Chilton 49693814a9 Unified dataset permission API.
There was an existing library dataset permission API and one proposed for HDAs in #6461. This tries to reconcile the two approaches and move toward managers.

- Proper treatment of "master_api_key" throughout the manager layers related to this.
- Use PUT instead of POST, since that is more appropriate for updates I believe.
- Use a similar URL pattern for library datasets, history contents, and dataset APIs.
- Generalize the dataset API to allow HDA or LDDA inputs (the proposal for the new API in #6461 added an HDA-only option to the dataset API - this isn't how that API layer is meant to be used I believe).
- Add an HDA only endpoint in the history contents API for this functionality to mirror the library dataset API.
- Use consistent and backward compatible payload parsing for these endpoints.
- Use consistent serialization for the result of these changes.
- Generalize the HDA variant of this to allow different actions - such as make public and make private that were available in the library dataset variant.
- Test cases for the new API endpoints, the roles API, tests for permissions during collection creation and running tools with both dataset and collection inputs.
2018-08-10 19:42:31 -04:00
mvdbeek 3d9c0b154a Make random_lines1 consistent on py2 and py3 (again)
Turns out integers are used as is in `random.seed()`, but strings are
hashed (in the version 1 protocol), and the hashing isn't stable. So
instead we hack around this by using `ord()` on each character and
concatenating the digits.  Yucky, but probably better than using numpy
and putting this tool on the list of tools that inherit galaxy's
environment (or adding a requirement tag and resolving with conda ...).
2018-08-10 22:21:21 +02:00
mvdbeek 61fa9711dc More resource_string fixes 2018-08-10 22:08:15 +02:00
mvdbeek a6b78e7a61 Decode bytestring returned by source_string 2018-08-10 22:08:15 +02:00
John Chilton 36e1d6cfce More use of test_history contextmanager in test_tools. 2018-08-09 11:37:18 -04:00