Commit Graph
3519 Commits
Author SHA1 Message Date
John Chilton c6b593b1ca Migrate API tests in test_jobs.py to use test_history context.
More configurable, better error reporting, cleans up jobs, etc..
2018-08-10 19:43:24 -04:00
John Chilton 36e1d6cfce More use of test_history contextmanager in test_tools. 2018-08-09 11:37:18 -04:00
John Chilton 136255c0ad Allow test_history context to annotate whether new histories are needed by test.
Usually tests should have new histories but we should still capture this information so we can target tests are particular histories for debugging interactively and so we could potentially reduce the number of new histories created when testing remote Galaxies (there have been complaints about this in the past).
2018-08-09 11:37:18 -04:00
John Chilton 4d1ce0f431 Cancel jobs when exiting test_history decorator.
Should reduce the probability of a test interferring with other tests.
2018-08-09 11:37:18 -04:00
John Chilton c2246d8b8a Fix last consistently failing Selenium test. 2018-08-08 09:17:23 -04:00
John Chilton 55436c3800 Merge pull request #5457 from mvdbeek/select_tag_parameter
Allow selecting subset of collection by group tag
2018-08-07 13:09:18 -04:00
Dannon Baker d1423b6e18 Merge branch 'release_18.05' into dev 2018-08-06 20:20:02 -04:00
Dannon Baker d7959568f8 Merge branch 'release_18.01' into release_18.05 2018-08-06 20:19:18 -04:00
Dannon 561e0099bc Merge pull request #6550 from jmchilton/objectstore_setup
Configure object store for datasets in job handler instead of web thread.
2018-08-06 11:00:43 -04:00
mvdbeek ba47188f5e Introduce test for auto-labelling subworkflow workflow outputs 2018-08-06 15:55:27 +02:00
John Chilton 389a1d6563 Merge pull request #6561 from mvdbeek/start_py3_api_tests
Fix all py3 api tests
2018-08-02 09:41:19 -04:00
mvdbeek b7163c0597 Explicitly sort workflow step edges
This seems to be necessary so that the workflow_stability test passes
under python 2 and python3, but does change the result under python 2,
hence the updated workflows (produced by uploading and downloading the
workflow to an instance running with this commit).
2018-08-02 13:21:19 +02:00
mvdbeek 049e4d0fa3 py3: Fix test_fetch_zip_to_folder test 2018-08-02 13:21:19 +02:00
mvdbeek 8ccd5ed137 py3: Fix upload_configuration_options integration test 2018-08-02 13:21:19 +02:00
mvdbeek fd5e8cdd28 py3: fix test_scripts integration test 2018-08-02 13:21:19 +02:00
mvdbeek 63da35889d py3: Fix exception handling in wait_on method 2018-08-02 13:21:19 +02:00
mvdbeek 11f9222122 Fix redirection unit test 2018-08-02 13:21:19 +02:00
mvdbeek f3bc18c85a py3: Use reponse.text instead of reponse.content for decoded text 2018-08-02 13:21:19 +02:00
mvdbeek 187457a461 py3: Don't rely on order of outputs, instead match by output name 2018-08-02 13:21:19 +02:00
mvdbeek 27a30b762d py3: Fix library tests 2018-08-02 13:21:19 +02:00
mvdbeek 8f73635499 py3: Fix upload jobs API tests 2018-08-02 13:21:19 +02:00
mvdbeek bbf739a3df py3: Fix tool_data API 2018-08-02 13:21:19 +02:00
mvdbeek dc9e5c5a83 py3: Fix authenticate api test 2018-08-02 13:21:19 +02:00
mvdbeek 8093d6b610 py3: Fix dataset collection test 2018-08-02 13:21:19 +02:00
mvdbeek cb7ebd7349 py3: Fix history import/export tool
- Open history tarfile in binary mode
 - Fix base64 encoding in history import tool
 - test history export more extensively
2018-08-02 13:21:19 +02:00
John Chilton 9552830121 More Selenium test fixes.
A lot broke while we weren't running the tests against PRs.
2018-08-01 12:13:27 -04:00
John Chilton d8bd5f4690 Many selenium tests fixes for recent dev changes. 2018-07-30 15:10:12 -04:00
John Chilton 1b5dff11a7 Setup objectstore for datasets in job handler instead of web thread.
This is good for a few reasons

* It speeds up the bottleneck that is the job creation code in the web thread (the job handler is much easier to parallelize). Skipping the flush for all those datasets and skipping the disk write per dataset should really speed things up nicely when submitting large numbers of jobs and jobs with a large number of inputs.
* This prevents a disk slow down from grinding the web response to a halt. We don't want the handler to freeze up either - but if something is going to freeze it is a better user experience and easier to recover from the job handler freezing while their are disk problems.
* This allows per-job-handler object store configurations - simply configure different job handlers with different object store configurations. This is cool and important and I can imagine some awesome applications but I will wait for them to materialize.
2018-07-30 12:03:44 -04:00
John Chilton fe5e1f1686 Integration test for the interaction of nested object stores and jobs.
- Test hierarchical store uses its first disk store for new files and not the remaining entries.
- Test basic functionality of writing to the distributed object store.
- Test all job outputs get placed in the same object store.
2018-07-27 09:16:05 -04:00
John Chilton 5f19b8752d Fix empty handling rule. 2018-07-26 09:52:07 -04:00
John Chilton f56c0bbac2 Test case for nested collection input to flatten in a workflow.
Also exercises delayed workflow scheduling because of the dynamic discovery of the input collection.

xref #5867
2018-07-25 23:18:03 -04:00
Dannon 4955add0a3 Merge pull request #6524 from jmchilton/cached_identity
Use cached database identity to avoid many DB requests when creating jobs.
2018-07-25 15:28:47 -04:00
Dannon Baker 43a0482f1c Minor (comment-only) wording tweaks. 2018-07-25 15:27:36 -04:00
Dannon b0b12e4706 Merge pull request #6531 from jmchilton/history_copy_opts
Optimizations for history copying.
2018-07-25 15:19:28 -04:00
John Chilton 9794d835e5 Fix to_dict with io_details=True for tools with collection outputs.
Fixes #6537 and includes a test case.
2018-07-25 12:32:38 -04:00
John Chilton d417e9b239 Flush out collection tag parameters a bit.
- Switch select_tag to group_tag as a parameter name - since it is restricted to group_tags and we don't call data parameters select_data.
- Add minimal XSD documentation for this new parameter type.
- Add example tools - for single and multiple tags.
- Add API tests for these tools and the tag handling.
2018-07-24 14:31:56 -04:00
John Chilton 45b2b7f434 Merge remote-tracking branch 'jmchilton/dev' into select_tag_parameter 2018-07-24 13:18:13 -04:00
John Chilton fe3e284bf9 Fix HDCA annotations.
Backend for these simply did not work.
2018-07-24 13:09:06 -04:00
John Chilton 63c2ffd3ba Implement simple history copy unit tests. 2018-07-24 13:09:06 -04:00
John Chilton dd6b6436c8 Use cached database identity to avoid certain DB requests when creating jobs.
When creating thousands of jobs for large database transactions - previously Galaxy would query the database thousands of times for the same history id, user id, and session id.
2018-07-23 11:30:29 -04:00
John Chilton 4d8b13d0e5 Handle pasted content in fetch API.
Unlike upload 1.0, use different 'src' types to distinguish between URLs and pasted content - in the abstract this is better because it is more structured and practically this allows 'pasting' spreadsheets that start with URLs for instance (that is sometimes useful).
2018-07-23 10:13:25 -04:00
Dannon 20f10fe6db Merge pull request #6389 from qiagu/data_column_1
fix data_column cast error when multiple is false
2018-07-18 19:27:57 -04:00
Dannon e794443f48 Merge pull request #6294 from jmchilton/better_tool_tests
Upload collections directly for tests.
2018-07-18 09:43:08 -04:00
Dannon Baker 5171b9bd49 A couple more typos. 2018-07-18 09:42:39 -04:00
Dannon Baker 9f73bc8985 Repsonse->response 2018-07-18 09:24:50 -04:00
Dannon 4719c4a3f1 Merge pull request #6499 from jmchilton/upload_tags_api
Allow setting tags on targets & contents in data fetch API.
2018-07-17 10:28:37 -04:00
Dannon 9f352f77c0 Merge pull request #6489 from guerler/workflow_import
Use bootstrap vue classes for workflow import form
2018-07-16 15:00:16 -04:00
John Chilton f8210d89ac Fix workflow import Selenium tests for #6489. 2018-07-16 12:55:59 -04:00
John Chilton f9ba8d3823 Allow setting tags on targets & contents in data fetch API.
Rebased with default argument handling improvements suggested by Marius.
2018-07-16 08:46:57 -04:00
John Chilton bc90d0a435 Merge pull request #6498 from mvdbeek/fix_resume_from_history_panel
Fix resume from history panel
2018-07-13 09:29:17 -04:00