Commit Graph
745 Commits
Author SHA1 Message Date
mvdbeek d48cc80653 Excplicitly fail dataset upload with invalid extension
If the extension is not known it shoudn't be set (or set to auto).
2019-10-22 20:55:47 +02:00
Martin Cech 84f31bd9b2 adjust and add more tests 2019-10-11 16:48:48 -04:00
Nicola Soranzo 84b92a69fc [19.09] Build dependency manager only for galaxy app
Fix https://github.com/galaxyproject/galaxy/issues/8656

Broken in https://github.com/galaxyproject/galaxy/pull/8152

Add test for bug introduced in https://github.com/galaxyproject/galaxy/pull/8660
when trying to fix #8656 on the dev branch.
2019-09-24 18:41:34 +01:00
John Chilton 654463810b jobs_summary API for workflow invocations.
API backbone used to generate the progress bar for collections but applied to a workflow invocation. Should be helpful in quickly summarizing all the job states in a workflow invocation.
2019-09-17 15:29:49 -04:00
John Chilton fa637518e8 Implement yet another syntax for Galaxy Markdown.
The community took a vote (https://github.com/galaxyproject/galaxy/pull/8511#issuecomment-525886525) and the overwhelming favorite was this programming style declaration of a vaguely C-ish language embedded in quote fenced blocks.
2019-08-30 09:46:14 -04:00
John Chilton 664ab71653 Rework toward more RMarkdown-y syntax for Galaxy Markdown. 2019-08-30 09:43:15 -04:00
John Chilton ad650897d6 Implement workflow invocation reports.
Implement markdown backend and frontend components as well generator plugin framework to allow customizable workflow invocation reports.

Architectural Choices on the Client

Old-style embedded objects vs components

In theory, this could make really nice use of excellent VueJS components for dataset display, dataset collection display, workflow display, etc.. These aren't available yet, we don't even really have Backbone stuff that exist very well outside history panels, so this re-uses "components" from Galaxy Pages for datasets and reuses the collection display for history panels as a stand-alone display for collections (I got this trick from DIsplayStructured.vue). This isn't ideal and I know that but at least reusing things this way will provide a path forward for migrating both pages and this new Markdown language (which could easily replace or co-exist with pages HTML someday) together seamlessly as the real modern components become available and doesn't increase the overall work needed to integrate newer style components. In fact, this might even be the impetus for creating and polishing more of these components.

markdown-it vs markdown-it-vue

I tried this with markdown-it-vue also but it added very little in terms of reducing client code, obscured entirely how to attach plugins to the markdown rendering process, and brought in many, many more extra packages that we don't need or want.

Given there is no representation of invocations in the GUI and not editor for reports config this is a bit challenging still. But here is goes:

- Source Galaxy's virtualenv.
- Login to a user and grab an API key, set in the following command:
- ``GALAXY_TEST_EXTERNAL=http://localhost:8080 GALAXY_TEST_USER_API_KEY=38175dfc69d9009992b69efcca8b209b pytest test/api/test_workflows.py::WorkflowsApiTestCase::test_workflow_invocation_report_custom``
- In the web browser go to http://localhost:8080/api/invocations and grab the latest invocation ID. Replace it in the follow query string.
- Navigate to http://localhost:8080/workflows/invocations/report?id=c887f1d0da42bdfe
2019-08-30 09:43:01 -04:00
Martin Cech 94e08ebb05 Merge pull request #8309 from cganote/purgegoodies
Implement undelete and purge API for users
2019-08-27 13:05:58 -04:00
Martin Cech bada84445f incorporate @nsoranzo's abstraction suggestions 2019-08-27 10:56:35 -04:00
Martin Cech addfeffb9e avoid calling superclass method for purging
Because multiple inheritance will result in calling this class 'delete' method
which is not the correct target. This also avoid a database operation
I believe, since the PurgableManagerMixin.purge also calls delete before purging.
2019-08-26 15:27:36 -04:00
John Chilton 55b384cc50 Add ability to collect QC from jobs. 2019-08-22 15:45:25 -04:00
John Chilton f5d436f13e Datatype-based validation framework.
There was an attempt to do this over a decade ago that didn't take off:
- xref 925aec1bd0
- xref f4f9e1d7b2
2019-08-22 15:45:25 -04:00
Martin Cech 2fa7eba30c fix tests 2019-08-22 15:04:00 -04:00
Juleen Graham 4e7371f0e8 Addressed lint issues 2019-08-22 15:04:00 -04:00
Juleen Graham b76242c586 add api test 2019-08-22 15:04:00 -04:00
mvdbeek cd9af5b0e7 Add an API test for deleting users 2019-08-22 15:04:00 -04:00
Nate Coraor acbc8d9ca1 Merge remote-tracking branch 'upstream/release_19.05' into dev 2019-08-07 15:45:20 -04:00
mvdbeek ae84a553f6 Add tests for correct tag saving/updating via workflow update API 2019-08-01 12:27:02 +02:00
Nicola Soranzo de798d4829 Merge pull request #8329 from mvdbeek/fix_py3_startup
Cast uwsgi option to unicode, fixes startup under python 3
2019-07-13 15:50:17 +01:00
mvdbeek 7f8c42421f Fix test_400_on_invalid_embedded_content on python 3 2019-07-13 10:47:30 +02:00
Sergey Golitsynskiy 9713184b03 Move tools/verify/ into tool_util/verify/
Ref: https://github.com/galaxyproject/galaxy/issues/8073
2019-07-12 18:06:53 +01:00
Brad Langhorst 50011c1e98 linting fixes 2019-07-09 04:09:11 -04:00
Brad Langhorst 4f99db9d3f starting point for a test…
Failing on sqlite
2019-07-08 06:29:57 -04:00
vahid d3cbb985a3 Refactor a test method to return a create test user with its api key. 2019-06-26 12:36:13 -07:00
Dannon Baker 77307e94ac Update test to drop ftp_upload_dir 2019-06-20 16:05:57 -04:00
mvdbeek 036a398494 Add test that ensures jobs are errored when inputs are purged
To provoke https://github.com/galaxyproject/galaxy/issues/8171
run the tests with GALAXY_CONFIG_OUTPUTS_TO_WORKING_DIRECTORY=True
2019-06-19 13:12:05 +02:00
John Chilton 98a4a8bd00 clean-fix-page-api - modern exception handling for embedded ID encoding 2019-05-29 13:43:49 -04:00
mvdbeek 93419bc3ce Add workflow testcase for ColumSetAction PJA 2019-05-24 10:07:03 +02:00
Nicola Soranzo 75d9e33363 Merge branch 'release_19.05' into dev 2019-05-17 10:10:16 +01:00
mvdbeek 556ee003ae Fix parse_values_from_file tool and tests 2019-05-14 00:14:34 +02:00
mvdbeek 974f45b043 Allow mapping over of expression tool params
This allows feeding a collection of parameters values to a parameter
value. This enables https://github.com/galaxyproject/tools-iuc/pull/2404#issuecomment-491740393
for instance, where we normalize a collection based on a computed
parameter.
2019-05-14 00:14:34 +02:00
Marius van den Beek 2c2e6aec1b Merge pull request #7670 from jmchilton/created_from_basename
Track basename at the time of creation for datasets.
2019-05-07 14:24:47 +02:00
Nicola Soranzo faac99976b Fix deprecated `assertEquals()`
See https://docs.python.org/2/library/unittest.html#deprecated-aliases
2019-04-23 12:48:35 +01:00
mvdbeek 6b3aecdcc4 Restrict search to items in owned histories
This was an oversight in https://github.com/galaxyproject/galaxy/pull/7745.
This is the quick fix, but I think it's feasible to implement the
accessible logic as a query, which means we could push this down to
a Mixin, and treat it as a regular fiter (so admins could for instance
search/sort for the largest datasets, which is already possible in the
reports app).
2019-04-20 16:27:34 +02:00
John Chilton 29dfc3085b Track basename at the time of creation for datasets. 2019-04-20 08:18:39 -04:00
mvdbeek e7b0867602 Make sure orm filters operate on correct model
In practice we use ParsedFiler.filter_type to discriminate
the different filter types. Filters that require the correct
model class for a specific query are now functions that take
a model_class and generate the correct filter.
2019-04-18 18:55:14 +02:00
mvdbeek 885d9d1766 Fix err_msg assertion 2019-04-17 16:30:24 +02:00
mvdbeek 4469b9cbc0 Split up test and test searching by tool id 2019-04-17 12:56:46 +02:00
mvdbeek 48d9eaf78f Add some basic dataset search testing 2019-04-16 19:31:36 +02:00
mvdbeek 95fe0ffcf5 Adjust DatasetsApiTestCase.test_index to status code 200
And modernize test setup by using DatasetPopulator.
2019-04-16 19:31:03 +02:00
Martin Cech 51cbf440bf Merge pull request #7755 from jmchilton/job_error_reporting
Report a couple common errors in dataset/job report.
2019-04-16 13:30:12 -04:00
John Chilton 44856a3f75 Report a couple common errors in dataset/job report.
Report if empty inputs were used or if the same input was used more than once, these were identified as common sources of potential errors across many tools. Neither of these are definite problems, but both could be depending on the tool and both happen frequently. Outline a few more ideas as TODOs in the code.
2019-04-16 10:24:28 -04:00
John Chilton c33b4d4364 Merge pull request #7724 from mvdbeek/dependent_jobs
Unpause dependent jobs when resuming jobs
2019-04-15 14:16:47 -04:00
Nicola Soranzo 1b1f6e9cda Fix comments 2019-04-14 18:02:42 +01:00
mvdbeek 0b8dec5af0 Make sure dependent jobs are being unpaused
Fixes https://github.com/galaxyproject/galaxy/issues/6926
2019-04-11 19:35:20 +02:00
John Chilton 9dfa5d7041 Merge pull request #5495 from jmchilton/batch_operation_optimize
Batch bulk hide and delete operations when multi-selected.
2019-04-11 09:01:32 -04:00
John Chilton d89749bad7 Bulk delete and hide operations. 2019-04-10 20:59:33 -04:00
Nicola Soranzo a12db037ca Merge branch 'release_19.01' into dev 2019-04-11 00:43:45 +01:00
mvdbeek 4c9e4118f5 Restrict workflow invocation index to current user
If the user is not an admin.
Fixes https://github.com/galaxyproject/galaxy/issues/7710

An alternative would be to skip Accessibility / Ownership
exceptions, but given that we can just restrict the query
this seems like the better approach to me.
2019-04-10 11:13:59 +02:00
Marius van den Beek 7ea8734796 Merge pull request #7367 from jmchilton/export_collections
Rework and Generalize History Import and Export
2019-04-08 14:24:45 +02:00