Commit Graph
8 Commits
Author SHA1 Message Date
Nicola Soranzo 1b54c0bcd8 Calculate hash for new non-deferred datasets when finishing a job
This is configurable with two new options:
- `calculate_dataset_hash`: in which cases Galaxy should calculate
  a hash for a new dataset. Possible values: 'always', 'upload'
  (the default), 'never'.
- `hash_function`. Possible values: 'md5', 'sha1', 'sha256', 'sha512'

Hashes are calculated via a Celery task, so currently only if
the 'enable_celery_tasks' option is set to true.
2024-11-21 15:55:14 +00:00
Nicola Soranzo f7c5769ca5 Always validate hashes when provided
Currently when uploading datasets with associated hashes, this were
only validated if `validate_hashes=True` was also passed in the
request.

This commit drops `validate_hashes` completely and always validates
hashes when they were provided.
2024-11-05 23:21:51 +00:00
John Chilton 93f2af6a44 Allow dataset and source checksum validation during materialization. 2024-09-30 13:25:02 -04:00
nuwang 0c0ed2a4e3 Fix test failures 2023-02-09 18:14:18 +05:30
Nicola Soranzo 3a8997ccf2 Replace `unittest.TestCase` in API, framework, performance, Selenium and ToolShed tests
In API tests, replace no more working `uses_test_history` decorator (because
the `history_id` method parameter is interpreted as a fixture) with a real
class-level pytest fixture.
As a consequence, replace use of `self.history_id` in API tests because it
interferes with the class-level `history_id` fixture.

Also:
- Some type annotations
2022-11-07 15:44:01 +00:00
Nicola Soranzo c35d8f2a06 Replace `unittest.TestCase` with pytest-based partial re-implementation
Also:
- Rename `FooBarTestCase` test classes as `TestFooBar`. These were collected
  by pytest only because they were `unittest.TestCase` derived, but normally
  pytest collects only test classes whose name starts with `Test`, see
  https://docs.pytest.org/en/7.1.x/reference/reference.html#confval-python_classes
2022-09-27 03:34:58 +01:00
mvdbeek 0bf7ed933e Drop global setup_celery_includes
Should be handled by autouse fixture
2022-05-27 17:33:55 +02:00
John Chilton c5bf63bc91 Add DEFERRED datasets to Galaxy
- Improves options and display around discarded datasets.
- Adds new APIs for importing model stores.
- Adds support to model store layer for importing/exporting workflow invocations and APIs and tests to support this.
- Add new DEFERRED dataset state - with APIs for materializing them or the option to defer them on the worker node if using tool_evaluation_strategy=remote on the job destination.
- UI and API options for uploading deferred datasets individually or into collections.
2022-05-23 19:48:47 -04:00