John Chilton
9d2a45f58d
Merge pull request #17540 from bwalkowi/add-onedata-objectstore
...
Add onedata objectstore
2024-05-19 16:41:00 -04:00
Bartosz Walkowicz
2d995bb178
Format new onedata related code
2024-05-06 11:50:00 +02:00
Bartosz Walkowicz
1f6b6a0827
Merge branch 'dev' of https://github.com/galaxyproject/galaxy into add-onedata-objectstore
2024-05-06 06:34:16 +02:00
John Chilton
e03d162429
Update Azure infrastructure.
2024-05-03 13:57:58 -04:00
Łukasz Opioła
cdca217f34
Docs improvements, fix camelCasing of the tls validation option in Onedata file source plugin
2024-03-06 09:33:23 +01:00
Bartosz Walkowicz
bf8db0cb5d
Add //space/@path option to onedata objectstore
2024-03-06 09:33:20 +01:00
Bartosz Walkowicz
86d88559ff
Use onedatafilerestclient instead on onedatarestfs
2024-03-06 09:25:11 +01:00
Bartosz Walkowicz
64b70b5ffe
Remove debug prints
2024-03-06 09:25:11 +01:00
Bartosz Walkowicz
48f13dd546
Add Onedata objectstore implementation integration tests
2024-03-06 09:25:08 +01:00
Yakubov, Sergey
442632f863
refactor tests skips, better wait to rucio to start
2024-02-14 13:24:38 -05:00
Yakubov, Sergey
f23ab02059
rename password variable
2024-02-14 09:03:21 -05:00
Yakubov, Sergey
0beef65cc9
Adding object store plugin for Rucio
...
https://rucio.cern.ch
2024-02-14 09:03:21 -05:00
Yakubov, Sergey
d0eef6ab3e
use cache_updated_data=True for s3 tests
2023-11-16 13:22:09 -05:00
Yakubov, Sergey
898c5c942d
optimize object store pull
...
added sync_cache parameter to the get_filename function that allows
skip pulling to cache when not needed
2023-11-14 11:57:40 -05:00
Marius van den Beek and Nicola Soranzo
7a915b60b6
Switch to trailing underscore
...
Co-authored-by: Nicola Soranzo <nicola.soranzo@gmail.com >
2023-07-31 18:51:40 +02:00
mvdbeek
147ca28af6
Test that object store cache file gets updated
2023-07-31 16:52:43 +02:00
John Chilton
92055a5407
Rename object stores in config.
...
Per @bgruening's request - s3 -> aws_s3 and swift -> generic_s3.
I think we only construct object stores with the one method - so this should be backward compatible.
2023-05-04 16:06:45 -04:00
John Chilton
3ed291f076
object store selection test
2023-03-13 15:32:32 -04:00
Nicola Soranzo
30f60493c3
Format Python code with black 23.1.0
...
with manual fixes to 3 files to make them compatible with black 22.12.0 .
We need to keep black pinned at `<23` until we vendorise `packaging`, since
the new version of black depends on `packaging >=22.0` which is the version
where `LegacyVersion` (which we use for tool lineages) was removed.
2023-02-01 23:51:03 +00:00
Nicola Soranzo
c35d8f2a06
Replace `unittest.TestCase` with pytest-based partial re-implementation
...
Also:
- Rename `FooBarTestCase` test classes as `TestFooBar`. These were collected
by pytest only because they were `unittest.TestCase` derived, but normally
pytest collects only test classes whose name starts with `Test`, see
https://docs.pytest.org/en/7.1.x/reference/reference.html#confval-python_classes
2022-09-27 03:34:58 +01:00
Nicola Soranzo
3091737ab9
Misc test fixes
2022-09-27 03:34:55 +01:00
Dannon
4644922783
Merge pull request #13655 from mvdbeek/metadata_embed
...
Create data_fetch and set_metadata celery tasks
2022-06-07 10:27:06 -04:00
Björn Grüning
235e47a0bd
try fixing the integration tests
2022-06-03 11:04:59 +02:00
mvdbeek
28d58edbcc
Use celery in more integration tests
2022-05-26 12:48:44 +02:00
Dannon Baker
623a5e165a
Apply black formatting.
...
Apply isort.
2022-02-03 07:42:20 -05:00
mvdbeek
8b7614ccd9
Fix mypy tests that broke while merging forward
2021-11-01 18:46:05 +01:00
mvdbeek
8507756ae4
Refactor SiwftObjectStore test so it can be re-used more easily
2021-10-30 16:36:50 +02:00
Nicola Soranzo
9d74bba7fb
Drop support for retired Python 3.5
...
Upgrade syntax using `pyupgrade --py36-plus` .
Manually drop several `six` imports.
Also:
- Remove broken pr_cache in scripts/bootstrap_history.py
- Fix broken prefix removal in lib/galaxy/tool_util/deps/mulled/mulled_build.py
2020-10-07 11:52:13 +01:00
John Chilton
801182c358
Make store_by a true per object store configuration.
2020-01-13 21:22:49 -05:00
John Chilton
64f3690367
Reduce duplication in object store integration tests.
2020-01-13 11:01:18 -05:00
John Chilton