Commit Graph
6356 Commits
Author SHA1 Message Date
Sergey Golitsynskiy 7cc3a418ce Fix selenium test (bibtex rendering) 2022-01-03 16:18:20 -05:00
Marius van den Beek a3ac2ab611 Merge pull request #12940 from nuwang/vault_impl
Vault abstraction for Galaxy
2021-12-27 18:59:13 +01:00
Uehara.Keizo 992f18e127 Disable cleanup thread of cloud objectstore in set_metadata.py
Apply the following fixes for s3.py to cloud.py
Be more explcit about starting cache monitor thread 494c15cb9d
Disable cleanup thread in set_metadata.py 6a56f3a5de
Fix S3 object store shutdown 7a63fd1db2
2021-12-23 01:32:16 +00:00
Nuwan Goonasekera 01ca66fa98 Merge branch 'dev' into vault_impl 2021-12-22 23:55:37 +05:30
Marius van den Beek f041b13d36 Merge pull request #13048 from bernt-matthias/topic/fix-optional-column-select
Fix dynamic optional + multiple select parameters: allow to select no option
2021-12-21 10:13:57 +01:00
Marius van den Beek 9c92c1bde9 Merge pull request #12500 from nuwang/papercut_file_sources
File sources for gdrive, gcs, onedata, basespace
2021-12-21 10:08:24 +01:00
Nuwan Goonasekera 0924628d10 Refactor file source tests 2021-12-21 00:56:17 +05:30
Nuwan Goonasekera 5d72ddba11 Make gcsfs test optional 2021-12-21 00:43:39 +05:30
Nuwan GoonasekeraandEnis Afgan d4fe61a424 Update vault docs
Co-authored-by: Enis Afgan <afgane@gmail.com>
2021-12-20 18:40:20 +05:30
Nuwan Goonasekera be9f210901 Change vault api test case to integration test case and add missing conditional requirements 2021-12-20 18:23:00 +05:30
Nuwan GoonasekeraandMarius van den Beek 592603eb41 Add file upload test to vault
Co-authored-by: Marius van den Beek <m.vandenbeek@gmail.com>
2021-12-20 18:00:53 +05:30
Nuwan Goonasekera d1f804921c Add support for anonymous gcs file source access 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera 15b7b88d8b Streamline access tokens needed to run gcsfs and gdrive storage tests 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera cb22970426 Added support for illumina basespace filesource 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera d1185fcd18 Added one data 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera b8bdb6878e Added file source for google cloud storage 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera 71862f540c Use separate env vars for each required param in google drive credentials 2021-12-20 11:08:42 +05:30
Nuwan Goonasekera ae8a832b7b Added unit tests for google drive file source 2021-12-20 11:08:42 +05:30
Uehara.Keizo 42b5971daf test: access_key and secket_key is optional in cloud objectstore(aws) 2021-12-19 09:35:39 +00:00
Matthias Bernt 34cd037df3 restructure tests
- put them all in one test tool
- and add other select parameter types
2021-12-16 09:55:12 +01:00
Matthias Bernt defbfbe8cf test for optional & multiple column select
showing that its currently not possible to select no column

and the same for a select with dynamic options (wo legal_values)
that shows that it works here
2021-12-16 09:55:12 +01:00
Simon Bray 505d94d21d add test for target_str_to_targets 2021-12-15 10:13:00 +01:00
Marius van den Beek a22184e7b2 Merge pull request #13044 from nsoranzo/fix_test_release.sh_on_dev
Misc fixes - round 5
2021-12-13 11:45:57 +01:00
Nicola Soranzo e7386d5230 Fix test_singularity_search unit test
in a way that it doesn't break when a new version of the container
is released.
2021-12-09 20:06:25 +00:00
Nicola Soranzo f7388c48fe Fix running test/release.sh on the dev branch
Fix the following error:

```
# >>>> make_forks()
Cloning into '/tmp/galaxy_release_test_cQZHDb9B/work'...
done.
+ cd /tmp/galaxy_release_test_cQZHDb9B/work
+ git config user.name 'Test User'
+ git config user.email test@example.org
# Checking out ref '9bddbada0d3f7835ecafd12220a76dcfb6e3daca' as 'dev'
+ git checkout --no-track -b dev 9bddbada0d
fatal: A branch named 'dev' already exists.
```

Also:
- Add `log_exec` to a few git commands
2021-12-09 19:46:40 +00:00
John Chilton 918302c23e Fix running pytest test/integration/test_remote_files.py::RemoteFilesIntegrationTestCase directly. 2021-12-08 11:33:13 -05:00
Nicola Soranzo 8c7477cab6 Test Galaxy release script
xref. https://github.com/galaxyproject/galaxy/pull/11641#discussion_r764049621
2021-12-08 10:43:09 +00:00
Nicola Soranzo 55b690ac99 Remove missing tool from functional test tool conf 2021-12-08 08:14:14 +00:00
Nicola Soranzo 9f89cd4d56 Fix errors in loading functional test tools 2021-12-08 08:14:13 +00:00
Nicola Soranzo 6c0036fb57 Fix wrong test tool file path 2021-12-08 08:14:13 +00:00
Nicola Soranzo cf1d036b1c Remove entry already in lib/galaxy/config/sample/tool_conf.xml.sample
Cannot be imported from this directory any way.
2021-12-08 08:14:12 +00:00
Nicola Soranzo 0bdc93a7cc Drop support for Python 3.6, add Python 3.10 2021-12-08 08:14:10 +00:00
John Chilton 44b8a45b34 Merge pull request #12996 from bernt-matthias/topic/is_multi_byte
Remove is_multi_byte
2021-12-06 16:17:45 -05:00
Marius van den Beek c00ed6f7a0 Merge pull request #13011 from nsoranzo/fix_job_env_vars
Don't pass all Galaxy environment variables to jobs
2021-12-06 20:37:53 +01:00
Nicola Soranzo eea0c8b673 Update pulsar-galaxy-lib to 0.14.13 and enable assert for EmbeddedPulsarDefaultJobEnvironmentIntegrationTestCase 2021-12-06 17:45:58 +00:00
Nicola Soranzo db566d4627 Check that jobs don't inherit env variables from Galaxy
in integration tests.

Also:
- Merge `RunsEnvironmentJobs` class into
  `BaseJobEnvironmentIntegrationTestCase`
- Remove redundant checks in `DefaultJobEnvironmentIntegrationTestCase`
2021-12-06 17:43:22 +00:00
Nicola Soranzo af46d773b5 Fix running test_config_defaults() unit tests locally
If the `database/files/` directory exists, 2 unit tests would fail:

```
test/unit/config/test_config_values.py::test_config_defaults[file_path]

test_data = TestData(key='file_path', expected='/srv/galaxy/database/objects', loaded='/srv/galaxy/database/files')

    @pytest.mark.parametrize('test_data', get_config_data(), ids=get_key)
    def test_config_defaults(test_data):
>       assert test_data.expected == test_data.loaded
E       AssertionError: assert '/srv/galaxy/database/objects' == '/srv/galaxy/datatabase/files'
E         - /srv/galaxy/database/files
E         ?                      ^^^
E         + /srv/galaxy/database/objects
E         ?                      ^^^ ++
```

and

```
test_config_defaults[object_store_store_by]

test_data = TestData(key='object_store_store_by', expected='uuid', loaded='id')

    @pytest.mark.parametrize('test_data', get_config_data(), ids=get_key)
    def test_config_defaults(test_data):
>       assert test_data.expected == test_data.loaded
E       AssertionError: assert 'uuid' == 'id'
E         - id
E         + uuid
```

Also:
- Include tested option in assertion message
2021-12-06 17:32:31 +00:00
Nicola Soranzo a0cf05ae71 Don't hide exception 2021-12-02 17:10:43 +00:00
Nuwan Goonasekera 7328ca0da9 Renamed vault migration script and some minor test fixes 2021-12-02 00:36:35 +05:30
Nuwan Goonasekera 85b6f6353b Fix vault table parent reference 2021-12-01 21:44:29 +05:30
Nuwan Goonasekera 7f663fad6e Add new secret type to user preferences that is not sent to client 2021-12-01 10:48:36 +05:30
Nuwan Goonasekera 2bc7bb45cf Added validation and prefixing decorators to vault 2021-12-01 07:00:18 +05:30
Nuwan Goonasekera 8c6c1b6a21 Validate vault keys 2021-12-01 06:25:30 +05:30
John Chilton 4ce8c35023 Merge pull request #12459 from mvdbeek/wip_remote_command_line
Remote / Late evaluation of tools
2021-11-30 15:22:31 -05:00
mvdbeek 26764218e4 Cleanup path handling and add unit test for handling traceback.txt 2021-11-30 16:18:33 +01:00
mvdbeek 1a08eb57b3 Make tool_evaluation_strategy configurable on app and destination level 2021-11-30 12:27:14 +01:00
mvdbeek 2384875073 Disable remote evaluation for JEHA history export jobs
We'd have the add `JobExportHistoryArchive` to the supported job outputs
in the model export store or move the `JobExportHistoryArchive` creation
from `execute()` ToolAction to the handler and skip creating
`JobExportHistoryArchive` altogether, but we want to perform the
job export in the Celery workers anyway, so I think it's not worth the
effort.
Note that exporting to file sources doesn't use
`JobExportHistoryArchive`, so for those we can still create the command
line remotely (and e.g materialize deferred datasets in a history).
2021-11-30 10:58:40 +01:00
mvdbeek c2e7acdbe7 Test tool derserialization 2021-11-29 20:16:03 +01:00
Nicola Soranzo 1701d0ed67 Merge pull request #13002 from nsoranzo/unnecessary_lists 2021-11-29 18:35:38 +00:00
John Chilton 089b0b59b7 Merge pull request #12974 from bernt-matthias/topic/lint-input-redundant-name
lint for inputs with redundant name
2021-11-29 12:59:39 -05:00