Commit Graph
6588 Commits
Author SHA1 Message Date
Assunta DeSanto ff8a036fc4 Merge branch 'dev' of https://github.com/galaxyproject/galaxy into menu-cleanup 2022-03-21 09:12:41 -04:00
John Chilton 4e01cfe3eb Merge pull request #13562 from ic4f/dev_sa20_3
Misc. SQLAlchemy 2.0 upgrades
2022-03-20 18:37:17 -04:00
Nicola Soranzo 6189032838 Fix test_callback_nonce_validation_with_bad_nonce unit test
Broken in PR #13572.
2022-03-19 02:20:05 +00:00
Nicola Soranzo 00f7522e7e Merge branch 'release_22.01' into dev 2022-03-19 01:57:33 +00:00
Nicola Soranzo 5114b67902 Merge branch 'release_21.09' into release_22.01 2022-03-18 18:28:15 +00:00
Nicola Soranzo 13d0f92fc0 Merge pull request #13071 from mvdbeek/drop_wsgi_mode 2022-03-18 13:41:33 +00:00
mvdbeek 7aae40d1af Include unit test for sessionless export/import with tags
Seems like the only way you could previously include tags
was if you included them in the data fetch tool.
2022-03-18 12:16:17 +01:00
Sergey Golitsynskiy ad0c79e0a9 Row.keys() removed in 2.0: use _fields instead; adjust test
Ref: https://docs.sqlalchemy.org/en/14/core/connections.html?highlight=row#sqlalchemy.engine.Row.keys
2022-03-16 15:12:27 -04:00
Sergey Golitsynskiy c2bee38662 Use text() to wrap sql string
Fixes RemovedIn20Warning
Ref: https://docs.sqlalchemy.org/en/14/changelog/migration_20.html#execute-method-more-strict-execution-options-are-more-prominent
2022-03-16 14:40:24 -04:00
John Chilton 427847bcc4 Fix up some import "issues". 2022-03-16 14:22:50 -04:00
John Chilton 4dae7c6f21 Disable implicit re-imports across the projects.
Exclude galaxy.util for now, but the exclusion is tracked in setup.cfg. Elimiantes a bunch of flake exception markers.
2022-03-15 19:58:42 -04:00
mvdbeek 7ea87efbf8 Clean up unit tests 2022-03-15 21:59:21 +01:00
mvdbeek 87170651af Drop uwsgi section from unit test test config files 2022-03-15 21:32:00 +01:00
mvdbeek 9277af6657 Raise exception when waiting for entry point
There's a retry loop, I suppose it was meant to be used that way.
2022-03-15 21:32:00 +01:00
mvdbeek fd51314a88 Drop more uWSGI legacy things 2022-03-15 21:32:00 +01:00
mvdbeek b39e8ad9a2 First pass in dropping uwsgi specific things 2022-03-15 21:31:59 +01:00
mvdbeek a8d9801785 Merge branch 'release_22.01' into dev 2022-03-15 15:21:15 +01:00
mvdbeek faea1c8211 Merge branch 'release_22.01' into dev 2022-03-14 17:06:49 +01:00
Dannon 4e742cdfcf Merge pull request #13536 from mvdbeek/content_id_issue
[22.01] Return actual tool id instead of specified tool id in workflow step
2022-03-14 10:49:54 -04:00
mvdbeek 4bb6802d31 Return actual tool id instead of specified tool id in step
We do also return the version changes in the module, so this should be
fine. Fixes https://github.com/galaxyproject/galaxy/issues/13524.
2022-03-14 13:37:50 +01:00
Nicola Soranzo a6b1238be7 Fix CondaSearch to use conda from PATH and CondaContext.exec_search()
The `conda` package on PyPI is severely outdated and unmaintained, and
the output of `run_command("search", ...)` did not parse correctly.

Fix broken `test_conda_search` unit test.
2022-03-13 20:34:40 +00:00
Nicola Soranzo dbf7ac364a Check GitHub API rate limit in GitHubSearch. Deprecate get_json() search
Follow-up on https://github.com/galaxyproject/galaxy/pull/13509 .
2022-03-13 20:34:31 +00:00
Sergey Golitsynskiy 44d245f820 Improve error message when SA Migrate version is incorrect
See inline comment ("version too old" is misleading if the incorrect
version is more recent than what the system expects).
2022-03-11 00:53:49 -05:00
mvdbeek 3fa572d612 First pass at supporting --preload and worker_id
We do need to include some kind of worker id in the server_name. If we
don't do this and we start with multiple workers the internal
QueueWorker won't work and multiple processes can pick up the same job
if the web process is also a job handler.
2022-03-10 17:15:37 +01:00
Sergey Golitsynskiy 70a7942cbb Fix path for package tests 2022-03-09 18:41:50 -05:00
Sergey Golitsynskiy 02437fb11c Fix some of the package tests 2022-03-09 18:41:50 -05:00
Sergey Golitsynskiy 1a1ae8d3d2 Adapt manage_db.py for usegalaxy playbook; add tests 2022-03-09 18:41:50 -05:00
Sergey Golitsynskiy 92b2e67145 Apply black, isort (squashed)
Squashed:
- pick 8a26c3c7af Fix import order in config
- squash ebe36de5fc Apply black, isort
2022-03-09 18:41:49 -05:00
Sergey Golitsynskiy 6ef54eb3af Stub out config call in test_scripts; fixes package test 2022-03-09 18:41:03 -05:00
Sergey Golitsynskiy f32b220cf8 Modify behavior of legacy wrapper, add tests, refactor
If the database is combined, running `./manage_db.sh upgrade` should upgrade
BOTH models: gxy and tsi. However, if tsi uses a separate database, only
the galaxy model should be updated.

Also, see this for context: https://github.com/galaxyproject/galaxy/pull/13108#discussion_r789108576

See inline comments for more details.

The new tests are examples of new behavior.

All refactoring is directly related to the changes in this commit.
2022-03-09 18:41:03 -05:00
Sergey Golitsynskiy 537cf5d2aa Preserve manage_db.sh, but do not hide alembic
- Preserves usage of legacy script while not hiding the Alembic script.
    (see manage_db.sh and run_alembic.sh)
- Adds documentation (see top of script files)
- Includes misc. relevant refactorings
- Includes unit tests for testing legacy script handling
2022-03-09 18:41:03 -05:00
Sergey Golitsynskiy deb683b745 Add type hints to common module in migration tests 2022-03-09 18:41:03 -05:00
Sergey Golitsynskiy 3c992a608f Add create/migrate scripts for Alembic dbs (squashed)
Also add exec permissions to create/migrate python scripts.
(not sure this is required, adding for consistency with previous
version)

+ A few fixes for TS scripts, tests

Squashed:
- pick b62443245e Add create/migrate scripts for Alembic dbs
- squash 06f0a923ca Fix integration test (test only relevant for TS)
2022-03-09 18:41:02 -05:00
Sergey Golitsynskiy a961939dfb Integrate migrations into config, model (squashed)
- pick 058f09a7ec Integrate migrations design into config and model code
- squash 89ca1a537b Drop config.database_create_tables (not used)

Next squash:
- pick cbf29e138c Integrate migrations into config, model (squashed)
- squash dd51fd578e Address existing mypy error (see note)

Address existing mypy error (see note)

This is a (possible) bug that has existed on dev. To expose it, simply
change this call to init_models_from_config
(https://github.com/galaxyproject/galaxy/blob/release_21.09/lib/galaxy/config/__init__.py#L1302)
to a call directly to mapping.init(). The result will be 6 mypy errors.

The reason is that the mapping.init() function
(https://github.com/galaxyproject/galaxy/blob/release_21.09/lib/galaxy/model/mapping.py#L79)
specifies its return type as GalaxyModelMapping - which results in
several errors of this type:

lib/galaxy/app.py:178: error: Definition of "model" in base class "MinimalApp" is incompatible with definition in base class "ConfiguresGalaxyMixin"

When we call an intermediary function (that does not have a return type
specified), mypy is happy.

This should be addressed in a separate issue/PR. Removing the return
type is the simplest (temporary) solution.

Next squash:
- squash c8429737ab Add type hints to migrations modules
- squash a54be2259f Remove circular dependency between migrations and config

Setup infrastructure for running db scripts (squashed)

Squashed:
- pick 146ff8019a Setup infrastructure for running db scripts
- squash e0a26dcf3a Move is-one-db check into model.database_utils

Squashed:
- pick a82c44ac12 Setup infrastructure for running db scripts (squashed)
- squash 31a1a702fe Fix mypy error

Squashed:
- pick 14a4eb08e2 Setup infrastructure for running db scripts (squashed)
- squash b1c6acb0f1 When overriding, override.

Add type hints to migrations modules

Remove circular dependency between migrations and config
2022-03-09 18:41:02 -05:00
Sergey Golitsynskiy bd5bb8522d Don't use triple-quoted strings as comments in tests
Ref #13007
2022-03-09 18:40:07 -05:00
Sergey Golitsynskiy 58ab6583f1 Add informative log/error messages; add tests for new methods 2022-03-09 18:40:07 -05:00
Sergey Golitsynskiy 38f9b4234c Use correct db options for both engines; resolve todos 2022-03-09 18:40:07 -05:00
Sergey Golitsynskiy e7de07007e Handle error when revision not found; add test case 2022-03-09 18:40:07 -05:00
Sergey Golitsynskiy 2cbc7f5de4 Add testing infrastructure 2022-03-09 18:40:07 -05:00
David López a0ad3160b2 Merge pull request #13504 from jmchilton/export_test_sele
Integration end-to-end test for PDF export.
2022-03-09 18:12:07 +01:00
Marius van den Beek cf0ff2eb89 Merge pull request #13498 from ic4f/dev_sa20_2
More backref_cascade fixes (SQLAlchemy 2.0)
2022-03-09 16:40:47 +01:00
Marius van den Beek ff72765507 Merge pull request #13376 from simonbray/add-trs-col
Add source_metadata attribute for workflows imported using TRS ID or via URL
2022-03-09 15:53:39 +01:00
Marius van den Beek 0e565d718d Merge pull request #13413 from jmchilton/legacy_edam
Allow legacy EDAM mappings.
2022-03-09 15:50:33 +01:00
John ChiltonandDavid López 72b42f1c2a Update test/integration_selenium/test_pages_pdf_export.py
Co-authored-by: David López <46503462+davelopez@users.noreply.github.com>
2022-03-09 09:43:08 -05:00
davelopez a28c1c2992 Increase retries 2022-03-09 12:29:36 +01:00
davelopez 41851cdb61 Add retries to test_github_search 2022-03-09 12:10:14 +01:00
Björn Grüning ef132152be Merge pull request #13475 from jmchilton/small_enhancements
Small enhancements from the deferred data branch.
2022-03-08 22:29:30 +01:00
Sergey Golitsynskiy f450876804 Fix linting 2022-03-08 16:28:07 -05:00
Sergey Golitsynskiy 7747dcc587 Fix backref_cascade (unit/app/tools/test_execution) 2022-03-08 16:27:48 -05:00
Sergey Golitsynskiy c80b7db9bd Fix backref_cascade for Workflow (added from WorkflowSteps) 2022-03-08 16:27:25 -05:00