Commit Graph
159 Commits
Author SHA1 Message Date
John Chilton 59cff45fb1 Decompose tool shed + schema package.
This commit creates two new packages - below a description of these packages and why they are being created.

galaxy-schema: This package contains the pydantic models that power the API. The purpose of packaging them is to ensure they can be reused by clients with minimal external dependencies. Reusing the schema in client code would very quickly provide rapid documentation and validation and static checking for Python clients using the Galaxy API.

galaxy-tool-shed: This package contains the tool shed server code. This has been a long term project to allow the tool shed to be spun out but maintain real galaxy dependencies and maintain testing. More discussions around this project can be found as part of https://github.com/galaxyproject/galaxy/pull/8830.
2023-09-26 13:46:55 -04:00
mvdbeek 521405136a Merge branch 'release_23.1' into dev 2023-07-29 12:28:41 +02:00
mvdbeek c314336705 Merge branch 'release_23.0' into release_23.1
# Conflicts:
#	lib/galaxy/version.py
#	packages/app/HISTORY.rst
#	packages/app/setup.cfg
#	packages/auth/HISTORY.rst
#	packages/auth/setup.cfg
#	packages/config/HISTORY.rst
#	packages/config/setup.cfg
#	packages/data/HISTORY.rst
#	packages/data/setup.cfg
#	packages/files/HISTORY.rst
#	packages/files/setup.cfg
#	packages/job_execution/HISTORY.rst
#	packages/job_execution/setup.cfg
#	packages/job_metrics/HISTORY.rst
#	packages/job_metrics/setup.cfg
#	packages/navigation/HISTORY.rst
#	packages/navigation/setup.cfg
#	packages/objectstore/HISTORY.rst
#	packages/objectstore/setup.cfg
#	packages/selenium/HISTORY.rst
#	packages/selenium/setup.cfg
#	packages/test_api/HISTORY.rst
#	packages/test_api/setup.cfg
#	packages/test_base/HISTORY.rst
#	packages/test_base/setup.cfg
#	packages/test_driver/HISTORY.rst
#	packages/test_driver/setup.cfg
#	packages/tool_util/HISTORY.rst
#	packages/tool_util/setup.cfg
#	packages/tours/HISTORY.rst
#	packages/tours/setup.cfg
#	packages/util/HISTORY.rst
#	packages/util/setup.cfg
#	packages/web_apps/HISTORY.rst
#	packages/web_apps/setup.cfg
#	packages/web_framework/HISTORY.rst
#	packages/web_framework/setup.cfg
#	packages/web_stack/HISTORY.rst
#	packages/web_stack/setup.cfg
2023-07-29 12:28:39 +02:00
mvdbeek 2fbbfd8417 Start work on 23.0.6.dev0 2023-07-29 12:28:35 +02:00
mvdbeek af730bc6b5 Create version 23.0.5 2023-07-29 12:28:32 +02:00
Nicola Soranzo 45e020e760 Merge branch 'release_23.1' into dev 2023-07-24 17:04:54 +01:00
Nicola Soranzo 0a73e1c512 Merge branch 'release_23.0' into release_23.1 2023-07-24 15:16:11 +01:00
Nicola Soranzo 741ecf6f44 Pin pysam to >=0.21.0
This reverts commit 353c08cbb9 .

pysam 0.20.0 doesn't build for Python 3.11 on macOS, so we need to
temporarily add the unnecessary Cython runtime dependency that
pysam 0.21 brings in.
2023-07-21 00:58:33 +01:00
Nate Coraor 8fee25f084 Merge branch 'release_23.1' into dev 2023-06-30 17:14:03 -04:00
Nate Coraor ea07ddba98 Merge branch 'release_23.0' into release_23.1
# Conflicts:
#	lib/galaxy/version.py
#	packages/app/HISTORY.rst
#	packages/app/setup.cfg
#	packages/auth/HISTORY.rst
#	packages/auth/setup.cfg
#	packages/config/HISTORY.rst
#	packages/config/setup.cfg
#	packages/data/HISTORY.rst
#	packages/data/setup.cfg
#	packages/files/HISTORY.rst
#	packages/files/setup.cfg
#	packages/job_execution/HISTORY.rst
#	packages/job_execution/setup.cfg
#	packages/job_metrics/HISTORY.rst
#	packages/job_metrics/setup.cfg
#	packages/navigation/HISTORY.rst
#	packages/navigation/setup.cfg
#	packages/objectstore/HISTORY.rst
#	packages/objectstore/setup.cfg
#	packages/selenium/HISTORY.rst
#	packages/selenium/setup.cfg
#	packages/test_api/HISTORY.rst
#	packages/test_api/setup.cfg
#	packages/test_base/HISTORY.rst
#	packages/test_base/setup.cfg
#	packages/test_driver/HISTORY.rst
#	packages/test_driver/setup.cfg
#	packages/tool_util/HISTORY.rst
#	packages/tool_util/setup.cfg
#	packages/tours/HISTORY.rst
#	packages/tours/setup.cfg
#	packages/util/HISTORY.rst
#	packages/util/setup.cfg
#	packages/web_apps/HISTORY.rst
#	packages/web_apps/setup.cfg
#	packages/web_framework/HISTORY.rst
#	packages/web_framework/setup.cfg
#	packages/web_stack/HISTORY.rst
#	packages/web_stack/setup.cfg
2023-06-30 17:14:03 -04:00
Nate Coraor 25b52a97f7 Start work on 23.0.5.dev0 2023-06-30 17:14:00 -04:00
Nate Coraor 03d9eb63b8 Create version 23.0.4 2023-06-30 17:13:57 -04:00
Nate Coraor c18ed28896 Merge remote-tracking branch 'upstream/release_23.1' into dev 2023-06-30 15:57:32 -04:00
Nate Coraor 2ca678482f Merge remote-tracking branch 'upstream/release_23.0' into release_23.1 2023-06-30 15:56:50 -04:00
Nate Coraor ab1e0485d7 Pin pydantic in packages to <2 2023-06-30 14:51:18 -04:00
mvdbeek bb65b07584 Merge branch 'release_23.1' into dev 2023-06-26 09:32:44 +02:00
mvdbeek 0b1a41bd86 Merge branch 'release_23.0' into release_23.1
# Conflicts:
#	lib/galaxy/version.py
#	packages/app/HISTORY.rst
#	packages/app/setup.cfg
#	packages/auth/HISTORY.rst
#	packages/auth/setup.cfg
#	packages/config/HISTORY.rst
#	packages/config/setup.cfg
#	packages/data/HISTORY.rst
#	packages/data/setup.cfg
#	packages/files/HISTORY.rst
#	packages/files/setup.cfg
#	packages/job_execution/HISTORY.rst
#	packages/job_execution/setup.cfg
#	packages/job_metrics/HISTORY.rst
#	packages/job_metrics/setup.cfg
#	packages/navigation/HISTORY.rst
#	packages/navigation/setup.cfg
#	packages/objectstore/HISTORY.rst
#	packages/objectstore/setup.cfg
#	packages/selenium/HISTORY.rst
#	packages/selenium/setup.cfg
#	packages/test_api/HISTORY.rst
#	packages/test_api/setup.cfg
#	packages/test_base/HISTORY.rst
#	packages/test_base/setup.cfg
#	packages/test_driver/HISTORY.rst
#	packages/test_driver/setup.cfg
#	packages/tool_util/HISTORY.rst
#	packages/tool_util/setup.cfg
#	packages/tours/HISTORY.rst
#	packages/tours/setup.cfg
#	packages/util/HISTORY.rst
#	packages/util/setup.cfg
#	packages/web_apps/HISTORY.rst
#	packages/web_apps/setup.cfg
#	packages/web_framework/HISTORY.rst
#	packages/web_framework/setup.cfg
#	packages/web_stack/HISTORY.rst
#	packages/web_stack/setup.cfg
2023-06-26 09:32:42 +02:00
mvdbeek 1ef440e92c Start work on 23.0.4.dev0 2023-06-26 09:32:37 +02:00
mvdbeek b4adbb4ec5 Create version 23.0.3 2023-06-26 09:32:32 +02:00
Marius van den Beek acc7136045 Merge pull request #15300 from SergeyYakubov/oidc_tokens
OIDC tokens
2023-06-21 19:39:19 +02:00
mvdbeek 5413333aac Merge branch 'release_23.0' into dev
# Conflicts:
#	lib/galaxy/version.py
2023-06-13 17:58:26 +02:00
mvdbeek 414abff510 Start work on 23.0.3.dev0 2023-06-13 17:58:19 +02:00
mvdbeek a7f0a365be Create version 23.0.2 2023-06-13 17:58:13 +02:00
Matthias Bernt a5f75e7ead Merge branch 'release_23.0' into dev 2023-06-08 15:54:42 +02:00
Matthias Bernt aa9cc5b9e8 Start work on 23.1.dev0 2023-06-08 15:54:32 +02:00
Matthias Bernt f722e122f7 Create version 23.0.1 2023-06-08 15:54:28 +02:00
Yakubov, Sergey c468a56655 Merge branch 'dev' into oidc_tokens 2023-05-11 13:49:05 -04:00
Greg Watson a83017a506 Add dependency to data package. 2023-05-04 20:48:15 -04:00
Yakubov, Sergey 15051d41d0 add msal package dependency (for auth via azure ad) 2023-02-02 10:03:38 -05:00
Nicola Soranzo 4ca163b9ca Add support for Python 3.11
- Update Python dependencies that didn't have a cp311 wheel: h5py and
  psycopg2-binary.
- For packages for which there is no recent version that works on all
  Python versions supported by Galaxy (numpy and scipy), replace old
  requirement with multiple Python-version-specific requirements.
2023-02-02 01:18:25 +00:00
Nicola Soranzo a850a47419 Update pysam depedency to 0.20.0
Fix `pysam.index()` calls which now use samtools 1.16 where
`samtools index input output` doesn't work any more if `output` is the path
of an already existing file, but `samtools index -o output input` works
fine.

Also:
- Pre-create the (empty) index file for mock test datasets as a unit test
  reproducer of the above issue.
- Fix `test_cram` unit test that wasn't checking the return value of
  `CRAM.set_index_file()`, which was in fact returning False because
  `test-data/2.cram` was not sorted (updated now).
2023-01-01 03:37:53 +00:00
Nicola Soranzo ee7d51f2f5 Merge branch 'release_22.05' into dev 2022-12-09 11:36:00 +00:00
Nicola Soranzo 1eceea2a45 Add/remove/pin/unpin Python requirements 2022-12-09 02:01:26 +00:00
mvdbeek 9c92c55a31 Reset all package HISTORY.rst file to 22.5.0.dev0 2022-12-08 13:24:06 +01:00
Nicola Soranzo f5deb24dbb Use dnspython to check specifically for an "MX" DNS record
when validating the domain name of the email address for a new user.

Fix https://github.com/galaxyproject/galaxy/issues/14829 .
2022-11-03 12:08:35 +01:00
Nicola Soranzo 5c43d2961f Use dnspython to check specifically for an "MX" DNS record
when validating the domain name of the email address for a new user.

Fix https://github.com/galaxyproject/galaxy/issues/14829 .
2022-10-27 11:17:14 +01:00
davelopezandNicola Soranzo 5dc7dae7c1 Use pydantic[email] instead of email-validator
Co-authored-by: Nicola Soranzo <nicola.soranzo@earlham.ac.uk>
2022-10-14 12:20:24 +02:00
John Chilton 61b9e57c7f Implement Workflow Invocation -> BCO export. 2022-10-14 12:20:24 +02:00
John Chilton 3dbe2891e7 Implement RO Crate export of Galaxy histories and invocations. 2022-09-13 19:20:48 -04:00
Nicola Soranzo dda6feb391 Remove redundant license info from package READMEs
The license is already specified in `setup.cfg` , which is the
canonical place.
This will simplify the transition to the MIT license.
2022-09-09 17:20:24 +01:00
Michael R. Crusoe 59ac92c1c8 mark galaxy packages as containing typing information 2022-07-26 23:27:36 +01:00
Nicola Soranzo 073a8d7956 Modernise build of galaxy-data package
Also:
- Update MANIFEST.in
2022-06-09 23:48:33 +01:00
Nicola Soranzo 73bf57e9a0 Remove unused and unnecessary code
- `PROJECT_OWNER`, `PROJECT_USERAME`, `RAW_CONTENT_URL` and `_version_re` are unused.
- `:changelog:` hyperlink target is unnecessary.
- `test_suite` and `tests_require` are deprecated since setuptools v41.5.0
2022-06-09 22:55:07 +01:00
Nicola Soranzo e9b2262dd3 Move mypy configuration to `mypy.ini`
So packages can use `setup.cfg` to replace `setup.py` .
2022-06-08 10:35:18 +01:00
Nicola Soranzo aeef3318a2 Use setuptools custom package discovery instead of explicit listing 2022-06-06 23:48:37 +01:00
Nicola Soranzo f2a42ba67e Run mypy on all packages' files
Also:
- mypy fixes.
- Use `with` statement to open/close files.
2022-05-30 22:38:55 +01:00
John Chilton c5bf63bc91 Add DEFERRED datasets to Galaxy
- Improves options and display around discarded datasets.
- Adds new APIs for importing model stores.
- Adds support to model store layer for importing/exporting workflow invocations and APIs and tests to support this.
- Add new DEFERRED dataset state - with APIs for materializing them or the option to defer them on the worker node if using tool_evaluation_strategy=remote on the job destination.
- UI and API options for uploading deferred datasets individually or into collections.
2022-05-23 19:48:47 -04:00
mvdbeek 37b47e0304 Better binary detection with FilePrefix & libmagic
FilePrefix reads the first Megabytes of a file, which is much more
than the previously used `check_binary` which read only 1KB.

Since we're re-using FilePrefix instance this shouldn't have any impact
on performace. In addition we're now using `python-magic` to detect
the encoding and mime-type. We're using the mime-type detection
for PDF only at this point, but we're also using the detected encoding
if we encounter non-utf8 content.
2022-04-05 15:06:04 +02:00
Nicola Soranzo 7cf3ce97ec Unpin alembic in galaxy-data package 2022-03-31 18:50:07 +01:00
Nicola Soranzo d11bbf219d Update mypy to 0.942 . Fix new mypy errors.
Remove unused `optional()` decorator function that had an annotation issue.
2022-03-31 18:47:52 +01:00