John Chilton
59cff45fb1
Decompose tool shed + schema package.
...
This commit creates two new packages - below a description of these packages and why they are being created.
galaxy-schema: This package contains the pydantic models that power the API. The purpose of packaging them is to ensure they can be reused by clients with minimal external dependencies. Reusing the schema in client code would very quickly provide rapid documentation and validation and static checking for Python clients using the Galaxy API.
galaxy-tool-shed: This package contains the tool shed server code. This has been a long term project to allow the tool shed to be spun out but maintain real galaxy dependencies and maintain testing. More discussions around this project can be found as part of https://github.com/galaxyproject/galaxy/pull/8830 .
2023-09-26 13:46:55 -04:00
mvdbeek
521405136a
Merge branch 'release_23.1' into dev
2023-07-29 12:28:41 +02:00
mvdbeek
c314336705
Merge branch 'release_23.0' into release_23.1
...
# Conflicts:
# lib/galaxy/version.py
# packages/app/HISTORY.rst
# packages/app/setup.cfg
# packages/auth/HISTORY.rst
# packages/auth/setup.cfg
# packages/config/HISTORY.rst
# packages/config/setup.cfg
# packages/data/HISTORY.rst
# packages/data/setup.cfg
# packages/files/HISTORY.rst
# packages/files/setup.cfg
# packages/job_execution/HISTORY.rst
# packages/job_execution/setup.cfg
# packages/job_metrics/HISTORY.rst
# packages/job_metrics/setup.cfg
# packages/navigation/HISTORY.rst
# packages/navigation/setup.cfg
# packages/objectstore/HISTORY.rst
# packages/objectstore/setup.cfg
# packages/selenium/HISTORY.rst
# packages/selenium/setup.cfg
# packages/test_api/HISTORY.rst
# packages/test_api/setup.cfg
# packages/test_base/HISTORY.rst
# packages/test_base/setup.cfg
# packages/test_driver/HISTORY.rst
# packages/test_driver/setup.cfg
# packages/tool_util/HISTORY.rst
# packages/tool_util/setup.cfg
# packages/tours/HISTORY.rst
# packages/tours/setup.cfg
# packages/util/HISTORY.rst
# packages/util/setup.cfg
# packages/web_apps/HISTORY.rst
# packages/web_apps/setup.cfg
# packages/web_framework/HISTORY.rst
# packages/web_framework/setup.cfg
# packages/web_stack/HISTORY.rst
# packages/web_stack/setup.cfg
2023-07-29 12:28:39 +02:00
mvdbeek
2fbbfd8417
Start work on 23.0.6.dev0
2023-07-29 12:28:35 +02:00
mvdbeek
af730bc6b5
Create version 23.0.5
2023-07-29 12:28:32 +02:00
Nicola Soranzo
45e020e760
Merge branch 'release_23.1' into dev
2023-07-24 17:04:54 +01:00
Nicola Soranzo
0a73e1c512
Merge branch 'release_23.0' into release_23.1
2023-07-24 15:16:11 +01:00
Nicola Soranzo
741ecf6f44
Pin pysam to >=0.21.0
...
This reverts commit 353c08cbb9 .
pysam 0.20.0 doesn't build for Python 3.11 on macOS, so we need to
temporarily add the unnecessary Cython runtime dependency that
pysam 0.21 brings in.
2023-07-21 00:58:33 +01:00
Nate Coraor
8fee25f084
Merge branch 'release_23.1' into dev
2023-06-30 17:14:03 -04:00
Nate Coraor
ea07ddba98
Merge branch 'release_23.0' into release_23.1
...
# Conflicts:
# lib/galaxy/version.py
# packages/app/HISTORY.rst
# packages/app/setup.cfg
# packages/auth/HISTORY.rst
# packages/auth/setup.cfg
# packages/config/HISTORY.rst
# packages/config/setup.cfg
# packages/data/HISTORY.rst
# packages/data/setup.cfg
# packages/files/HISTORY.rst
# packages/files/setup.cfg
# packages/job_execution/HISTORY.rst
# packages/job_execution/setup.cfg
# packages/job_metrics/HISTORY.rst
# packages/job_metrics/setup.cfg
# packages/navigation/HISTORY.rst
# packages/navigation/setup.cfg
# packages/objectstore/HISTORY.rst
# packages/objectstore/setup.cfg
# packages/selenium/HISTORY.rst
# packages/selenium/setup.cfg
# packages/test_api/HISTORY.rst
# packages/test_api/setup.cfg
# packages/test_base/HISTORY.rst
# packages/test_base/setup.cfg
# packages/test_driver/HISTORY.rst
# packages/test_driver/setup.cfg
# packages/tool_util/HISTORY.rst
# packages/tool_util/setup.cfg
# packages/tours/HISTORY.rst
# packages/tours/setup.cfg
# packages/util/HISTORY.rst
# packages/util/setup.cfg
# packages/web_apps/HISTORY.rst
# packages/web_apps/setup.cfg
# packages/web_framework/HISTORY.rst
# packages/web_framework/setup.cfg
# packages/web_stack/HISTORY.rst
# packages/web_stack/setup.cfg
2023-06-30 17:14:03 -04:00
Nate Coraor
25b52a97f7
Start work on 23.0.5.dev0
2023-06-30 17:14:00 -04:00
Nate Coraor
03d9eb63b8
Create version 23.0.4
2023-06-30 17:13:57 -04:00
Nate Coraor
c18ed28896
Merge remote-tracking branch 'upstream/release_23.1' into dev
2023-06-30 15:57:32 -04:00
Nate Coraor
2ca678482f
Merge remote-tracking branch 'upstream/release_23.0' into release_23.1
2023-06-30 15:56:50 -04:00
Nate Coraor
ab1e0485d7
Pin pydantic in packages to <2
2023-06-30 14:51:18 -04:00
mvdbeek
bb65b07584
Merge branch 'release_23.1' into dev
2023-06-26 09:32:44 +02:00
mvdbeek
0b1a41bd86
Merge branch 'release_23.0' into release_23.1
...
# Conflicts:
# lib/galaxy/version.py
# packages/app/HISTORY.rst
# packages/app/setup.cfg
# packages/auth/HISTORY.rst
# packages/auth/setup.cfg
# packages/config/HISTORY.rst
# packages/config/setup.cfg
# packages/data/HISTORY.rst
# packages/data/setup.cfg
# packages/files/HISTORY.rst
# packages/files/setup.cfg
# packages/job_execution/HISTORY.rst
# packages/job_execution/setup.cfg
# packages/job_metrics/HISTORY.rst
# packages/job_metrics/setup.cfg
# packages/navigation/HISTORY.rst
# packages/navigation/setup.cfg
# packages/objectstore/HISTORY.rst
# packages/objectstore/setup.cfg
# packages/selenium/HISTORY.rst
# packages/selenium/setup.cfg
# packages/test_api/HISTORY.rst
# packages/test_api/setup.cfg
# packages/test_base/HISTORY.rst
# packages/test_base/setup.cfg
# packages/test_driver/HISTORY.rst
# packages/test_driver/setup.cfg
# packages/tool_util/HISTORY.rst
# packages/tool_util/setup.cfg
# packages/tours/HISTORY.rst
# packages/tours/setup.cfg
# packages/util/HISTORY.rst
# packages/util/setup.cfg
# packages/web_apps/HISTORY.rst
# packages/web_apps/setup.cfg
# packages/web_framework/HISTORY.rst
# packages/web_framework/setup.cfg
# packages/web_stack/HISTORY.rst
# packages/web_stack/setup.cfg
2023-06-26 09:32:42 +02:00
mvdbeek
1ef440e92c
Start work on 23.0.4.dev0
2023-06-26 09:32:37 +02:00
mvdbeek
b4adbb4ec5
Create version 23.0.3
2023-06-26 09:32:32 +02:00
Marius van den Beek
acc7136045
Merge pull request #15300 from SergeyYakubov/oidc_tokens
...
OIDC tokens
2023-06-21 19:39:19 +02:00
mvdbeek
5413333aac
Merge branch 'release_23.0' into dev
...
# Conflicts:
# lib/galaxy/version.py
2023-06-13 17:58:26 +02:00
mvdbeek
414abff510
Start work on 23.0.3.dev0
2023-06-13 17:58:19 +02:00
mvdbeek
a7f0a365be
Create version 23.0.2
2023-06-13 17:58:13 +02:00
Matthias Bernt
a5f75e7ead
Merge branch 'release_23.0' into dev
2023-06-08 15:54:42 +02:00
Matthias Bernt
aa9cc5b9e8
Start work on 23.1.dev0
2023-06-08 15:54:32 +02:00
Matthias Bernt
f722e122f7
Create version 23.0.1
2023-06-08 15:54:28 +02:00
Yakubov, Sergey
c468a56655
Merge branch 'dev' into oidc_tokens
2023-05-11 13:49:05 -04:00
Greg Watson
a83017a506
Add dependency to data package.
2023-05-04 20:48:15 -04:00
Yakubov, Sergey
15051d41d0
add msal package dependency (for auth via azure ad)
2023-02-02 10:03:38 -05:00
Nicola Soranzo
4ca163b9ca
Add support for Python 3.11
...
- Update Python dependencies that didn't have a cp311 wheel: h5py and
psycopg2-binary.
- For packages for which there is no recent version that works on all
Python versions supported by Galaxy (numpy and scipy), replace old
requirement with multiple Python-version-specific requirements.
2023-02-02 01:18:25 +00:00
Nicola Soranzo
a850a47419
Update pysam depedency to 0.20.0
...
Fix `pysam.index()` calls which now use samtools 1.16 where
`samtools index input output` doesn't work any more if `output` is the path
of an already existing file, but `samtools index -o output input` works
fine.
Also:
- Pre-create the (empty) index file for mock test datasets as a unit test
reproducer of the above issue.
- Fix `test_cram` unit test that wasn't checking the return value of
`CRAM.set_index_file()`, which was in fact returning False because
`test-data/2.cram` was not sorted (updated now).
2023-01-01 03:37:53 +00:00
Nicola Soranzo
ee7d51f2f5
Merge branch 'release_22.05' into dev
2022-12-09 11:36:00 +00:00
Nicola Soranzo
1eceea2a45
Add/remove/pin/unpin Python requirements
2022-12-09 02:01:26 +00:00
mvdbeek
9c92c55a31
Reset all package HISTORY.rst file to 22.5.0.dev0
2022-12-08 13:24:06 +01:00
Nicola Soranzo
f5deb24dbb
Use dnspython to check specifically for an "MX" DNS record
...
when validating the domain name of the email address for a new user.
Fix https://github.com/galaxyproject/galaxy/issues/14829 .
2022-11-03 12:08:35 +01:00
Nicola Soranzo
5c43d2961f
Use dnspython to check specifically for an "MX" DNS record
...
when validating the domain name of the email address for a new user.
Fix https://github.com/galaxyproject/galaxy/issues/14829 .
2022-10-27 11:17:14 +01:00
davelopez and Nicola Soranzo
5dc7dae7c1
Use pydantic[email] instead of email-validator
...
Co-authored-by: Nicola Soranzo <nicola.soranzo@earlham.ac.uk >
2022-10-14 12:20:24 +02:00
John Chilton
61b9e57c7f
Implement Workflow Invocation -> BCO export.
2022-10-14 12:20:24 +02:00
John Chilton
3dbe2891e7
Implement RO Crate export of Galaxy histories and invocations.
2022-09-13 19:20:48 -04:00
Nicola Soranzo
dda6feb391
Remove redundant license info from package READMEs
...
The license is already specified in `setup.cfg` , which is the
canonical place.
This will simplify the transition to the MIT license.
2022-09-09 17:20:24 +01:00
Michael R. Crusoe
59ac92c1c8
mark galaxy packages as containing typing information
2022-07-26 23:27:36 +01:00
Nicola Soranzo
073a8d7956
Modernise build of galaxy-data package
...
Also:
- Update MANIFEST.in
2022-06-09 23:48:33 +01:00
Nicola Soranzo
73bf57e9a0
Remove unused and unnecessary code
...
- `PROJECT_OWNER`, `PROJECT_USERAME`, `RAW_CONTENT_URL` and `_version_re` are unused.
- `:changelog:` hyperlink target is unnecessary.
- `test_suite` and `tests_require` are deprecated since setuptools v41.5.0
2022-06-09 22:55:07 +01:00
Nicola Soranzo
e9b2262dd3
Move mypy configuration to `mypy.ini`
...
So packages can use `setup.cfg` to replace `setup.py` .
2022-06-08 10:35:18 +01:00
Nicola Soranzo
aeef3318a2
Use setuptools custom package discovery instead of explicit listing
2022-06-06 23:48:37 +01:00
Nicola Soranzo
f2a42ba67e
Run mypy on all packages' files
...
Also:
- mypy fixes.
- Use `with` statement to open/close files.
2022-05-30 22:38:55 +01:00
John Chilton
c5bf63bc91
Add DEFERRED datasets to Galaxy
...
- Improves options and display around discarded datasets.
- Adds new APIs for importing model stores.
- Adds support to model store layer for importing/exporting workflow invocations and APIs and tests to support this.
- Add new DEFERRED dataset state - with APIs for materializing them or the option to defer them on the worker node if using tool_evaluation_strategy=remote on the job destination.
- UI and API options for uploading deferred datasets individually or into collections.
2022-05-23 19:48:47 -04:00
mvdbeek
37b47e0304
Better binary detection with FilePrefix & libmagic
...
FilePrefix reads the first Megabytes of a file, which is much more
than the previously used `check_binary` which read only 1KB.
Since we're re-using FilePrefix instance this shouldn't have any impact
on performace. In addition we're now using `python-magic` to detect
the encoding and mime-type. We're using the mime-type detection
for PDF only at this point, but we're also using the detected encoding
if we encounter non-utf8 content.
2022-04-05 15:06:04 +02:00
Nicola Soranzo
7cf3ce97ec
Unpin alembic in galaxy-data package
2022-03-31 18:50:07 +01:00
Nicola Soranzo
d11bbf219d
Update mypy to 0.942 . Fix new mypy errors.
...
Remove unused `optional()` decorator function that had an annotation issue.
2022-03-31 18:47:52 +01:00