Commit Graph

86650 Commits

Author SHA1 Message Date
Marius van den Beek 4e57a67f2a Merge pull request #21625 from mvdbeek/claude/convert-sample-sheets-iN2wd
[25.1] Add database operation tool to convert sample sheets to list collections
2026-01-20 17:01:48 +01:00
Björn Grüning f753f5b4ba Merge pull request #21624 from davelopez/25.1_more_dataverse_hardening
[25.1] Harden Dataverse integration
2026-01-20 15:28:47 +01:00
mvdbeek e46f9e789c Add database operation tool to convert sample sheets to list collections
This tool converts sample sheet collections back to their corresponding
non-sample-sheet types by stripping the column_definitions and row
column metadata:

- sample_sheet -> list
- sample_sheet:paired -> list:paired
- sample_sheet:paired_or_unpaired -> list:paired_or_unpaired
- sample_sheet:record -> list:record

Useful when a sample sheet needs to be passed to a tool that expects
a regular list collection, or when discarding sample sheet metadata.
2026-01-20 15:07:22 +01:00
davelopez e201d590d2 Hardens Dataverse file ID parsing for nested PIDs
Handles Dataverse file-level persistent identifiers that themselves contain URI schemes and slashes, ensuring correct resolution of files with independent persistent IDs. Enhances parsing logic to support more complex Dataverse path structures and improves robustness when extracting dataset and file identifiers.
2026-01-20 12:55:36 +01:00
davelopez 15319d1006 Fix error handling to expose issues to the user
Replaces generic exceptions with Galaxy exceptions to surface the issues to the user. Those exceptions should be safe to surface since they are proxied from the Dataverse instance.
2026-01-20 12:54:52 +01:00
davelopez 9b8849ed8c Normalize repository URLs by removing trailing slash
Ensures repository URLs are consistently formatted without a trailing slash to prevent potential issues with URL setup in configs.
2026-01-20 12:42:58 +01:00
davelopez ad8dc528ac Allow optional token and public_name in RDM configs
Updates RDM file source configuration fields to be optional, improving flexibility for cases where token or public_name may not be provided during initialization, like in public instances.
2026-01-20 12:42:02 +01:00
Marius van den Beek cb3a9c9018 Merge pull request #21620 from SaimMomin12/add-pangenome-datatypes
[25.1] Add new datatype pg and hg for pangenomics
2026-01-20 11:31:33 +01:00
Saim Momin b4e6a52b69 Add prefix for a better scope 2026-01-20 10:25:42 +01:00
Saim Momin abf18682b9 Add pg and hg datatype 2026-01-20 10:17:01 +01:00
mvdbeek d8d7280a31 Merge branch 'release_25.0' into release_25.1 2026-01-19 18:01:49 +01:00
Marius van den Beek ba286db0c8 Merge pull request #21613 from mvdbeek/claude/fix-flaky-workflow-test-rC2wh
[25.0] Fix race condition in workflow collection populated state check
2026-01-19 17:24:56 +01:00
mvdbeek 7f640f69ab Fix race condition in workflow collection populated state check
The `expire_populated_state()` method was only expiring the SQLAlchemy
`populated_state` attribute but not clearing the cached `_populated_optimized`
value. This caused a race condition during workflow scheduling:

1. `populated_optimized` was called and cached False (nested collection NEW)
2. Job thread marked the nested collection as OK
3. `waiting_for_elements` saw the new state (OK) and returned False
4. `expire_populated_state()` was called but didn't clear the cache
5. Second `populated` check returned the stale cached False
6. Workflow incorrectly failed with collection_failed

The fix ensures the cached value is cleared so the second populated check
gets fresh database state, preventing spurious collection_failed errors
for collections that are actively being populated.

Fixes flaky test: test_workflow_list_list_multi_data_map_over
2026-01-19 11:15:28 +01:00
Nicola Soranzo ec810e47a7 Merge pull request #21598 from nsoranzo/release_25.1_deprecate_py3.9
[25.1] Add belated deprecation of Python 3.9 support
2026-01-17 12:09:31 +00:00
Nicola Soranzo 96aabd0277 Add belated deprecation of Python 3.9 support 2026-01-16 01:10:43 +00:00
Marius van den Beek 8be6cfce90 Merge pull request #21563 from bernt-matthias/citation_bibtex_quotes
[25.1] Use quotes for Galaxy citation bibtex
2026-01-15 09:44:09 +01:00
Marius van den Beek 817651904a Merge pull request #21561 from arash77/add-credentials-docs
[25.1] Add tool credentials system documentation and schema updates
2026-01-15 09:43:43 +01:00
Marius van den Beek 40da2ddc58 Merge pull request #21576 from guerler/fix_preferences_user
[25.1] Fix passing user id to preferences
2026-01-15 09:43:05 +01:00
Marius van den Beek 05f6fe5f8a Merge pull request #21584 from jmchilton/sample-sheet-external-paired-fix-25-1
[25.1] Fix #21542 - allow workbook bootstrap generation for sample sheet collection types.
2026-01-15 09:38:48 +01:00
guerler 775ab8b152 Fix parsing user id to preferences 2026-01-15 10:01:06 +03:00
John Chilton 5d1b898793 Refactor test_sample_sheet_workbook.py organization.
Replace mock classes with real DatasetCollection instances and
reorganize tests into logical classes (TestWorkbookGeneration,
TestWorkbookParsing, TestListToSampleSheetCollectionType).

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-14 12:24:43 -05:00
John Chilton 578479eae9 Fix #21542 - allow workbook bootstrap generation for sample sheet collection types.
Previously this only worked for actual lists.
2026-01-14 12:13:24 -05:00
David López 4df310d4ed Merge pull request #21569 from davelopez/25.1_dataverse_fixes
[25.1] Supports Dataverse file access via both persistent and database IDs
2026-01-14 13:58:50 +01:00
Matthias Bernt 49ddccee28 update docs 2026-01-14 10:04:36 +01:00
Matthias Bernt a74cacbdbf update sample 2026-01-14 10:04:14 +01:00
Matthias Bernt 8bd436b4cd use double quotes for galaxy bibtex citation 2026-01-14 10:01:41 +01:00
davelopez 86c2533fdc Supports Dataverse file access via both persistent and database IDs
Improves Dataverse integration by handling file access for instances where FilePIDsEnabled is false and files use database IDs instead of persistent IDs.
Enhances path parsing, access URL construction, plugin URI generation, and file listing to robustly differentiate between persistent and database identifiers.
Refines error handling for authentication and not-found scenarios to improve reliability and clarity.
2026-01-13 15:06:33 +01:00
Nicola Soranzo a360903a70 Merge pull request #21557 from mvdbeek/fix_pulsar_rewrite_parameters_false
[25.1] Fix pulsar with ``rewrite_parameters: false``
2026-01-13 02:19:43 +00:00
Marius van den Beek 41b8531b72 Merge pull request #21560 from mvdbeek/dataset-expiration-hover
[25.1] Show "Expires today" instead of "Expires soon" in Expiration Warning
2026-01-12 19:42:28 +01:00
Nicola Soranzo ce140f3e73 Use StrPath type 2026-01-12 19:16:43 +01:00
Arash aabca704fa Add documentation for the new tool credentials system in the vault 2026-01-12 17:41:56 +01:00
Arash 348b79bb4a Add credentials tags to schema template for tool requirements 2026-01-12 17:41:17 +01:00
Marius van den Beek 31f92eb079 Merge pull request #21558 from mvdbeek/replacement_fix
[25.1] Fix job cache collection copy
2026-01-12 17:40:39 +01:00
mvdbeek 0024357360 Fix content expiration indicator to show "Expires today" instead of "Expires soon"
- Change "Expires soon!" to "Expires today" when less than 1 day remains
- Add proper singular handling ("Expires in 1 day" instead of "1 days")
- Show full date and time in tooltip using toLocaleString() instead of just
  the date, so users can see the exact expiration time in their local timezone

Fixes https://github.com/galaxyproject/galaxy/issues/21559
2026-01-12 16:35:55 +01:00
mvdbeek 3639edb459 Fix pulsar with `rewrite_parameters: false`
And add type hints that would have caught this.
Fixes https://github.com/galaxyproject/galaxy/issues/21555
2026-01-12 16:28:28 +01:00
mvdbeek 30db9fac56 Fix job cache collection copy 2026-01-12 15:55:08 +01:00
mvdbeek 96d6df1170 Add regression test for Error with job cache #21556 2026-01-12 15:55:08 +01:00
Marius van den Beek 894e4c685e Merge pull request #21531 from bgruening/new_jup
[25.1] Add new jupter version
2026-01-12 12:41:22 +01:00
Marius van den Beek 12943a2ff6 Merge pull request #21544 from mvdbeek/claude/filter-failed-hda-cache-nIi9o
[25.1] Filter out failed_metadata HDAs from job cache
2026-01-10 09:18:32 +02:00
mvdbeek 62e8470606 Refactor to decrease duplication 2026-01-09 11:44:41 +01:00
David López f2e63cdbd5 Merge pull request #21547 from davelopez/25.1_add_expiration_sample
[25.1] Adds object_expires_after_days example usage to sample config
2026-01-08 18:11:20 +01:00
David López 1494389445 Clarify comment about how expired data is deleted
Co-authored-by: Lucille Delisle <lucille.delisle@unige.ch>
2026-01-08 11:01:46 +01:00
davelopez b877e8a74d Adds object_expires_after_days example usage to sample config 2026-01-08 10:40:05 +01:00
mvdbeek 243de11fa1 Filter out failed_metadata HDAs from job cache
HDAs where _state is set (indicating failed_metadata or setting_metadata)
were not being filtered out when looking for cached jobs. This change adds
checks to require _state to be NULL (which indicates metadata is OK) in the
following cache lookup methods:

- _build_stmt_for_hda: filters the requested input HDA
- _build_stmt_for_hdca: filters leaf HDAs in the reference collection
- _build_stmt_for_dce: filters leaf HDAs in both collection and direct
  HDA cases

Also adds integration tests to verify that job cache lookups correctly
exclude HDAs and HDCA elements in failed_metadata state.
2026-01-07 19:19:55 +01:00
John Chilton 664ada17a6 Merge pull request #21520 from mvdbeek/cleanup_integration_instance
[25.1] Improve tempdir cleanup in integration tests
2026-01-06 09:37:03 -05:00
Bjoern Gruening 1805f26df8 add new jupter version 2026-01-04 11:36:24 +01:00
mvdbeek 77d953c628 Move more setup code into handle_galaxy_config_kwds which has test_driver configured 2026-01-01 15:08:26 +01:00
mvdbeek 415e5feb58 Use test_driver.mkdtemp systematically
This might help with integration tests filling up the disk.
This was mostly fine before but this is a nice abstraction.
2026-01-01 15:08:26 +01:00
mvdbeek 5c1e94dfd0 Avoid undefined variable error 2026-01-01 13:34:25 +01:00
John Chilton d3bf550f1e Merge pull request #21518 from nsoranzo/release_25.1_backports
[25.1] Add missing dependencies to ``galaxy-files`` package
2025-12-31 12:15:57 -05:00