Commit Graph
1322 Commits
Author SHA1 Message Date
Dannon f6011bab5b Merge pull request #7992 from jmchilton/more_packages
Add galaxy-tool-util and galaxy-job-metrics packages.
2019-05-20 16:36:11 -04:00
Marius van den Beek a71a44b2de Merge pull request #8003 from galaxyproject/release_19.01
Merge 19.01 into 19.05
2019-05-19 15:12:01 +02:00
Nate Coraor bd06628a3d Fix use of pgcleanup's purge_deleted_users when there are no users to
purge
2019-05-17 16:37:19 -04:00
Nate Coraor a6e0158672 Merge remote-tracking branch 'upstream/release_19.01' into release_19.05 2019-05-17 13:32:42 -04:00
Nate Coraor fc027182f7 Fix variable name for work mem in pgcleanup.py 2019-05-17 11:30:40 -04:00
John Chilton 939e7774a8 Create galaxy-tool-util package.
This is (so far a subset of) the tool utilities from galaxy-lib. galaxy-lib mocked out a fake galaxy.tools to allow these to all exist below the galaxy.tools - but this was a terrible hack - in order for the new packages to be true subsets of Galaxy they need to be refactored into a new package that doesn't depend on models, SA, galaxy.jobs, etc...

[x] galaxy.tools.deps -> galaxy.tool_util.deps
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.cwl -> galaxy.tool_util.cwl
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.fetcher -> galaxy.tool_util.fetcher
[x] galaxy.tools.locations -> galaxy.tool_util.locations
[x] galaxy.tools.parser -> galaxy.tool_util.parser
2019-05-16 16:45:25 -04:00
John Chilton b09f48978e Merge pull request #7830 from erasche/grt-tiny-fix
grt small bugfix for ancient data, deprecated params table
2019-04-26 10:56:21 -04:00
Helena Rasche 1b6b52ce10 swap to exception 2019-04-26 13:29:12 +02:00
Helena Rasche c54bddd3f3 it is pointless to load sample config 2019-04-26 13:27:59 +02:00
Helena Rasche cb7b26e25e Remove now-deprecated params + more defensive 2019-04-26 13:20:37 +02:00
Helena Rasche dcfff4d5de ensure a string is returned
Very old values in EU db were missing this.
2019-04-26 13:20:26 +02:00
Nicola Soranzo d53112aa43 Use `yaml.safe_load() instead of load()`
See https://msg.pyyaml.org/load
2019-04-23 16:50:55 +01:00
Nicola Soranzo 0faa479f94 Fix deprecated `getchildren()`
See https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.getchildren
2019-04-23 12:51:13 +01:00
Nicola Soranzo 1b1f6e9cda Fix comments 2019-04-14 18:02:42 +01:00
mvdbeek c8392299c8 Make processes and mules report heartbeat in database
It's important to not set the DatabaseHeartbeat `server_name` prior to forking,
which we avoid be getting `server_name` from
`application_stack.app.config.server_name`.
`WorkerProcess.server_name` for uwsgi web processes will look like:
`main.web.1` and mules like `main.job-handlers.1` while webless workers
remain named `handler1`.
2019-03-29 21:46:18 +01:00
Dannon Baker 485eece7f3 Grammatical tweaks. 2019-03-26 09:31:33 -04:00
Dannon Baker 8bb2b6bfbc Add extra verbosity covering non-client-building branches in startup. 2019-03-26 09:04:45 -04:00
Dannon Baker 2bb159ef52 Merge remote-tracking branch 'upstream/release_19.01' into dev 2019-03-22 10:49:37 -04:00
Martin Cech e65604bc06 Merge pull request #7556 from jmchilton/expression_tools
Implement expression tools and non-data tool outputs.
2019-03-20 18:52:59 -04:00
John Chilton 8d982b6410 Merge pull request #7532 from dannon/plugin-staging
Static plugin staging as a part of client build instead of startup
2019-03-20 13:47:17 -04:00
mvdbeek 5e778f4812 Install node as part of common_startup.sh 2019-03-20 10:02:56 +01:00
John Chilton 528497f7c4 Refactor galaxy.web.security into galaxy.security.idencoding.
I want to be able to use this class in galaxy.model and it doesn't have any dependnecies on "web" stuff so I'd like to move it out of galaxy.model and into galaxy.security. galaxy.model shouldn't have dependencies on galaxy.web (and doesn't after the recent 976f5ad367), so this pre-emptively ensures it doesn't require these dependencies for https://github.com/galaxyproject/galaxy/pull/7367.

This has the benefit of also eliminating any galaxy.web dependencies from the generic test base file (test/base/testcase.py) which has long been a goal of mine as well.

There are places we legimately use ID encoding and decoding for security (i.e. job files API) but for the most part it doesn't provide security for API endpoints and this causes confusion repeatedly, so I've started the process of renaming the contained class SecurityHelper to something I feel makes it clearer this is just about encoding and decoding IDs.
2019-03-19 14:28:31 -04:00
Dannon Baker 085d83d34c Fix template name substitution var 2019-03-19 10:45:20 -04:00
Dannon Baker 5d771424bf Drop debug github object print 2019-03-19 10:24:55 -04:00
Dannon Baker 29eca308f4 Drop static-safe navigation to plugin dirs. These are no longer symlinks, they are staged files. 2019-03-14 13:23:45 -04:00
Dannon Baker d72643fc2a Update plugin_staging to actually stage instead of symlink, since it no longer needs to be quite as fast (on startup). This will allow us to drop unnecessary trust rules from uwsgi static. 2019-03-14 13:18:43 -04:00
Dannon Baker 99082ff486 Drop plugin staging from common_startup 2019-03-14 11:40:52 -04:00
Helena Rasche ea0700a032 fix some small bugs 2019-03-14 10:09:36 +01:00
Helena Rasche ec086c1e8b Attempt to automate this? 2019-03-14 10:02:23 +01:00
Hervé Ménager 557407c384 correct virtualenv download with no wget/curl
the embedded python code needs a small correction to work in the no curl/wget available case.
2019-03-06 16:24:07 +01:00
Nicola Soranzo 84648f4986 Remove or replace references to Biostars 2019-03-01 22:59:16 +00:00
Nate Coraor ef8f208002 Merge remote-tracking branch 'upstream/release_19.01' into dev 2019-02-22 13:24:15 -05:00
Dannon Baker 726ad9a0f6 Bump yarn's network timeout from 2 minutes to 5 minutes. 2019-02-21 11:48:11 -05:00
Nicola Soranzo c6f1183939 Update documentation about dependencies 2019-02-18 22:36:32 +00:00
Sergey Golitsynskiy c21e07e1a0 Do not default to DEV_WHEELS=1 if no Git is found
If there is no Git repo in a Galaxy install, DEV_WHEELS will not be
turned on by default. If they are needed, use the --dev-wheels flag.

(Current behavior: common_startup.sh will turn on the DEV_WHEELS option
if no git repo is found, making the assumption that it is dealing with a
dev install. Thus, dev dependencies are installed whenever there's no
Git repo, including the use case when Galaxy was downloaded as a tarball
- when they may or may not be desired. There is no option to override
this behavior without editing the script.)
2019-02-15 17:05:48 -05:00
Dannon Baker 4427d3a982 Separate client node version requirement into individual dotfile for easier reading/use in ansible playbooks 2019-02-13 14:52:08 -05:00
Nicola Soranzo 21ce99e231 Merge branch 'release_19.01' into dev 2019-02-12 12:03:03 +00:00
Nicola Soranzo b33b06440f Merge branch 'release_18.09' into release_19.01 2019-02-12 11:51:07 +00:00
Nicola Soranzo 6589bf3314 Drop support for Python 3.4. Officially support Python >=3.5
xref. https://github.com/galaxyproject/galaxy/issues/7260
2019-01-31 23:31:44 +00:00
Dannon Baker a10d2c51d3 Add/pin configurable node version to 18.09. Backport/tweak of https://github.com/galaxyproject/galaxy/pull/7220) 2019-01-18 11:54:59 -05:00
Dannon Baker bad8cffdbc Verify .venv's node version is in line with what we've specified as being locked, rather than just checking if node exists. 2019-01-15 14:24:12 -05:00
Nate Coraor 473210714e Add support for dynamic handlers when using DB serialization handler assignment 2018-12-18 13:34:31 -05:00
Nicola Soranzo b22b7e5868 Merge branch 'release_18.09' into dev 2018-12-16 23:02:41 +00:00
Nicola Soranzo 975c8b605f Fix activation of `_galaxy_` conda env
- Use `conda_activate`, which works also under dash
- Run `conda_activate` also when `$GALAXY_CONDA_ENV` already exists
- Run `virtualenv` when the conda env is active but `$GALAXY_VIRTUAL_ENV`
  does not exist
- Update the default for `GALAXY_CONDA_ENV` in
  scripts/common_startup_functions.sh

Follow-up on https://github.com/galaxyproject/galaxy/pull/6975 .
2018-12-14 00:22:12 +00:00
Björn Grüning 6db721915f Merge pull request #7041 from erasche/fix-grt
[18.09] GRT: Rip out all parameters, round file sizes
2018-12-12 19:22:32 +01:00
Nicola Soranzo 16f3be66be Merge branch 'release_18.09' into dev 2018-12-06 14:27:16 +00:00
Dannon Baker 66fae561b2 Don't use pushd/popd 2018-12-02 22:04:45 -05:00
Dannon Baker fa408f4850 exit with error code (and appropriate message) on either build failure 2018-11-29 11:19:49 -05:00
Dannon Baker 77aec5a79d Standardize on spaces in common_startup.sh (tabs were mixed in here) 2018-11-29 11:11:37 -05:00
Dannon Baker be43693ef0 Avoid using make for autobuild; reducing necessary dependencies out of the box. 2018-11-29 11:11:11 -05:00