Commit Graph
1336 Commits
Author SHA1 Message Date
John Chilton 584c117df3 Refactor to cleanup dependencies around galaxy.web.stack.
Move galaxy.web.stack.database_heartbeat into galaxy.model - since it was the only thing in galaxy.web.stack that used galaxy.model at all and it didn't import anything else from galaxy.web.stack.

Once that was done, I refactored this whole package (galaxy.web.stack) into galaxy.web_stack. It doesn't use the framework setup or exported by the base galaxy.web package so it wouldn't seem to belong there. It also has very different dependencies than the rest of that. And finally and most importantly, this elimiantes almost all dependency from galaxy.jobs and galaxy.tools and galaxy.workflows to anything in galaxy.web.
2019-06-26 18:54:52 -04:00
Nicola Soranzo 90a6c6d46b Fix issues reported by ShellCheck 2019-06-13 12:53:26 +01:00
John Chilton 344055c4d2 Merge pull request #8098 from jmchilton/tool-util-expand
Migrate XSD into galaxy-tool-util.
2019-06-12 10:48:59 -04:00
Nicola Soranzo 1fd248311f Fix traceback in `printquery()`
Fix the following traceback:

```
/usr/users/ga002/soranzon/software/galaxyproject_galaxy/scripts/db_shell.py in printquery(statement, bind)
     60         if bind is None:
     61             bind = statement.session.get_bind(
---> 62                 statement._mapper_zero_or_none())
     63         statement = statement.statement
     64     elif bind is None:

AttributeError: 'Query' object has no attribute '_mapper_zero_or_none'
```

due to the removal of `_mapper_zero_or_none()` in SQLAlchemy commit
https://github.com/sqlalchemy/sqlalchemy/commit/234a5b9723fbbb9747c0f9e3917baf8500b73370
2019-06-11 11:31:40 +01:00
Dannon 0bbcb4fe40 Merge pull request #8047 from jmchilton/pages_api_and_component
Toward a more modern frontend and backend for Pages.
2019-06-10 09:08:48 -04:00
John Chilton 2fb06e7cc0 Skip client build when validating test tools, unneeded. 2019-06-05 16:46:52 -04:00
John Chilton fb7efea6ba Move tool XSD into galaxy-tool-util package. 2019-06-05 16:46:52 -04:00
Martin Cech 20bdd5867a Merge branch 'release_19.05' into dev 2019-06-05 16:35:35 -04:00
Martin Cech d6a26e1ba5 enhance repository search API capabilities
* include categories as keywords for repository index
* allow filtering on category/owner using github-like wildards "category:name"
* only log metadtaa like matched terms, do not return in http response
* refactoring
2019-05-29 16:17:09 -04:00
John Chilton ead233c0c1 clean-fix-page-api - move page revision creation to manager. 2019-05-29 13:43:49 -04:00
Martin Cech fd82ec013b repo search - prefix hash with changeset number, stringify as list 2019-05-28 11:38:16 -04:00
John Chilton 038d78a8f6 Fixes and enhancements for release note generation.
- Auto-bootstrap user announcements for datatypes, tools, and viz. (follow up on #7527)
- Many fixes for things broken in #7527
- Treat procedures as an enhancment for categorizing things.
- Speed up release note generation a bit by not considering really, really old PRs.
2019-05-24 16:59:32 -04:00
Martin Cech 0706a7ea24 add repo lineage to search results, lower limit to 1 char 2019-05-24 16:05:15 -04:00
Martin Cech 93609f4e68 include repo changeset history in the search index
unicodify the lineage string
2019-05-24 16:05:09 -04:00
Dannon f6011bab5b Merge pull request #7992 from jmchilton/more_packages
Add galaxy-tool-util and galaxy-job-metrics packages.
2019-05-20 16:36:11 -04:00
Marius van den Beek a71a44b2de Merge pull request #8003 from galaxyproject/release_19.01
Merge 19.01 into 19.05
2019-05-19 15:12:01 +02:00
Nate Coraor bd06628a3d Fix use of pgcleanup's purge_deleted_users when there are no users to
purge
2019-05-17 16:37:19 -04:00
Nate Coraor a6e0158672 Merge remote-tracking branch 'upstream/release_19.01' into release_19.05 2019-05-17 13:32:42 -04:00
Nate Coraor fc027182f7 Fix variable name for work mem in pgcleanup.py 2019-05-17 11:30:40 -04:00
John Chilton 939e7774a8 Create galaxy-tool-util package.
This is (so far a subset of) the tool utilities from galaxy-lib. galaxy-lib mocked out a fake galaxy.tools to allow these to all exist below the galaxy.tools - but this was a terrible hack - in order for the new packages to be true subsets of Galaxy they need to be refactored into a new package that doesn't depend on models, SA, galaxy.jobs, etc...

[x] galaxy.tools.deps -> galaxy.tool_util.deps
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.cwl -> galaxy.tool_util.cwl
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.fetcher -> galaxy.tool_util.fetcher
[x] galaxy.tools.locations -> galaxy.tool_util.locations
[x] galaxy.tools.parser -> galaxy.tool_util.parser
2019-05-16 16:45:25 -04:00
John Chilton b09f48978e Merge pull request #7830 from erasche/grt-tiny-fix
grt small bugfix for ancient data, deprecated params table
2019-04-26 10:56:21 -04:00
Helena Rasche 1b6b52ce10 swap to exception 2019-04-26 13:29:12 +02:00
Helena Rasche c54bddd3f3 it is pointless to load sample config 2019-04-26 13:27:59 +02:00
Helena Rasche cb7b26e25e Remove now-deprecated params + more defensive 2019-04-26 13:20:37 +02:00
Helena Rasche dcfff4d5de ensure a string is returned
Very old values in EU db were missing this.
2019-04-26 13:20:26 +02:00
Nicola Soranzo d53112aa43 Use `yaml.safe_load() instead of load()`
See https://msg.pyyaml.org/load
2019-04-23 16:50:55 +01:00
Nicola Soranzo 0faa479f94 Fix deprecated `getchildren()`
See https://docs.python.org/2/library/xml.etree.elementtree.html#xml.etree.ElementTree.Element.getchildren
2019-04-23 12:51:13 +01:00
Nicola Soranzo 1b1f6e9cda Fix comments 2019-04-14 18:02:42 +01:00
mvdbeek c8392299c8 Make processes and mules report heartbeat in database
It's important to not set the DatabaseHeartbeat `server_name` prior to forking,
which we avoid be getting `server_name` from
`application_stack.app.config.server_name`.
`WorkerProcess.server_name` for uwsgi web processes will look like:
`main.web.1` and mules like `main.job-handlers.1` while webless workers
remain named `handler1`.
2019-03-29 21:46:18 +01:00
Dannon Baker 485eece7f3 Grammatical tweaks. 2019-03-26 09:31:33 -04:00
Dannon Baker 8bb2b6bfbc Add extra verbosity covering non-client-building branches in startup. 2019-03-26 09:04:45 -04:00
Dannon Baker 2bb159ef52 Merge remote-tracking branch 'upstream/release_19.01' into dev 2019-03-22 10:49:37 -04:00
Martin Cech e65604bc06 Merge pull request #7556 from jmchilton/expression_tools
Implement expression tools and non-data tool outputs.
2019-03-20 18:52:59 -04:00
John Chilton 8d982b6410 Merge pull request #7532 from dannon/plugin-staging
Static plugin staging as a part of client build instead of startup
2019-03-20 13:47:17 -04:00
mvdbeek 5e778f4812 Install node as part of common_startup.sh 2019-03-20 10:02:56 +01:00
John Chilton 528497f7c4 Refactor galaxy.web.security into galaxy.security.idencoding.
I want to be able to use this class in galaxy.model and it doesn't have any dependnecies on "web" stuff so I'd like to move it out of galaxy.model and into galaxy.security. galaxy.model shouldn't have dependencies on galaxy.web (and doesn't after the recent 976f5ad367), so this pre-emptively ensures it doesn't require these dependencies for https://github.com/galaxyproject/galaxy/pull/7367.

This has the benefit of also eliminating any galaxy.web dependencies from the generic test base file (test/base/testcase.py) which has long been a goal of mine as well.

There are places we legimately use ID encoding and decoding for security (i.e. job files API) but for the most part it doesn't provide security for API endpoints and this causes confusion repeatedly, so I've started the process of renaming the contained class SecurityHelper to something I feel makes it clearer this is just about encoding and decoding IDs.
2019-03-19 14:28:31 -04:00
Dannon Baker 085d83d34c Fix template name substitution var 2019-03-19 10:45:20 -04:00
Dannon Baker 5d771424bf Drop debug github object print 2019-03-19 10:24:55 -04:00
Dannon Baker 29eca308f4 Drop static-safe navigation to plugin dirs. These are no longer symlinks, they are staged files. 2019-03-14 13:23:45 -04:00
Dannon Baker d72643fc2a Update plugin_staging to actually stage instead of symlink, since it no longer needs to be quite as fast (on startup). This will allow us to drop unnecessary trust rules from uwsgi static. 2019-03-14 13:18:43 -04:00
Dannon Baker 99082ff486 Drop plugin staging from common_startup 2019-03-14 11:40:52 -04:00
Helena Rasche ea0700a032 fix some small bugs 2019-03-14 10:09:36 +01:00
Helena Rasche ec086c1e8b Attempt to automate this? 2019-03-14 10:02:23 +01:00
Hervé Ménager 557407c384 correct virtualenv download with no wget/curl
the embedded python code needs a small correction to work in the no curl/wget available case.
2019-03-06 16:24:07 +01:00
Nicola Soranzo 84648f4986 Remove or replace references to Biostars 2019-03-01 22:59:16 +00:00
Nate Coraor ef8f208002 Merge remote-tracking branch 'upstream/release_19.01' into dev 2019-02-22 13:24:15 -05:00
Dannon Baker 726ad9a0f6 Bump yarn's network timeout from 2 minutes to 5 minutes. 2019-02-21 11:48:11 -05:00
Nicola Soranzo c6f1183939 Update documentation about dependencies 2019-02-18 22:36:32 +00:00
Sergey Golitsynskiy c21e07e1a0 Do not default to DEV_WHEELS=1 if no Git is found
If there is no Git repo in a Galaxy install, DEV_WHEELS will not be
turned on by default. If they are needed, use the --dev-wheels flag.

(Current behavior: common_startup.sh will turn on the DEV_WHEELS option
if no git repo is found, making the assumption that it is dealing with a
dev install. Thus, dev dependencies are installed whenever there's no
Git repo, including the use case when Galaxy was downloaded as a tarball
- when they may or may not be desired. There is no option to override
this behavior without editing the script.)
2019-02-15 17:05:48 -05:00
Dannon Baker 4427d3a982 Separate client node version requirement into individual dotfile for easier reading/use in ansible playbooks 2019-02-13 14:52:08 -05:00