Commit Graph
602 Commits
Author SHA1 Message Date
John Chilton 732abcc0db Merge remote-tracking branch 'jmchilton/release_15.05' into dev 2015-06-08 14:04:28 -04:00
Nicola Soranzo 292d16a593 Mark also HDAs as purged when purging datasets via cleanup script.
This will make purged datasets be shown as purged in histories,
preventing them to be undeleted through the UI.
This will not fix datasets previously purged through this script,
scripts/cleanup_datasets/pgcleanup.py may be used for that.
2015-06-04 18:06:01 +01:00
Dannon Baker e56b2a3433 Merge pull request #274 from dpryan79/dev
Add usage information to python cleanup scripts
2015-06-02 07:57:02 -04:00
John Chilton 3946ff50bb Merge pull request #80 from erasche/jbrowse-ie
Add EDAM IDs to datatypes
2015-05-22 09:42:59 -05:00
dpryan79 00eb96923f Add a missing period in populate_uuid.py 2015-05-20 13:01:40 +02:00
dpryan79 0ff5a050d5 Indentation fix 2015-05-19 21:55:36 +02:00
dpryan79 0763cab37a Update the remainder of the python cleanup scripts 2015-05-19 21:53:45 +02:00
John Chilton 98d8c2cc2e Allow config of shed tool conf used with `run_tests.sh -installed`.
Set with GALAXY_TEST_SHED_TOOL_CONF.

This is required to implement galaxyproject/planemo#176.
2015-05-18 02:07:36 -04:00
John Chilton 08e2c351d9 Add edam formats to most Galaxy datatypes and a script for producing a mapping.
See notes in scripts/edam_mapping.py for more information on mapping.

This is based on mapping of terms done by Eric Rasche (@erasche) (in galaxyproject/galaxy#80) and by the team at Pasteur including @hmenager, @fmareuil, and @odoppelt (in https://docs.google.com/spreadsheets/d/1vptTpJvQfb5FOtRJOajjftUkL9aZ0eeVdhUPvd9h5wY/edit#gid=0).

Current mapping at time of commit is https://gist.github.com/jmchilton/73cd540d7a08488843d7.
2015-05-16 16:47:39 -04:00
Nate Coraor 656d9bef50 Merge remote-tracking branch 'upstream/release_15.05' into dev
Conflicts:
	lib/galaxy/version.py
2015-05-14 11:11:46 -04:00
dpryan79 4c20494011 Make python scripts executable. Tweak remove_renamed_datasets_from_disk.py. 2015-05-12 18:25:32 +02:00
John Chilton 4e1324e432 Add PR7 to release notes (caught by @bgruening).
... small updates to bootstrap history script for reuse in planemo.
2015-05-12 12:15:56 -04:00
dpryan79 a092aa2f59 Start providing usage information for the various cleanup scripts 2015-05-12 17:53:18 +02:00
John Chilton bb7fb089fe First crack at release notes for 15.05. 2015-05-11 23:05:56 -04:00
John Chilton 0aabdd4048 Merge remote-tracking branch 'jmchilton/release_15.05' into dev 2015-05-06 20:56:43 -04:00
John Chilton 5d31ce641a Fix problem with twill's custom subprocess module.
There has been for some time a scary warning when testing (http://dev.list.galaxyproject.org/run-test-sh-ImportError-cannot-import-name-args-from-interpreter-flags-td4666277.html) that I now understand is the result of Twill being packaged with its own custom subprocess module that conflicts with modules using multiprocessing (e.g. kombu).

After the #198 this scary warning has become an exception that prevents exception of tests (see https://travis-ci.org/galaxyproject/planemo/jobs/61547827 for instance). Importing subprocess seems to force Python to use the system module instead of twills - which seems to prevent these problems.

There have been other reports of this problem with Twill in other projects and removing the subprocess module didn't seem to break anything for them either.
2015-05-06 20:24:50 -04:00
John Chilton 6e71a90cdd Merge pull request #151 from natefoo/runtime_stats
A command line script for collecting stats on job runtimes
2015-04-28 13:11:33 -05:00
Marek Vavrusa 43cd2083f6 runners/drmaa: set 'workingDirectory' correctly
this fixes an issue with when the Galaxy lib (and therefore working
directory) is not shared with the compute nodes
2015-04-24 16:12:33 +02:00
Nate Coraor 73dd0b1a6f Add some additional documentation/usage in the doc string 2015-04-23 16:03:58 -04:00
Nate Coraor bdbc98c47c Fix the connection string when a database username is provided (reported
by @afgane in #151).
2015-04-23 15:46:46 -04:00
Nate Coraor fd5c41e902 Pull runtime stats from metrics by default (job state history remains an
option), a couple other minor improvements to the script.
2015-04-23 15:42:46 -04:00
Nate Coraor ef69881e56 Added a command line script for collecting stats on job runtimes to help
admins make decisions about how/where to run jobs.
2015-04-23 12:56:06 -04:00
Martin Cech 16ee7fa74c add default config for TS search; rename to match TS playbook 2015-04-21 11:59:01 -04:00
Martin Cech dc736c73f2 remove another abspath; use optparse; 2015-04-14 11:31:44 -04:00
Martin Cech 66e61271b1 add comments and example; add consistency checks; remove bash script 2015-04-14 10:55:34 -04:00
Martin Cech c12b8063e3 remove abspath 2015-04-13 14:39:31 -04:00
Martin Cech a9bc7dc5ca generate separate index for tools in repositories 2015-04-13 13:45:32 -04:00
John Chilton a357e2b613 Workflow scaling test infrastructure.
- Add script to hit the API with workflows requests.
 - Update testing Dockerfile to allow just booting up with a fixed master API key for this test to leverage.
 - WIP: on updating test Dockerfile to work with slurm, multiple handlers, uwsgi, etc...
2015-03-25 14:54:48 -04:00
Carl Eberhard 9a7f5fc17b Remove scripts/packed, packing infrastructure, and pack_scripts config options 2015-03-17 10:31:35 -04:00
Nicola Soranzo b4acf247df Uniform configuration of "From" field of sent emails.
Subsume activation_email in email_from (used also in tool_shed.ini).
Try also getfqdn in PJA.
Default to 'galaxy-no-reply@' instead of 'galaxy-noreply@' in PJA.
2015-03-13 01:07:57 +00:00
Dannon Baker 8c476931f9 Cleanup related to PR#7 and affected files. 2015-03-05 09:47:14 -05:00
Dannon Baker fe226e1a9b Refactoring of set_user_disk_usage and admin controller disk usage to use the same pgcalc 2015-02-25 12:52:47 -05:00
Dannon Baker 9f01d275ef Add all the necessary dependency requires. Note to self: fix the egg dependency resolution bug so we don't have to dot his. 2015-02-14 10:35:42 -05:00
Nate Coraor e64ab4c85c There's no reliable way to use the Galaxy config file to control egg use/fetching since so many things use galaxy.eggs from outside of Galaxy, so drop the support for the config file options and rely on the environment variables only. Reverse the defaults so that eggs and fetching are enabled by default. I'll make sure that they properly get passed to the tool execution environments in the next commit. 2015-02-12 15:10:19 -05:00
Nate Coraor 1e07117791 Place the new egg config options into the environment at Galaxy startup since
eggs.require() has no access to the config file.
2015-02-12 14:27:37 -05:00
Nate Coraor 92f6ace47f Ensure the correct default Galaxy config file is found in common_startup.sh, it
makes a difference for egg fetching since some eggs are conditional based on
config.
2015-02-12 11:47:58 -05:00
Dannon Baker c733ce370b Fix path insertion vs appending of <galaxy>/lib for all scripts. 2015-02-12 10:34:51 -05:00
Dannon Baker de1cd01954 Fix path manipulation during fetch_eggs. This getting an external version of pkg_resources (and not ours in lib/) is what is causing the weird egg fetching errors. Newer versions of pkg_resources create a mangled distribution string for some eggs with nonstandard version identifiers. 2015-02-12 08:28:37 -05:00
John Chilton 38679a0d32 Dynamically fetch and cache test-data from git repositories if needed...
... for tool tests. Longer term this functionality should be dropped (i.e. after all the tools are out of Galaxy) and the test-data always lives next to the tool - but for now it decreases the size of the repository ahead of a potential move to github.
2015-02-09 21:43:42 -05:00
Dave Bouvier decb4a1ec0 Add script to update the paths to tool config files in installed repositories' metadata. 2015-01-30 12:17:01 -05:00
Dannon Baker dba89dff83 Convert everything from elementtree to stdlib xml module. 2015-01-29 16:10:56 -05:00
Martin Cech 9f454b404f found a known Whoosh bug, trying to avoid it
https://bitbucket.org/mchaput/whoosh/issue/386/keyerror-1l
2015-01-29 11:43:29 -05:00
Nate Coraor 29dda3e11a Remove GeneTrack remnants. 2015-01-28 16:29:21 -05:00
Martin Cech f10ed7d184 way better search; dont query DB; repair final scoring functions 2015-01-28 15:24:10 -05:00
Martin Cech fd8a7da910 adjust schema, start dynamic scoring 2015-01-27 17:15:18 -05:00
Martin Cech 05e9ea637e initial version of TS search API and Index builder script
beware: always returns jsonp for now
2015-01-26 13:08:16 -05:00
Nicola Soranzo ee28d3c45a Fix merge() documentation. 2015-01-23 19:19:15 +00:00
John Chilton 46f2679e9d Tool Tests - Only set library import dir if it exists.
Fixes planemo #41 (https://github.com/galaxyproject/planemo/issues/41).
2015-01-11 21:32:50 -05:00
John Chilton b0e43e567e Allow specification of multiple data manager configuration files...
... use this to create API functional tests for data managers.
2014-12-15 00:20:35 -05:00
John Chilton 33463efe13 Allow multiple tool data table config files...
... use this functionality to implement tests for tool data API.
2014-12-15 00:20:35 -05:00