Martin Cech
eb54b1d854
expose searching full TS toolset over a separate index
...
the index is created by the same script (build_ts_whoosh_index.py)
2015-06-19 16:24:27 -04:00
John Chilton
4e82c80293
Fix for 38679a0d32.
...
Reported by @golharam.
2015-06-18 15:57:49 -04:00
Martin Cech
508b685c70
fix common API scripts so they dont fail when response has no url param
2015-06-15 16:12:21 -04:00
John Chilton
374795f631
Only cleanup successful jobs when testing.
...
As per the recommendation of Ryan G. at http://dev.list.galaxyproject.org/keep-job-output-and-scripts-on-failed-tests-td4667327.html .
I considered making this 'never' - since those files will get cleaned up at the end anyway. This would actually reduce our test coverage related to job cleanup logic - so I have decided this is a fine a middle ground.
2015-06-15 09:53:59 -04:00
John Chilton
584f673f8d
Merge remote-tracking branch 'jmchilton/dev' into ts-search-expansion
...
Conflicts:
lib/galaxy/webapps/tool_shed/buildapp.py
2015-06-15 09:43:59 -04:00
John Chilton
732abcc0db
Merge remote-tracking branch 'jmchilton/release_15.05' into dev
2015-06-08 14:04:28 -04:00
Nicola Soranzo
292d16a593
Mark also HDAs as purged when purging datasets via cleanup script.
...
This will make purged datasets be shown as purged in histories,
preventing them to be undeleted through the UI.
This will not fix datasets previously purged through this script,
scripts/cleanup_datasets/pgcleanup.py may be used for that.
2015-06-04 18:06:01 +01:00
Dannon Baker
e56b2a3433
Merge pull request #274 from dpryan79/dev
...
Add usage information to python cleanup scripts
2015-06-02 07:57:02 -04:00
John Chilton
3946ff50bb
Merge pull request #80 from erasche/jbrowse-ie
...
Add EDAM IDs to datatypes
2015-05-22 09:42:59 -05:00
dpryan79
00eb96923f
Add a missing period in populate_uuid.py
2015-05-20 13:01:40 +02:00
dpryan79
0ff5a050d5
Indentation fix
2015-05-19 21:55:36 +02:00
dpryan79
0763cab37a
Update the remainder of the python cleanup scripts
2015-05-19 21:53:45 +02:00
John Chilton
98d8c2cc2e
Allow config of shed tool conf used with `run_tests.sh -installed`.
...
Set with GALAXY_TEST_SHED_TOOL_CONF.
This is required to implement galaxyproject/planemo#176 .
2015-05-18 02:07:36 -04:00
John Chilton
08e2c351d9
Add edam formats to most Galaxy datatypes and a script for producing a mapping.
...
See notes in scripts/edam_mapping.py for more information on mapping.
This is based on mapping of terms done by Eric Rasche (@erasche) (in galaxyproject/galaxy#80 ) and by the team at Pasteur including @hmenager, @fmareuil, and @odoppelt (in https://docs.google.com/spreadsheets/d/1vptTpJvQfb5FOtRJOajjftUkL9aZ0eeVdhUPvd9h5wY/edit#gid=0 ).
Current mapping at time of commit is https://gist.github.com/jmchilton/73cd540d7a08488843d7 .
2015-05-16 16:47:39 -04:00
Nate Coraor
656d9bef50
Merge remote-tracking branch 'upstream/release_15.05' into dev
...
Conflicts:
lib/galaxy/version.py
2015-05-14 11:11:46 -04:00
dpryan79
4c20494011
Make python scripts executable. Tweak remove_renamed_datasets_from_disk.py.
2015-05-12 18:25:32 +02:00
John Chilton
4e1324e432
Add PR7 to release notes (caught by @bgruening).
...
... small updates to bootstrap history script for reuse in planemo.
2015-05-12 12:15:56 -04:00
dpryan79
a092aa2f59
Start providing usage information for the various cleanup scripts
2015-05-12 17:53:18 +02:00
John Chilton
bb7fb089fe
First crack at release notes for 15.05.
2015-05-11 23:05:56 -04:00
Martin Cech
e0c7e02e40
do not require option that is actualy in the config
2015-05-07 16:50:27 -04:00
John Chilton
0aabdd4048
Merge remote-tracking branch 'jmchilton/release_15.05' into dev
2015-05-06 20:56:43 -04:00
John Chilton
5d31ce641a
Fix problem with twill's custom subprocess module.
...
There has been for some time a scary warning when testing (http://dev.list.galaxyproject.org/run-test-sh-ImportError-cannot-import-name-args-from-interpreter-flags-td4666277.html ) that I now understand is the result of Twill being packaged with its own custom subprocess module that conflicts with modules using multiprocessing (e.g. kombu).
After the #198 this scary warning has become an exception that prevents exception of tests (see https://travis-ci.org/galaxyproject/planemo/jobs/61547827 for instance). Importing subprocess seems to force Python to use the system module instead of twills - which seems to prevent these problems.
There have been other reports of this problem with Twill in other projects and removing the subprocess module didn't seem to break anything for them either.
2015-05-06 20:24:50 -04:00
John Chilton
6e71a90cdd
Merge pull request #151 from natefoo/runtime_stats
...
A command line script for collecting stats on job runtimes
2015-04-28 13:11:33 -05:00
Marek Vavrusa
43cd2083f6
runners/drmaa: set 'workingDirectory' correctly
...
this fixes an issue with when the Galaxy lib (and therefore working
directory) is not shared with the compute nodes
2015-04-24 16:12:33 +02:00
Nate Coraor
73dd0b1a6f
Add some additional documentation/usage in the doc string
2015-04-23 16:03:58 -04:00
Nate Coraor
bdbc98c47c
Fix the connection string when a database username is provided (reported
...
by @afgane in #151 ).
2015-04-23 15:46:46 -04:00
Nate Coraor
fd5c41e902
Pull runtime stats from metrics by default (job state history remains an
...
option), a couple other minor improvements to the script.
2015-04-23 15:42:46 -04:00
Nate Coraor
ef69881e56
Added a command line script for collecting stats on job runtimes to help
...
admins make decisions about how/where to run jobs.
2015-04-23 12:56:06 -04:00
Martin Cech
16ee7fa74c
add default config for TS search; rename to match TS playbook
2015-04-21 11:59:01 -04:00
Martin Cech
dc736c73f2
remove another abspath; use optparse;
2015-04-14 11:31:44 -04:00
Martin Cech
66e61271b1
add comments and example; add consistency checks; remove bash script
2015-04-14 10:55:34 -04:00
Martin Cech
c12b8063e3
remove abspath
2015-04-13 14:39:31 -04:00
Martin Cech
a9bc7dc5ca
generate separate index for tools in repositories
2015-04-13 13:45:32 -04:00
John Chilton
a357e2b613
Workflow scaling test infrastructure.
...
- Add script to hit the API with workflows requests.
- Update testing Dockerfile to allow just booting up with a fixed master API key for this test to leverage.
- WIP: on updating test Dockerfile to work with slurm, multiple handlers, uwsgi, etc...
2015-03-25 14:54:48 -04:00
Carl Eberhard
9a7f5fc17b
Remove scripts/packed, packing infrastructure, and pack_scripts config options
2015-03-17 10:31:35 -04:00
Nicola Soranzo
b4acf247df
Uniform configuration of "From" field of sent emails.
...
Subsume activation_email in email_from (used also in tool_shed.ini).
Try also getfqdn in PJA.
Default to 'galaxy-no-reply@' instead of 'galaxy-noreply@' in PJA.
2015-03-13 01:07:57 +00:00
Dannon Baker
8c476931f9
Cleanup related to PR#7 and affected files.
2015-03-05 09:47:14 -05:00
Dannon Baker
fe226e1a9b
Refactoring of set_user_disk_usage and admin controller disk usage to use the same pgcalc
2015-02-25 12:52:47 -05:00
Dannon Baker
9f01d275ef
Add all the necessary dependency requires. Note to self: fix the egg dependency resolution bug so we don't have to dot his.
2015-02-14 10:35:42 -05:00
Nate Coraor
e64ab4c85c
There's no reliable way to use the Galaxy config file to control egg use/fetching since so many things use galaxy.eggs from outside of Galaxy, so drop the support for the config file options and rely on the environment variables only. Reverse the defaults so that eggs and fetching are enabled by default. I'll make sure that they properly get passed to the tool execution environments in the next commit.
2015-02-12 15:10:19 -05:00
Nate Coraor
1e07117791
Place the new egg config options into the environment at Galaxy startup since
...
eggs.require() has no access to the config file.
2015-02-12 14:27:37 -05:00
Nate Coraor
92f6ace47f
Ensure the correct default Galaxy config file is found in common_startup.sh, it
...
makes a difference for egg fetching since some eggs are conditional based on
config.
2015-02-12 11:47:58 -05:00
Dannon Baker
c733ce370b
Fix path insertion vs appending of <galaxy>/lib for all scripts.
2015-02-12 10:34:51 -05:00
Dannon Baker
de1cd01954
Fix path manipulation during fetch_eggs. This getting an external version of pkg_resources (and not ours in lib/) is what is causing the weird egg fetching errors. Newer versions of pkg_resources create a mangled distribution string for some eggs with nonstandard version identifiers.
2015-02-12 08:28:37 -05:00
John Chilton
38679a0d32
Dynamically fetch and cache test-data from git repositories if needed...
...
... for tool tests. Longer term this functionality should be dropped (i.e. after all the tools are out of Galaxy) and the test-data always lives next to the tool - but for now it decreases the size of the repository ahead of a potential move to github.
2015-02-09 21:43:42 -05:00
Dave Bouvier
decb4a1ec0
Add script to update the paths to tool config files in installed repositories' metadata.
2015-01-30 12:17:01 -05:00
Dannon Baker
dba89dff83
Convert everything from elementtree to stdlib xml module.
2015-01-29 16:10:56 -05:00
Martin Cech
9f454b404f
found a known Whoosh bug, trying to avoid it
...
https://bitbucket.org/mchaput/whoosh/issue/386/keyerror-1l
2015-01-29 11:43:29 -05:00
Nate Coraor
29dda3e11a
Remove GeneTrack remnants.
2015-01-28 16:29:21 -05:00
Martin Cech
f10ed7d184
way better search; dont query DB; repair final scoring functions
2015-01-28 15:24:10 -05:00
Martin Cech