Commit Graph
220 Commits
Author SHA1 Message Date
Nate Coraor cce1848d5e Use env for the API example scripts instead of directly referring to /usr/bin/python 2010-07-29 11:18:15 -04:00
Ramkrishna Chakrabarty c925dc1f2c lims:
- added a new table 'sample_dataset' to store sample datasets & their info when they are transfered from the sequencer
- the datasets transfer page now uses a grid to facilitate bulk renaming
- bulk renaming possible to fix the problem with the way SOLiD generates datasets
- the remote file browser is now independent of a specific sample, the user may select any sample when transferring datasets from the sequencer
2010-07-29 10:55:08 -04:00
Nate Coraor 99b9d820e8 Have check_galaxy.py script get twill from galaxy.eggs instead of directly from the (defunct) eggs/py-(version) directory 2010-07-28 12:57:16 -04:00
Greg Von Kuster 6bc3da5e5d Fix for sqlalchemy-migrate scripts so they will function across webapps - galaxy is the default, so no command line changes necessary when migrating the db. 2010-07-20 09:27:14 -04:00
Nate Coraor 85c6a3193a Upgrade pbs_python to 4.1.0 and use PBS exit_status (if keep_completed is set) so we can detect PBS failures. This is a reapplication of 3786:48432330228e, which was backed out in a subsequent revision due to crashes experienced in pbs_python 2.9.8. 2010-07-19 12:29:53 -04:00
Nate Coraor 57521e88cf Set a default (database/universe.sqlite) in manage_db.py in case the deprecated database_file is unset 2010-07-02 15:37:25 -04:00
Ramkrishna Chakrabarty 6ef3645b33 lims: removed the db engine echo option in the data transfer 2010-07-01 09:31:41 -04:00
Ramkrishna Chakrabarty 45cb09579f lims: requests/request_admin controller refactor
A new controller called requests_common now handles all common tasks like create/edit/delete requests & samples. The requests controller has only the grid definition and requests_admin controller has the request_type code and the sequencer data transfer code.
Also fixed a form importer bug in forms.py
2010-06-30 10:46:50 -04:00
Nate Coraor 7b93d1f53b API: Add library creation functionality. Note that no roles can be associated with libraries via the API at this time. 2010-06-23 14:44:37 -04:00
Nate Coraor 5eb9ca909f Initial implementation of the Galaxy Web API. Disabled unless
'enable_api = True' in config file.  You should not enable the API on
production sites as this code is brand new and may contain serious bugs and
security flaws!  Implemented:

* Display libraries
* Display library info
* Display library contents
* Display library content info
* Create library folders
* Upload datasets to a library from a server directory or with a path paste.
* Basic example scripts in scripts/api/

Framework changes that were made to support this:

* API Key interface in User Preferences.
* New api_keys database table for storing users' API Keys.
* New API-specific route mapper in webapp.
* API controllers in galaxy.web.api
* Return handling in reused library_common methods.
* expose_api decorator for API controller methods validates key and ensures
  valid JSON format.
* UniverseWebTransaction renamed to GalaxyWebTransaction and subclassed for
  GalaxyWebUITransaction and GalaxyWebAPITransaction.

Things that need to be done next:

* Documentation!
* Refactor reused code from library_common and other controllers into an
  even-more-generic location and format.  The main changes are that the Web UI
  returns redirects and rendered templates, whereas the API returns various
  HTTP status codes and JSON.
* Implement more functionality.
* The request and response format should be considered alpha and are subject to
  change.  They will be standardized as the API matures.

Hints to get started can be found in scripts/api/README
2010-06-22 13:10:28 -04:00
Ramkrishna Chakrabarty df780b03c9 lims:
- bug fix - the data transfer module now works for file/folder names with spaces in them
- UI cleanup
2010-06-11 10:18:13 -04:00
Ramkrishna Chakrabarty 37e3e9c006 lims:
- UI enhancements to the remote file browser, double click to open folder
- data transfer folder name includes date now
2010-06-09 13:07:05 -04:00
Daniel Blankenberg fdef6331e5 Updates for 'Profile Annotations for a set of genomic intervals' tool. This tool will now report a 'data version'. Add a script that creates the indexes and table description xml from a UCSC database dump. 2010-04-23 11:14:26 -04:00
Ramkrishna Chakrabarty 3d9c8baaad lims:
dataset rename issue fixed
2010-04-22 09:35:44 -04:00
Ramkrishna Chakrabarty 53151321b5 lims: fixed data transfer bugs 2010-04-21 16:42:09 -04:00
Ramkrishna Chakrabarty 378ada9cd7 lims:
- data transfer now uses rabbitmq
- datasets can now be renamed before transfering from the sequencer
- data transfer code refactored
2010-04-21 10:41:30 -04:00
Ramkrishna Chakrabarty fc58d32535 removed unused file. 2010-04-08 16:09:58 -04:00
Kanwei Li 0952b28502 Sync hashbangs 2010-04-01 20:36:31 -04:00
Ramkrishna Chakrabarty 14a2326260 lims: data transfer bug fix 2010-03-23 10:09:12 -04:00
Nate Coraor 8c872c16e7 Add numpy egg, update bx_python egg (now with 100% more numpy) and include code that allows scrambling to depend on other eggs existing and being importable. 2010-03-15 14:35:35 -04:00
Daniel Blankenberg 2223606101 Add a helper script that will re.escape files; useful for creating files valid for re_match and re_match_multiline comparisons in tool tests. 2010-03-09 15:25:23 -05:00
Nate Coraor b10c2324f5 Update psycopg2 to 2.0.13/postgresql 8.4.2 2010-03-09 14:13:05 -05:00
Nate Coraor 4a0c9b3175 I am having a bad day 2010-03-02 12:10:43 -05:00
Nate Coraor 1b8bcabd1e pbs_python 2.9.8 doesn't work 2010-03-02 12:08:01 -05:00
Nate Coraor 9b912184d0 Scratch that, just upgrade pbs_python instead 2010-03-02 11:52:16 -05:00
Nate Coraor a0bd85dbb3 Use the old method for fixing pbs_python's version 2010-03-02 11:37:55 -05:00
Nate Coraor 9a8c5f6711 psycopg2 scramble fix 2010-03-02 00:38:57 -05:00
James Taylor 31a4f80604 [mq] workflow-invocation: Track workflow invocations in database, provide a view of the history grouped by workflow and job 2010-02-11 00:17:04 -05:00
Nate Coraor 006716f53a Egg support overhaul, introduces a number of fixes to the ABI recognition, better build scripts, a rewrite of the eggs library and eliminition of the need for python -ES 2010-03-01 15:41:30 -05:00
Nate Coraor 6e9996f89a Fix for set metadata tests when setting metadata externally 2010-02-24 15:54:52 -05:00
Ramkrishna Chakrabarty 6b45a2c1f9 lims:
- code cleanup
- cleanup tmp files after data transfer
2010-02-24 10:42:36 -05:00
Ramkrishna Chakrabarty dd4757f20a lims:
- added error msg when dataset transfer is started for samples with no library
- fixed typos
- now dataset transfer does not affect sample state
- request completion logic restored.
2010-02-24 10:04:03 -05:00
Nate Coraor 5e34e82e5c Modify functional_tests.py to allow for testing of an environment nearly identical to Galaxy Test/Main via buildbot 2010-02-23 15:14:28 -05:00
Nate Coraor bb6a16d1f4 Fix MySQL_python static egg on OS X 2010-02-19 14:34:25 -05:00
Ramkrishna Chakrabarty 2da3981679 LIMS: using threads for data transfer. first pass 2010-02-12 16:59:57 -05:00
Ramkrishna Chakrabarty 1e3bcd5d7c LIMS data transfer:
- Fixed some config variable issues
- Now for the time being, Galaxy can transfer one dataset at a time.
2010-02-12 14:01:45 -05:00
Ramkrishna Chakrabarty 453092bf74 fixed the 0037_sample_library migration script to work with sqlite 2010-02-11 09:25:29 -05:00
Ramkrishna Chakrabarty ebe405446a LIMS: replaced os.system with subprocess to spawn the data transfer daemon process 2010-02-09 11:21:53 -05:00
Ramkrishna Chakrabarty 5747633a06 LIMS data acquisition: now the data transfer user logs out after the transfer is complete 2010-02-04 17:00:46 -05:00
Ramkrishna Chakrabarty cea3324bbb Sequencer data acquisition for LIMS
- Add a data transfer script which fetches datasets from the sequencer
- transfer_datasets.ini for setting up the separate user to login to Galaxy programmatically to add datasets to the data libraries.
- Added a dataset transfer page which includes remote file browser to select files for transfer

Removed library & folder foreign keys from the request table and added them to the sample table. Also the sample table now has a dataset_files column to store the datatsets and the their transfer status.
Add an egg for pexpect which is used in the remote file browser.
The request_type table has a new column datatx_info which stores all the login info for the sequencer machine
2010-02-04 11:01:45 -05:00
Nate Coraor eace604562 require pysqlite in functional_tests to work around a bug in nose 2010-01-28 14:52:02 -05:00
Nate Coraor 96a4144bc3 Fix another exception error (only in 2.4) with check_python.py 2010-01-28 13:37:53 -05:00
Nate Coraor ae12fd7d5b Prevent sys.exit() from being caught by the try-except block in check_galaxy.py (since sys.exit() actually raises an exception, but one not derived from Exception). 2010-01-05 15:17:10 -05:00
Nate Coraor 1f5e079a3a python run from virtualenv sets up site.py to pull things from the real python's lib directory, so 'python -S' breaks it. To fix this, have the check_python.py script check for virtualenv and output the arguments that should be used to start python ('python -E' for virtualenv, 'python -ES' for real), then use these arguments anywhere 'python -ES' was used in the past. 2010-01-04 12:51:34 -05:00
Nate Coraor a3aaa1e780 Fix libdrmaa runtime link path on OS X 2009-12-09 10:15:15 -05:00
Ramkrishna Chakrabarty ec1aac46e4 AMQP listener now updates request_event table when all samples have finished processing 2009-12-07 14:45:09 -05:00
Ramkrishna Chakrabarty 8ff7f8f853 AMQP listener config file bug fix 2009-12-04 14:50:00 -05:00
Daniel Blankenberg 77bd226f2b When setting metadata externally, substitute a MetadataTempFile object for all populated metadata FileParameters. Fixes the problem with writting to metadata FileParameter files on cluster nodes with read-only database/files directory. 2009-11-30 14:55:30 -05:00
Kanwei Li e4a4889524 Fix run.sh --reload by requiring Paste before PasteScript 2009-11-23 17:20:01 -05:00
Nate Coraor a3d62f4036 Explicitly check eggs and fetch when starting, instead of relying on automatic in-process fetching. Also contains a fix for pysqlite egg building 2009-11-16 14:42:09 -05:00