Commit Graph
11583 Commits
Author SHA1 Message Date
John Chilton 77a9bb5db2 Models: Unify 'now' import and comment across galaxy and toolshed. 2013-12-05 00:20:54 -06:00
John Chilton 9faa65a66e Models: Random fixes for mapping tests.
PEP-8. Get rid of old test suite code mixed into real code.
2013-12-05 00:20:54 -06:00
John Chilton 79c8f59341 Models: Introduce real class for app.model (ModelMapping).
Shared across Tool Shed and Galaxy to reduce code duplication. Previously this was just a bunch, making it a real class allows placing some shared logic in there.

This refactoring also eliminates some global variables galaxy.model.mapping.Session, galaxy.model.mapping.context, and same for tool shed. This may break things, but these are things that should probably be fixed anyway.

In particular small changes to db_shell.py and a unit test that depended on these global variables have been updated. The functional test frameworks likewise needed to be updated to not depend on these - these changes were more substantial.

To fix these functional tests, I essentially replace old references to global variables in Galaxy with references to global variables just defined in the test framework in test/functional/database_contexts.py (a slight improvement).
2013-12-05 00:20:54 -06:00
John Chilton 4dc6c93a9f Models: Refactor common code out between Galaxy and Tool Shed related to create_engine. 2013-12-05 00:20:54 -06:00
John Chilton e7d8b36513 Models: Refactor some common code between tool shed and Galaxy into galaxy.model.orm. 2013-12-05 00:20:54 -06:00
John Chilton b686182e13 Modles: Clean up stand-alone database scripts.
Namely create_db.py,db_shell.py, and manage_db.py.

Move duplicated code into lib/galaxy/model/orm/scripts.py - add unit tests. PEP-8 clean up of all 4 files. Add incoherent incoherent comment at top of manage_db.py.

As a result of the code de-duplication create_db.py should be usable with the tool shed now.

Will be refactoring lib/galaxy/model/orm/scripts.py to work with new tool shed install database - it will be good to have a place to test these and allow manage_db.py and clean_db.py to work immediately.
2013-12-05 00:20:54 -06:00
John Chilton 962a53e544 Allow run_unit_tests.sh to execute all unit tests in test/unit.
Basically adds __init__.py files to each subdirectory so nose detects these as Python module directories. Also modify dynamic loading of modules in Carl's test cases so the test case can be run with any cwd - including the Galaxy root directory as run_unit_tests.sh will use.

This should roughly double the number of unit tests buildbot runs.
2013-12-04 11:46:32 -06:00
John Chilton f6f2d64a8a Load plugins in a deterministic order.
Fixes plugin unit tests on my dev box and is a good idea overall anyway.
2013-12-04 11:42:43 -06:00
Aysam Guerler edd8892a4a UI: Fix iconbar css 2013-12-05 00:05:20 -05:00
Aysam Guerler 894ec4a475 Grids: Fix tag click event 2013-12-04 19:59:07 -05:00
Aysam Guerler 250dd672bd Grids: Refactoring and fixes
iG: removed templates/grid_common.mako
2013-12-04 18:51:44 -05:00
Greg Von Kuster 6d55496418 Fixes for rendering tools and invalid tools in the tools container. 2013-12-04 15:48:16 -05:00
Greg Von Kuster 340762bbf1 Correctly use the initialized test_environment dict when running the tool shed's install and test framework and additional code cleanup for the framework. 2013-12-04 15:07:39 -05:00
Greg Von Kuster 24ee75b05c Actually skip inspection of repository revisions that have the skip_tool_test set in the Tool Shed instead of just stating we're going to... 2013-12-04 11:01:32 -05:00
Greg Von Kuster 59e949f353 Final fixes for rendering installation errors in the tool test results container in the tool shed. 2013-12-04 10:29:59 -05:00
Greg Von Kuster 22df2c0db9 More fixes for rendering tests that resulted in installation errors within the tool test results container in the tool shed. 2013-12-04 09:49:17 -05:00
Dave Bouvier 88ec4149d2 Update test 0450 to also verify the list of testable revisions returned by the repository_revisions tool shed API controller. 2013-12-04 08:41:23 -05:00
Greg Von Kuster ea8d67499d Fix for displaying installation errors in the Tool Shed's tool test results container. 2013-12-03 16:15:03 -05:00
Greg Von Kuster 2f56fc479e Fix tool shed unit test I broke with a recent commit. 2013-12-03 15:52:46 -05:00
Greg Von Kuster 00857760f0 Fixes for filtering repository revision to be tested by the Tool Shed's install and test framework, and a new Tool Shed API script to enable analyzing the the Tool Shed's install and test framework. 2013-12-03 15:16:14 -05:00
Carl Eberhard 1a766e25a1 History panel: allow anon use of dataset search 2013-12-03 15:13:17 -05:00
Carl Eberhard e377fbcfc7 History panel: allow searching datasets: name, tags, annotation, dbkey, file_ext, blurb, and info will be searched when enter is pressed in the search field, include whitespace by enclosing search term in double quotes, allow specifying which field to search by using the idiom 'field=term' where field is any of the previous field names (or more user-centric aliases: database for dbkey, etc.), (GUI filters as an alternate means to accomplish field specifiers to be added soon); Allow showing and hiding search input; Tweak style on panel-header buttons; pack scripts 2013-12-03 15:03:32 -05:00
John Chilton 188dcb17e8 Another attempt to fix nosetests' handling of rods.py.
Further dirtying @dannon's code :(, sorry.
2013-12-03 12:59:35 -06:00
John Chilton 209243aa67 Remove unused get_missing_tool_dependencies in install_and_test_tool_shed_repositories/base/test_db_util.py.
Looks to have been replaced by method with same name in install_and_test_tool_shed_repositories/functional_tests.py and would throw a NameError on repository_id if ever used.
2013-12-03 11:54:56 -06:00
John Chilton ae34c75c7b Merged in jmchilton/galaxy-central-fork-1 (pull request #270)
Delay potential problems with fluent logger dependencies until fluent logger used.
2013-12-03 10:39:21 -06:00
Greg Von Kuster 28d2c1bb38 Code cleanup for rendering the tool test results container in the tool shed. 2013-12-03 11:32:00 -05:00
Dannon Baker 8bb209cae3 Merged in jmchilton/galaxy-central-fork-1 (pull request #269)
Object Store dependency refactoring, testing, and added LWR implementation.
2013-12-03 11:12:57 -05:00
Greg Von Kuster 8192156632 Refactoring code cleanup for installing tool dependencies from the tool shed into Galaxy. 2013-12-03 11:01:20 -05:00
Greg Von Kuster a91ccbf8fb Fix for determining if a required tool dependency is in an error state. 2013-12-03 09:35:05 -05:00
Aysam Guerler 8a3ff9163a UI: Improve masthead, simplify code 2013-12-03 01:42:58 -05:00
Greg Von Kuster b2c873bc1e Fix type in my last commit - thanks John! 2013-12-02 21:35:00 -05:00
Greg Von Kuster 93953d0a75 Tweak changeset 5b8c91e4183664c90f4d95699ab971e674ffd67d which created symlinks to a required tool dep endncy env.sh file for dependent tool dependencies being installed. This approach was better than the previous approach which parsed the requried repository's tool_dependencies.xml file to create the env.sh file. This changeset uses a slightly different approach: it creates an env.sh file for the dependent tool dependency whose first line "sources" the required tool dende pendcy's env.sh file. This allows for the dependent env.sh file to be managed by its tool dependency (e.g., its tool dependency may require additional env.sh paths beyond those contained in the requyired tool dependency's env.sh file). This changeset also handles sysncing the database with the file system when tool dependencies are being installed when handling a complex repository dependency definition. This process used to be handled only when not dealing with a complex repository dependency definition. This fix should correct problems encounted by the Tool Shed's install and test framework which were introduced in 5b8c91e4183664c90f4d95699ab971e674ffd67d. 2013-12-02 20:36:59 -05:00
John Chilton 32d5ef1820 Delay problems with fluent logger dependencies until fluent logger used. 2013-12-02 15:15:16 -06:00
John Chilton 4bc289707a Fix test case in test/unit/test_tool_deps.py which fails if modulecmd is unavailable. 2013-12-02 14:57:00 -06:00
John Chilton 258f5b36b3 Tell nose functions in lib/galaxy/tools/test.py are not unit tests. 2013-12-02 14:57:00 -06:00
Daniel Blankenberg 422ea67297 Fix for missing eggs.require in lib/galaxy/exceptions/__init__.py. 2013-12-02 14:48:30 -05:00
John Chilton 58dd0fde13 Fix default behavior of composite archival broken with previous changeset.
Other small tweaks this implementation.
2013-12-02 12:40:43 -06:00
John Chilton 159adbbd19 Add an LWR object store implementation.
This changeset implements an object store implementation that delegates to a concrete remote object store instance via an LWR server. Can utilize existing LWR security mechanisms and multiple transport options.

Updates the Galaxy LWR client through LWR changeset 2333f57.

This changeset contains no tests for this new implementation, but the LWR contains the same code along with an integration test that spins up a temp LWR to test against - this test case demonstrating the lwr object store client and server can be found here : https://bitbucket.org/jmchilton/lwr/src/default/test/lwr_objectstore_test.py.
2013-12-01 19:07:04 -06:00
John Chilton a4c38261d1 Add test cases for some basic object store types.
Namely tests for disk, hierarchical, and distributed stores - as well parsing.
2013-12-01 19:07:04 -06:00
John Chilton f745c44f28 Update objectstore XML parsing to stdlib's ElementTree implementation.
Eliminates dependency on older elementtree egg.
2013-12-01 19:07:04 -06:00
John Chilton 7b053cee87 Make sqlalchemy dependency in object store optional unless create is used. 2013-12-01 19:07:04 -06:00
John Chilton 622e3ae0a4 Use relative imports in objectstore code.
Goal is to enable the whole module to be placed in lwr.objectstore.
2013-12-01 19:07:04 -06:00
John Chilton 32db70a2a7 More work on objectstore dependencies.
Be explicit about what in galaxy.util is being used, don't fail if galaxy.eggs is unavailable - assume the actual dependencies will be there (boto and rods) if not fail just a little later. If nothing else, this should fix some failing buildbot tests (nosetests records a failure if it cannot import a file and it cannot import the s3 or irods object store files because of these imports).
2013-12-01 19:07:04 -06:00
John Chilton d02bba0567 Refactor jobs.Sleeper into its own module.
This eliminates explicit dependency between galaxy.objectstore and galaxy.job - with the ultimate goal of being able to utilize all object store functionality except dataset creation from a remote LWR instance with minimal dependencies.
2013-12-01 19:07:04 -06:00
John Chilton 09bf7116ea PEP-8 fixes for object store module. 2013-12-01 19:07:04 -06:00
John Chilton cda736de98 Refactor directory_hash_id into its own module.
Also add PEP-8 cleanup and unit tests. This eliminates explicit dependency between galaxy.objectstore and galaxy.model - with the ultimate goal of being able to utilize all object store functionality except dataset creation from a remote LWR instance without a database connection.
2013-12-01 19:07:03 -06:00
John Chilton 226f468b40 Update LWR client through LWR revision acecc74f7016.
Mostly small modifications related Python 3 compat. (no iteritems, diff. StringIO, exception syntax, urllib diffs,) and improved handling of unicode data.
2013-12-01 06:14:32 -06:00
Jeremy Goecks 82467b0b96 Automated merge of local changesets with default branch. 2013-11-30 17:00:44 -05:00
Jeremy Goecks da0967233d Trackster: (a) use colors to denote track state and (b) add and use function to show messages. 2013-11-30 17:00:01 -05:00
Nate Coraor cc0a59eb9e merge stable. 2013-11-30 12:47:19 -05:00