Commit Graph
200 Commits
Author SHA1 Message Date
John Chilton a253d52827 Try separate amqp connection from database for integration testing.
In case this is what is holding on to the connection causing tests to fail.
2019-08-15 14:26:26 -04:00
John Chilton ef29b72e00 Integration test for 'outputs_to_working_directory' with Pulsar. 2019-07-16 10:23:33 -04:00
mvdbeek ff0d1f142e Add test for k8s_walltime_limit 2019-07-10 17:16:08 +02:00
Nicola Soranzo ea32667142 Merge branch 'release_19.05' into dev 2019-07-09 18:43:43 +01:00
Nate Coraor caef1d6711 Fix datatypes_conf.xml.sample path for upload integration test 2019-07-07 13:10:37 +02:00
mvdbeek 54a60a6aaa Looks like we never actually cancel the job? 2019-06-26 15:53:25 +02:00
mvdbeek 5016dedac7 Add test that ensures cancelling job in admin interface works 2019-06-26 12:08:49 +02:00
Dannon 7639566685 Merge pull request #8161 from mvdbeek/fail_job_if_queueing_job_fails
Fail job if queueing job fails
2019-06-19 13:52:00 -04:00
Martin Cech 463a1a19e5 Merge pull request #7835 from jmchilton/k8s_staging
Kubernetes 2-container pod staging.
2019-06-19 10:59:57 -04:00
John Chilton a7e394af27 Merge pull request #8181 from mvdbeek/fix_job_fail_fail_invalid_tool
Fix failure to fail job when tool is unavailable
2019-06-18 15:33:53 -04:00
mvdbeek 4c83abc41f Raise JobMappingException when tool has been removed
That fixes the underlying problem in
https://github.com/galaxyproject/galaxy/issues/8141
but doesn't implement the outer try/except suggested
by @natefoo.
2019-06-18 17:53:36 +02:00
mvdbeek d0bf7c9767 Add integration test for job failure behavior when a tool is removed while a job is queued 2019-06-18 17:47:09 +02:00
Marius van den Beek 4d2d0cafb5 Merge pull request #8042 from VJalili/os_tests
Extend ObjectStore integration tests
2019-06-18 11:46:55 +02:00
vahid a4656c2654 Remove \n from test content strip. 2019-06-17 09:46:22 -07:00
vahid 428a29dac4 Remove an unnecessary tab strip. 2019-06-17 09:29:09 -07:00
VahidandMarius van den Beek a2bfba12a1 Update test/integration/objectstore/test_jobs.py
Co-Authored-By: Marius van den Beek <m.vandenbeek@gmail.com>
2019-06-17 09:08:05 -07:00
VahidandMarius van den Beek 1dbca872d5 Update test/integration/objectstore/test_jobs.py
Co-Authored-By: Marius van den Beek <m.vandenbeek@gmail.com>
2019-06-17 09:07:22 -07:00
John Chilton 1753e7752e Improvements to Kubernetes Pod Staging runner approach.
- Rev pulsar-galaxy-lib for improved error messages.
- Rev to a newer container - one that actually logs.
- More use of host.docker.internal to improve testing robustness.
- Add documentation for overriding container to use.
2019-06-17 11:47:27 -04:00
John Chilton ac1b25ed4c Kubernetes 2-container pod staging.
The tests included here are really very manual and brittle tests, but I'm not sure how to do much better. See documentation in the file docstring for more information.
2019-06-17 11:47:27 -04:00
mvdbeek 7ae75e9a89 Test that failure to queue job results in job error 2019-06-17 16:48:35 +02:00
mvdbeek ab952886b4 Include .xml in job_config_file 2019-06-16 17:26:10 +02:00
John Chilton 2e3165cb7f clean-fix-page-api - integration API test case ensure DB contains unencoded IDs 2019-05-29 13:43:49 -04:00
vahid 4b3dbc6bcb Add a todo comment. 2019-05-27 11:15:10 -07:00
vahid ffc8b87ee9 Extend ObjectStore integration test to assert the content of datasets. 2019-05-25 19:47:13 -07:00
vahid 216f31a2f1 Refactor a test name. 2019-05-25 17:31:01 -07:00
vahid 28c8943919 Assert the exact number of files in the OS jobs output than a range. 2019-05-25 17:30:14 -07:00
vahid 275cc365a5 Move some code from test method to setUp method in OS integration tests. 2019-05-25 17:26:14 -07:00
vahid 6acb9e50eb Remove objectstore from its integration tests filenames. 2019-05-25 17:20:00 -07:00
vahid 52596d186e Organize ObjectStore integration tests under a dedicated package. 2019-05-25 16:36:50 -07:00
Dannon f6011bab5b Merge pull request #7992 from jmchilton/more_packages
Add galaxy-tool-util and galaxy-job-metrics packages.
2019-05-20 16:36:11 -04:00
John Chilton 6000f79b6d Fix extra newlines in peek code.
Behavior changes:
 - Now includes a trailing new line if the input contained a trailing newline.
 - Now returns only as many lines as are present if the file contains fewer lines than LINE_COUNT.
2019-05-17 15:41:13 -04:00
John Chilton 939e7774a8 Create galaxy-tool-util package.
This is (so far a subset of) the tool utilities from galaxy-lib. galaxy-lib mocked out a fake galaxy.tools to allow these to all exist below the galaxy.tools - but this was a terrible hack - in order for the new packages to be true subsets of Galaxy they need to be refactored into a new package that doesn't depend on models, SA, galaxy.jobs, etc...

[x] galaxy.tools.deps -> galaxy.tool_util.deps
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.cwl -> galaxy.tool_util.cwl
[x] galaxy.tools.loader -> galaxy.tool_util.loader
[x] galaxy.tools.fetcher -> galaxy.tool_util.fetcher
[x] galaxy.tools.locations -> galaxy.tool_util.locations
[x] galaxy.tools.parser -> galaxy.tool_util.parser
2019-05-16 16:45:25 -04:00
John Chilton 9913ecdee3 Fix extra newlines in peek code.
Behavior changes:
 - Now includes a trailing new line if the input contained a trailing newline.
 - Now returns only as many lines as are present if the file contains fewer lines than LINE_COUNT.
2019-05-15 15:56:06 -04:00
Nicola Soranzo 97a3a75339 Merge branch 'release_19.05' into dev 2019-05-13 00:15:00 +01:00
Nicola Soranzo 196e000191 Fix upload of gzipped VCF files
which were mistakenly sniffed as `vcf_bgzip`.

Fix Fix https://github.com/galaxyproject/galaxy/issues/4892 .
2019-05-10 19:47:48 +01:00
Martin Cech 375e65ef2b add default to test job_conf 2019-05-08 11:55:13 -04:00
John Chilton f81c41895b Allow YAML configuration of job_conf.xml. 2019-05-07 08:23:30 -04:00
John Chilton 5531ce4bc0 Refactor job_conf -> dictifiable: <plugins> -> runners: 2019-05-07 08:22:00 -04:00
John Chilton 49757608de Fix kubernetes test for job I/O separation. 2019-05-03 14:40:47 -04:00
John Chilton 754ca26f92 Fix failing integration test.
https://jenkins.galaxyproject.org/job/docker-integration/9044/testReport/junit/test.integration.test_job_recovery/JobRecoveryBeforeHandledIntegerationTestCase/test_recovery/

Likely transiently broken with #7874
2019-05-03 08:38:33 -04:00
John Chilton c6fcd051c8 Cleanup integration test configuration code.
Remove copy and paste problems, remote excess configuration unrelated to the what is being tested (handler configuration, multiple worker counts, etc..).
2019-05-02 08:45:11 -04:00
John Chilton faae919af1 Add file missing from #7694 2019-05-02 08:27:04 -04:00
Nicola Soranzo d53112aa43 Use `yaml.safe_load() instead of load()`
See https://msg.pyyaml.org/load
2019-04-23 16:50:55 +01:00
John Chilton 74bf94f445 Fix kubernetes integration tests for Docker on Mac. 2019-04-16 08:28:36 -04:00
John Chilton 74a6615488 Fix pulsar with metadata_strategy == 'directory'. 2019-04-08 16:30:15 -04:00
John Chilton 4527293ce4 Refactor IntegrationTestCase to allow integration test functions.
I want to be able to make more integration tests like test_pulsar_embedded.py, where we just define a configuration and then some tool tests to run. In particular this will be useful for extended metadata testing of the most interesting tools.
2019-04-04 14:58:55 -04:00
John Chilton 0fe13b7e5a Seperate tool and job script standard I/O.
This should allow Galaxy to reason about what the tool reports vs. what dependency resolution and metadata reports, allow us to enable logging during metadata collection, and allow us to reason about the tool's I/O from inside the job script during cleanup/metadata collection at the end.
2019-03-04 15:39:07 -05:00
mvdbeek b0f3d92149 Don't use skip_unless_docker decorator
This is handled in setupClass. Also drop
unused skip_unless_singularity.
2019-03-02 12:19:14 +01:00
mvdbeek e293a74e66 Add test for tool using python dependencies 2019-02-19 20:17:16 +01:00
mvdbeek 7cf161ba01 Allow adding multiple volume claims 2019-02-19 20:17:16 +01:00