Commit Graph
64 Commits
Author SHA1 Message Date
Nicola Soranzo c38cdb9dcf Use bash for run_tests.sh 2021-01-04 02:59:48 +00:00
Nicola Soranzo 57ffefa395 Fix assigning default value to variables in `run_test_wrapper.sh`
`GALAXY_TEST_UID`, `GALAXY_VIRTUAL_ENV` and `GALAXY_TEST_DATABASE_TYPE`
were not assigned the default value due to using `:-` instead of `:=` .

Also clean up and fixes suggested by `shellcheck`.
2020-10-08 13:40:06 +01:00
Nicola Soranzo 9eae2c58cf Always set HOME to the target user's dir when calling sudo -E 2020-04-13 00:51:39 +01:00
mvdbeek 0a2ed24a9d Skip migrations 2020-04-12 22:39:23 +01:00
mvdbeek 74a27f3de0 Move docker image build to ubuntu 18.04, drop unused stuff 2020-04-12 22:39:23 +01:00
Nicola Soranzo 55df890a5f Use become instead of sudo in Ansible playbook
`sudo` is deprecated since Ansible 1.9 .
2019-11-01 12:11:22 +00:00
Nicola Soranzo d1400d4864 Simplify Python deps installation in Dockerfile
Also remove pip cache to save space.
2019-11-01 12:10:06 +00:00
Nicola Soranzo abe695cd77 Small Dockerfile fixes
- `MAINTAINER` is deprecated
- Ports for `EXPOSE` don't need a starting colon
- We use the `psycopg2-binary` wheel in
  `lib/galaxy/dependencies/conditional-requirements.txt`
2019-06-04 19:55:40 +01:00
mvdbeek 1c38a4a075 Fix 'postgres' dialect name has been renamed to 'postgresql' deprecation warning 2019-04-24 10:49:23 +02:00
mvdbeek 087070c72c Still need python3-dev for uwsgi 2019-03-01 17:50:50 +01:00
mvdbeek a0fd6438d9 Directlyy setup virtualenv in /galaxy_venv, saves 700MB 2019-03-01 14:27:54 +01:00
mvdbeek 3bed43fb84 Don't add compiler-stack (will still come in ansible), use prebuilt singularity 2019-03-01 14:27:09 +01:00
mvdbeek d9ac24a982 Don't install slurm, it isn't used in any test 2019-03-01 12:13:18 +01:00
mvdbeek bf8dbdade3 Slim down testing image 2019-03-01 12:11:53 +01:00
mvdbeek bed8b54af6 Only run integration tests with --privileged 2019-01-06 15:11:11 +01:00
mvdbeek 06f5abe1bc Install singularity 3.0.1 from source 2019-01-06 15:11:11 +01:00
mvdbeek a03f8bdffd Test singularity exec as Galaxy user 2019-01-06 15:11:10 +01:00
mvdbeek 44d73f72c8 Update Dockefile and run_test_wrapper.sh
We use the Galaxy users' home dir for HOME.
Otherwise os.environ.get('HOME') would return '/home/galaxy',
but jobs run would see /galaxy.
2019-01-06 15:01:31 +01:00
mvdbeek 83473f075d Update testing docker image; drop mysql tests, add singularity 2019-01-06 15:01:31 +01:00
mvdbeek 2527038ffc Mount in run_tests script at container runtime
This allows changing variables in the script without rebuilding the
container
2018-08-10 22:08:15 +02:00
mvdbeek eb1cb57f42 Fix up Dockerfile for bdbag installation 2018-08-10 22:08:15 +02:00
mvdbeek 39e1877cce Explicitly create a python 3 virtualenv 2018-08-10 22:08:15 +02:00
mvdbeek 7342a7ebbc Avoid prepopulating database twice 2018-08-10 22:08:15 +02:00
mvdbeek bd92136841 Setup pytest python3 API testing 2018-08-10 22:08:15 +02:00
John Chilton 23762f48a3 Docker fixes - release 18.05 edition.
- Rev to new container with 18.05 dependencies pre-installed.
- Enable caching of Yarn stuffs to enable
- Redo fix for git not working in node container - was mounting /etc/passwd but that wasn't compat. with Mac OS X, setting these environment variables are.
- Rearrange startup script a bit to make it load faster (wait for Selenium right before the tests not before waiting for DB).
- Fix random error in logs related to Selenium trying to read something in /root by passing -H to set the Selenium user's home directory.
2018-05-01 23:47:27 -04:00
John Chilton f6342616eb Fixes for testing Dockerfile recipe.
The current Dockerfile build is broken because Selenium is not compatible with the latest chromedriver it seems (and the version in galaxy/testing-base:18.01.4 isn't compatible with the latest stable Chrome - version 65). I can't get older versions of Chrome to install with the current apt source but this does at least pin the version of chromedriver.

Longer term it would be good to have the version of chrome we target to be pinned also, I hate that this Dockerfile isn't reproducible.
2018-03-25 15:45:20 -04:00
John Chilton 14f0185b21 yaml_config - change test wrapper to work with either ini or yml in container. 2017-12-06 20:28:20 -05:00
John Chilton 7bae23e105 yaml_config - update code base for converting galaxy.ini.sample to YAML. 2017-12-06 20:28:20 -05:00
John Chilton 459a9621e2 Fix run_test_wrapper to reflect Galaxy database isn't created with UTF8 encoding. 2017-10-30 23:58:14 -04:00
John Chilton 5f15889ca1 Another round of Selenium enhancements and fixes for 18.01.
- Bake Selenium (chrome, chrome-wrapper, xvfb, and Selenium server) into Docker test image. (1)
- Correct usage of common_startup.sh to fetch dev wheels (don't use pip directly).
- Fix/enhance the test wrapper file to not set GALAXY_CONFIG_OVERRIDE_DATABASE_CONNECATION - this prevents integration database templating (#4887) from working with the Docker image.
- Update target Dockerfile.

1) The Docker compose setup for Selenium tests currently used by Jenkins is nice in that it uses official Selenium and Postgres Docker images - but it is problematic in that it takes more resources than the other single container Docker jobs, it doesn't cleanup as nicely, it doesn't have a pre-migrated database or pre-installed dependencies so it takes longer to run, and isn't easily exposed to developers via run_tests.sh. A more pragmatic Jenkins job based on this work should be runnable for every PR - the current variant simply takes too long and requires too many resources.
2017-10-30 14:48:26 -04:00
John Chilton c9799013ee Updates and enhancements for the Docker testing Dockerfile.
- Target dev on Github instead of stable on bitbucket for base dependencies and migrations.
- Update to Ubuntu 16.04 ahead of trying to merge in Selenium support (should be a bit slimmer without the TS requirements layer also).
- Use fancy new Node compatible with yarn.
2017-10-27 13:13:50 -04:00
John Chilton b1f12d41f6 Simplify run_test_wrapper.sh per @natefoo comments.
https://github.com/galaxyproject/galaxy/pull/3755/files#r106182107
2017-03-20 09:12:33 -04:00
John Chilton d6654838f3 Fix pip install cache inside Galaxy testing container.
It is causing Jenkins to fail throughout on https://github.com/galaxyproject/galaxy/pull/3179.
2017-03-14 16:28:38 -04:00
John Chilton d1eab2685f Provide a fallback for GALAXY_TEST_UID if manually running Docker tests. 2017-03-14 16:28:36 -04:00
John Chilton 5c48402b02 Various fixes for test image Docker user switching.
- Fix if testing as user with GID 109 (fixes #3425).
- Fix if testing as a user with any UID or GID that already exists in the container.
- More logging to indicate the "problems" being printed to standard output in these cases are not problems.
- Fix sqlite being readonly in the container for the test user.
2017-01-17 16:56:51 -05:00
John Chilton 09f0272ede Document how to create Docker testing images.
With fix noted by @martenson.
2017-01-10 15:54:35 -05:00
Björn Grüning 64faeece93 Merge pull request #3286 from jmchilton/slim_test_dockerfile
Slim down testing ``Dockerfile``.
2017-01-08 17:50:05 +01:00
John Chilton b75ee68d9f Run Galaxy tests in --dockerize mode as UID of tester.
Fixes #1541 and should really help Jenkins clean up after itself.
2017-01-05 14:53:10 -05:00
John Chilton a78ae1bb71 Fix tool shed pre-population against current dev.
I don't know how this ever worked to be honest - but these changes make a lot of sense. I think there was another bug somewhere that prevented this bug from exhibiting itself.
2017-01-05 14:52:06 -05:00
John Chilton 433b993eca Slim down testing `Dockerfile`.
- Remove broken CasperJS from testing Dockerfile.
- Remove multi-process mode.

Multi-process mode was difficult to maintain and the last time I did testing at scale I found docker-galaxy-stable to be much more useful and easy to use. The test framework now supports GALAXY_TEST_EXTERNAL again so it should be easy enough to rig something up with docker-compose that actually uses a best practice container for scaling tests such as those in ``test/manual``.
2016-12-19 10:58:36 -05:00
John Chilton 6135d7ea56 Update to phantomjs 2.1 and official sources. 2016-02-29 14:36:40 +00:00
John Chilton 78b1f9af37 Dockerfile testing improvements.
- Use wheel from inside container.
- Update to the latest pre-release phantom and casper dependencies (they seem more stable).
2016-02-29 13:19:41 +00:00
Dave B 5f175e3503 Update run_test_wrapper.sh 2016-01-22 10:45:33 -05:00
Martin Cech f8d95abf06 Merge pull request #1263 from nsoranzo/dev_tool_shed_fixes
Extend the logging of tool dependency status changes.
2015-12-10 20:49:17 -05:00
Martin Cech c3e4ae11b0 set client_encoding for TS dockerized test db 2015-12-09 11:37:31 -05:00
Nicola Soranzo a22c09b11f Fix typos. 2015-12-08 16:56:27 +00:00
Martin Cech 2dcb92aa0e Merge pull request #942 from davebx/docker
Enable dockerized toolshed tests.
2015-11-13 11:26:24 -05:00
Nate Coraor 4a05d5ea12 Merge branch 'dev' of https://github.com/galaxyproject/galaxy into smash_eggs 2015-10-20 18:59:06 -04:00
Dave B 1766b896e3 Merge -dev. 2015-10-20 13:02:09 -04:00
carlfeberhard c4edd0b32e Merge pull request #952 from martenson/postgres-docker-client-encoding
fix the docker db client_encoding to not be ascii (default)
2015-10-20 12:21:37 -04:00