- Replace --skip-successful with two new mutually exclusive options --skip-previously-successful and --skip-previously-executed.
- Enhance argparse usage for mutual exclusivity of history options also.
- I noticed in some tests of collection operation tools I will sometimes get the ToolInputNotReady problems - I refactored this to be a MessageException with a specific error code that can be checked and retried later by the client.
- Allow the client to specify test-data directories to check against - many of the bundled tools depend on https://github.com/galaxyproject/galaxy-test-data for instance but production instances will not have this available.
- Improve log message when writing outputs to standard output.
- Some older toolshed tools rely on Galaxy's bundled test data - so when generated paths to test-data check this also even if a repository directory is found.
- Refactor the entry point to allow passing in tool filters - I want to develop a downstream script that will test all the tools of a workflow.
- Option to skip if reference data is annotated.
- Try to build more abstractions to allow reuse with ephemeris.
- Enhance to allow parallelization and enhnaced reporting like ephemeris.
- Allow testing a whole tool panel.
- Fix bugs in imported ephemeris logic (skipped failed tests and skipped tests for in counts/reporting for instance).
- Unit tests for abstractions.