Implement structured tool test data.

Rather than relying solely on exceptions back to nose/test framework - add option (--structured_data_report_file) to run_tests.sh that causes a bunch of detailed data to be dumped to the specified file in a very structured way. Includes full to_dict of the job from the API which in turn includes job metrics, command-line, job's standard error and outputs (instead of the test frameworks), as well as the tool inputs, and exceptions broken out for tool execution versus output checking.

Its all indexed in the file by the test id (without the actual test toolbox depending on knowing the test id) - so one could pair this information with the XUnit output to produce much more detailed breakdowns of the tests.

scripts/functional_tests.py

@@ -55,6 +55,7 @@ from functional import database_contexts
 from base.api_util import get_master_api_key
 from base.api_util import get_user_api_key
 from base.nose_util import run
+from base.instrument import StructuredTestDataPlugin
 
 import nose.core
 import nose.config
@@ -439,6 +440,7 @@ def main():
                     user_api_key=get_user_api_key(),
                 )
             test_config = nose.config.Config( env=os.environ, ignoreFiles=ignore_files, plugins=nose.plugins.manager.DefaultPluginManager() )
+            test_config.plugins.addPlugin( StructuredTestDataPlugin() )
             test_config.configure( sys.argv )
             result = run_tests( test_config )
             success = result.wasSuccessful()