Lance Parsons
b4c9f2fb10
Added pkg_resources to load required Mako package
2014-12-03 14:50:56 -05:00
Nate Coraor
acd078a65c
merge.
2014-09-15 16:57:28 -04:00
Nate Coraor
8fadc6392b
Rename universe_wsgi.ini -> galaxy.ini everywhere.
2014-09-15 16:43:51 -04:00
Nate Coraor
4306560237
Remove unused "Main" versions of cleanup convenienence wrappers.
2014-09-15 15:34:03 -04:00
Dannon Baker
038f6dc6d5
Switch to_json_string/from_json_string in galaxy/scripts.
2014-09-09 10:04:28 -04:00
Kyle Ellrott
47f0f822f0
Refactoring work to add in Workflow UUIDs
2014-08-20 14:10:43 -07:00
Dave Bouvier
5bdb75aa82
Correct usage of "it's" versus "its".
2014-04-17 15:49:32 -04:00
Kyle Ellrott
e4f45e04e3
Adding script to generate UUIDs for datasets where the value is null. This is to backfill previously generated records (from now on UUID will be generated during creation)
2014-03-04 15:46:10 -08:00
Nate Coraor
5a8c6457b9
Fix username argument to PostgreSQL connection in pgcleanup.py
2014-01-09 10:46:01 -05:00
Dannon Baker
eed1f76001
Merged in lance_parsons/galaxy-central-pull-requests/dataset-cleanup (pull request #158 )
...
Basic administrative dataset cleanup script
2013-09-10 13:14:10 -04:00
Lance Parsons
91ba836a00
Fix unicode issue when printing history names in cleanup_datasets.py script
2013-07-22 14:24:13 -04:00
Nate Coraor
c1fb32d7c6
Update pgcleanup.py for dialect name change.
2013-05-29 16:16:11 -04:00
Lance Parsons
d37fabc834
Fix admin_cleanup_datasets.py for copied datasets
2013-04-18 15:43:00 -04:00
Lance Parsons
bd8cd477bc
Basic administrative dataset cleanup script
2013-04-18 11:24:09 -04:00
Nate Coraor
1e2256fe0e
pgcleanup: Print a useful message if no options are given.
2012-10-01 13:45:37 -04:00
Nate Coraor
8193489dda
pgcleanup/set_user_disk_usage: set usage to 0, not null, when the user has no active data.
2012-09-28 16:11:38 -04:00
Nate Coraor
459d3a2c1d
More pgcleanup.py fixes and addition of cleanup event tables for library items.
2012-09-17 12:51:17 -04:00
Nate Coraor
71d7f7c132
Distributed object store fixes for pgcleanup.py.
2012-09-11 12:22:03 -04:00
Nate Coraor
0e1b041cde
Bug fixes for pgcleanup.py
2012-09-10 16:59:33 -04:00
Nate Coraor
c8e49cdd6d
Bugfix for pgcleanup.py
2012-09-10 14:07:05 -04:00
Nate Coraor
e19092e9c5
Add a dataset cleanup script that's optimized for (and compatible only with) PostgreSQL 9.1+. Also add a bunch of tables for logging all cleanup events, which makes reversing such events trivial.
2012-09-10 12:03:23 -04:00
Nate Coraor
35dd4e1ef9
Fix for cleanup_datasets.py when database_connection is the uncommented default in the config file.
2012-04-16 10:07:10 -04:00
Nate Coraor
9aed5a36d8
Fix for dataset cleanup scripts and object store.
2012-01-31 14:07:14 -05:00
Nate Coraor
3a1526ac8a
Decrease user disk usage when files are removed from disk by the cleanup_datasets.py.
2011-08-22 16:19:49 -04:00
Greg Von Kuster
581c3d9c67
Another patch from Assaf Gordon for the cleanup_datasets.py script.
...
This patch adds messages for the "purge histories" step:
1. A message is printed when processing a new history (so that the user can tell to which history the following dataset/hda messages belong).
2. in "info_only" mode, a message is printed about each deleted history
3. in "info_only" mode, a message is printed for each HDA that is checked
4. The message for HDA is changed to include the associated dataset id.
2011-07-14 15:58:06 -04:00
Greg Von Kuster
8eb0033904
Add patch from Assaf Gordon to the cleanup_datasets.py script. The changes are:
...
1. If a dataset is skipped (because it's shared/cloned and was already process), no message is printed at all.
2. If a dataset can not be deleted because it is shared, and one instance is not marked as "deleted", a proper message is printed.
3. If a dataset has metadata files, the message is changed depending on "info_only" and "remove_from_disk" flags.
4. The final summary message is slightly changed.
2011-07-13 09:39:02 -04:00
Greg Von Kuster
40d02d1e7b
Add patch from Assaf Gordon to fix the cleanup_dataset.py script, correcting the behavior of setting the info_only flag to True when running delete_datasets.sh and purge_datasets.sh.
2011-07-06 09:52:28 -04:00
Ross Lazarus
d53c3e984f
Backed out changeset 48bbe32beefe which introduced a whole bunch of unintended reversions from a broken hg repository
...
This is a backout of commit 5765
2011-07-06 09:44:56 +10:00
Ross Lazarus
86b55bb0c0
branch merge
2011-07-05 12:40:43 +10:00
Greg Von Kuster
b0b5df4e93
Add a purged column to the LibraryDataset table - a LibraryDataset is marked purged when all associated LibraryDatasetDatasetAssociations are marked deleted. Fix the cleanup_datasets.py script to more correclty handle the lifecycle of LibraryDatasets.
2011-02-09 15:42:09 -05:00
Kanwei Li
7736a34123
Add default file_path to cleanup_datasets.py script. Closes #376
2010-10-07 14:15:19 -04:00
Greg Von Kuster
91d97585c1
Fix for cleanup_datasets.py - add app param to the _purge_dataset method signature.
2009-11-14 20:32:41 -05:00
Greg Von Kuster
8f6e8213a0
Fix most of the db flushes to be compatibel with sqlalchemy 05. Add the _monkeypatch_query_method() back into assignmapper due to a single object.get() method in the MetadataCollection class since Metadata has no current hook into mapping.context ( the sqlalchemy session ). There a 4 flushes in metadata,py and 20 flushes in model.__init__.py that still use the _monkeypatch_session_method in assignmapper due to the same issue, but all other flushes are fixed.
2009-11-11 15:59:41 -05:00
Greg Von Kuster
1c4070ea92
Eliminate printing PYTHONPATH to stderr in the cleanup_datasets.py script.
2009-11-04 13:09:37 -05:00
Greg Von Kuster
da149187b4
Bug fix for cleanup_datasets.py - use app.sa_session instead of self.sa_session.
2009-11-02 09:54:18 -05:00
Greg Von Kuster
29b55b8707
Make sqlalchemy queries use sa_session.query( object ) rather than object.query(). This eliminates the need for the _monkeypatch_query_method() in assignmapper.py. Also eliminate the need for the _monkeypatch_session_method() for everything except object.flush() - I just ran out of time and will handle flush() asap. I also eliminated the .all() call on several queries where it was not necessary - should improve performance. I fixed several bugs I found as well.
2009-10-22 23:02:28 -04:00
Greg Von Kuster
18c95bb622
Improve logging for cleanup_datasets.py script.
2009-09-24 21:17:32 -04:00
Greg Von Kuster
947491b270
More improvement in cleanup_datasets script - will take significantly less disk, and may be faster.
2009-09-24 16:52:15 -04:00
Greg Von Kuster
a40bf886f1
Performance improvements in delete_datasets method in cleanup_datasets script ( hopefully enough ).
2009-09-24 12:21:41 -04:00
Nate Coraor
2abf463a95
More fixes for cleanup_datasets.py
2009-09-15 12:57:17 -04:00
Nate Coraor
f11dcd9781
Fix path mangling in cleanup_datasets.py
2009-09-14 12:23:16 -04:00
Greg Von Kuster
5665f1dbaf
Fix for cleanup_datasets.py script.
2009-09-11 11:26:26 -04:00
Daniel Blankenberg
52d1bc065a
Enable the cleanup_datasets script to purge Dataset Instances (HDAs, LDDAs) and mark base datasets as deleted without requiring the container (history, library/folder) to be deleted.
2009-08-10 11:53:28 -04:00
Daniel Blankenberg
f4a7dbc436
Add a new flag -f/--force_retry to cleanup_datasets.py. This flag will cause the script to attempt to perform the requestion action on objects regardless if it has been performed before.
...
This is useful, i.e. if purge_datasets was called with out using --remove_from_disk, but it is later decided to remove these files: the purge_datasets script should be called with both -r and -f.
2009-07-30 12:56:16 -04:00
Greg Von Kuster
0090622f59
Add ability to share histories with multiple users, along with bug fixes and more functional test coverage for history features.
2009-06-05 11:15:25 -04:00
Nate Coraor
9113ceb29f
Fix the cleanup_datasets script
2009-05-28 15:18:49 -04:00
Daniel Blankenberg
da52bd848a
Add ability for admins to delete and undelete library items.
...
Modify cleanup_datasets.py script and include a database migration script.
2009-04-23 12:42:05 -04:00
Greg Von Kuster
cfde4c4015
Normalize the model supporting the new library features. This rev assumes all current Library tables will be dropped so they are re-created at server start-up ( all library data will be lost ). Normalized objects are as follows:
...
1. ActionDatasetRoleAssociation -> DatasetPermissions ( renamed )
2. LibraryFolderDatasetAssociation -> LibraryDatasetDatasetAssociation ( renamed )
3. ActionLibraryItemRoleAssociation -> LibraryPermissions, LibraryFolderPermissions, LibraryDatasetPermissions, LibraryDatasetDatasetPermissions, LibraryItemInfoPermissions, LibraryItemInfoTemplatePermissions
4. LibraryItemInfoAssociation -> LibraryInfoAssociation, LibraryFolderInfoAssociation, LibraryDatasetInfoAssociation, LibraryDatasetDatasetInfoAssociation
5. LibraryItemInfoTemplateAssociation -> LibraryInfoTemplateAssociation, LibraryFolderInfoTemplateAssociation, LibraryDatasetInfoTemplateAssociation, LibraryDatasetDatasetInfoTemplateAssociation
2009-01-28 16:29:30 -05:00
Greg Von Kuster
2dd60568fc
merging from central
2008-12-01 14:07:33 -05:00
Greg Von Kuster
4015f31eff
Refix cleanup_dataset.py script.
2008-12-01 14:07:36 -05:00