Add scripts/managed_repo_symlinks.py #54
Open
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For the importing-NGFF-Filesets-without-chunks workflow, we import a metadata-only copy of the image/plate, then need to view an image from each plate before creating symlinks from the Managed Repo to the directory that contains the image/plate.
E.g. see README at https://github.com/IDR/idr0125-way-cellpainting
This PR aims to replace the following manual steps described there...
Need to view an image from each plate OR
omero render set Image:ID rdef.ymlfor each plate, to avoid subsequent ResourceError after symlinking. Seescripts/render_set_cmd.pyRun
scripts/get_import_paths.pyto create imported_paths.txt with the managed repo path for each imported plate.Run
scripts/symlink_cmd.pywhich consumesimported_paths.txtto output the commands to replace each plate in the managed repo with a symlink to the corresponding plate on a mounted s3 bucket. These can be saved inscripts/symlinks.bash. Need torun sudo chmod +x symlinks.bashthensudo -u omero-server -sandbash symlinks.bash....with a single script run:
E.g. For a Screen that contains Plates, where the plates are mounted at
/path/to/plates/dir/we can run:Default
repois/data/OMERO/ManagedRepositoryScript also supports the
--dry-runand--reportoptions.