Merge pull request #93 from UCL-ARC/sharedspaces

Deletion policy for increased quota and shared spaces

Author: heatherkellyucl

mkdocs-project-dir/docs/Additional_Resource_Requests.md

@@ -1,9 +1,8 @@
 ---
 title: Additional Resource Requests
 categories:
- - Legion
  - Myriad
- - Grace
+ - Kathleen
 layout: docs
 ---
 # Additional Resource Requests
@@ -20,6 +19,8 @@ Users who wish to request additional resources or reserve resources
 beyond those provided can complete the additional resource request form
 in collaboration with your supervisor or the project's principal
 investigator. This includes requests for increased storage quotas.
+Please read the [Deletion policy](#deletion-policy-for-increased-quota-and-shared-spaces) 
+below as data will be deleted if these expire.
 
 The completed form should be sent to the Research Computing Platforms
 team at <mailto:[email protected]>, for technical review. If successful,
@@ -37,19 +38,13 @@ additional resources is only likely to be approved if the impact on
 other users is not deemed to be significant, or of long duration.
 
   - [Additional resource request form](Additional_Resource_Requests/CRAG_additional_resources_request_form.rtf)
-  - *NB:* Myriad's filesystem is still very full (replacement due March 2025) and so
-    we need more detail for requests, plus your plan for removal of the data once your 
-    quota increase ends. We will be considering requests in batches and comparing to
-    space left. All granted requests will expire at the end of March 2025 or Myriad
-    refresh date, whichever is earliest, and will require reapplication for the new 
-    filesystem.
 
 
 ### Examples of requests
 
  - Increased Scratch quota - tell us how much, for what purpose and how long you'll need it. Also
    tell us in brief your plan for removal of the data once your quota increase ends.
-    - Once implemented, `lquota` will show the new quota.
+    - Once implemented, `gquota` (Myriad) or `lquota` (Kathleen) will show the new quota.
  - Longer wallclock limit
     - Consider whether you can checkpoint and restart your job: that is, write out everything that
       you need for a second job to begin where the previous one finished. Running multiple shorter
@@ -63,13 +58,13 @@ other users is not deemed to be significant, or of long duration.
       `#$ -P crag5day` to your jobscript you will be able to request a longer wallclock time than 
       usual for that job.
 
-## Request hosting of shared datasets
+## Request hosting of shared project spaces or datasets
 
-We have provision for hosting shared datasets for users on Myriad. These
-can be datasets that are freely accessible by all users, or ones limited
+We have provision for hosting project spaces/shared spaces/datasets for users on Myriad. 
+These can be spaces or datasets that are freely accessible by all users, or ones limited
 to groups.
 
-Hosted datasets:
+Shared project spaces/hosted datasets:
 
   - Will not be backed up.
   - Must have a named primary contact.
@@ -78,14 +73,44 @@ Hosted datasets:
   - Will have an associated quota.
   - Will be removed when renewal lapses (notice will be given).
 
-They are likely to be managed by a role account - access to the role
-account will be by ssh key.
-
 To apply for a hosted dataset, please send this form to
 <[email protected]>.
 
   - [Hosted dataset request form](Additional_Resource_Requests/Hosted_dataset_request_form.rtf)
 
+## Deletion policy for increased quota and shared spaces
+
+When your quota or space is due to expire, we will send reminders via MyServices (so you should get an email notification but also have a notification viewable in there) on this schedule:
+
+* 1 month before expiry
+* 2 weeks before expiry 
+* 1 week before expiry 
+* Day of expiry 
+* 1 month after expiry
+
+(If you renew, you won't get the additional reminders).
+
+If it is a shared space with an associated group, notifications will also be sent to the members of the group, in case the person in charge of it left and ownership needs to change.
+
+On the day of expiry, if we have heard nothing from you and you are still using the space your quota will be set back to normal so new files cannot be created. If it was a personal quota we will also prevent you from submitting new jobs since they would fail. Your data will remain on Myriad at this point so you can still copy it off and delete it. 
+
+One month after expiry if it was a personal quota and you are still over quota we will move all of your home and Scratch data onto another location. If it was a shared space and still contains data we will move all the contents of the space to another location.
+
+We will keep the data for two months more.
+
+If we still hear nothing from you during these two months, we will delete all the data (three months after the expiry date).
+
+Please do consider this if you are going to be away from UCL for some period of time - you can contact us in advance of the quota or space expiring.
+
+To summarise:
+
+* Day of expiry: quota set back to normal; job submission prevented if a personal quota.
+* One month after quota expiry:
+    - If personal quota: all your home and Scratch data moved to a third location
+    - If shared space, shared data moved to a third location
+* Three months after quota expiry: all data deleted from the third location.
+
+
 ## Purchase dedicated compute nodes or priority cycles on Myriad
 
 Researchers may purchase additional resources to be used as part of the [Myriad](Clusters/Myriad.md) High Performance Computing cluster if the free service does not meet their needs. See Paid-for resources: [Purchasing in Myriad](Paid-For_Resources/Purchasing_in_Myriad.md) for details.