Skip to content

Commit a5ac17b

Browse files
committed
🍱 Add CSE shared server doc
1 parent d6330f0 commit a5ac17b

File tree

3 files changed

+80
-5
lines changed

3 files changed

+80
-5
lines changed

docs/.vitepress/config.mts

Lines changed: 13 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,11 +44,23 @@ export default defineConfig({
4444
},
4545

4646
nav: [
47-
{ text: 'Guide', link: '/guide/', activeMatch: '/guide/' },
47+
{ text: 'Roselab Guide', link: '/guide/', activeMatch: '/guide/' },
48+
{ text: 'CSE Public Server Guide', link: '/shared/', activeMatch: '/shared/' },
4849
{ text: 'Config', link: '/config/', activeMatch: '/config/' }
4950
],
5051

5152
sidebar: {
53+
'/shared/': [
54+
{
55+
text: 'Shared',
56+
items: [
57+
{
58+
text: 'Shared Servers',
59+
link: '/shared/',
60+
},
61+
],
62+
}
63+
],
5264
'/guide/': [
5365
{
5466
text: 'Guide',

docs/guide/index.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -205,6 +205,10 @@ To see the file system, run `df -H` . You would see
205205
* a 5 TB private data HDD mounted under `/data` that is only accessible to you, and
206206
* a 5 TB public data HDD mounted under `/public` that is accessible to everyone.
207207

208+
::: tip Note
209+
The system SSD is faster but has limited space and is local to the machine. The HDD is synchronized between machines and is suitable for large datasets. When you modify files in `/data` in one container, the changes will be reflected in your containers on all other machines. Use the HDD for larger or archived project data.
210+
:::
211+
208212
```bash
209213
$ df -H
210214
Filesystem Size Used Avail Use% Mounted on
@@ -216,10 +220,6 @@ data/public 5.0T 263k 5.0T 1% /public
216220

217221
It is recommended to use soft links to access your data files on the `/data` HDD. For example, instead of downloading your data files to `/data/project1/sample...pt` and hard-coding their absolute paths, you can create a soft link under the code folder using the `ln -s /data/project1/ /home/ubuntu/project1/data/` command. Then, you can refer to the data files as if they and the code are in the same project structure.
218222

219-
::: tip
220-
For datasets under 200 GB, use the faster system SSD. Use HDD for larger or archived project data.
221-
:::
222-
223223
### 5. Verify Web Application Access
224224

225225
Refer to the documentation for [Seafile](https://help.seafile.com/), [HedgeDoc](https://docs.hedgedoc.org/), and [MinIO](https://min.io/docs/minio/linux/index.html) to access these services. For [Jupyter Lab](./jupyter) or [Remote Desktop](./rdp), check the respective pages for login instructions.

docs/shared/index.md

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
# Getting Started with CSE Shared Servers
2+
3+
## Overview
4+
5+
After the containerization migration, the CSE shared servers are now under the management of the RoseLab. The CSE shared servers (north, south, east, and west) also provide a containerized environment for research and development. Each user has their own isolated container with dedicated resources and sudo access.
6+
7+
## Key Differences from RoseLab
8+
9+
1. **Fixed Server Assignment**: Unlike RoseLab, you cannot move between machines. Your container is fixed to the assigned server. Your data directory is `/data/<username>` instead of `/data` (due to the backward compatibility with the previous setup). Your data directory is not synced between servers.
10+
11+
2. **No Common Utilities**: The shared servers do not have access to the common utilities available in RoseLab for managing containers or port mappings.
12+
13+
3. **Limited Software**: The shared servers come with a basic setup. Additional software installations are the responsibility of the user.
14+
15+
4. **Shared Conda**: A shared Conda installation is mounted by default to reduce storage usage. However, you are free to install your own Conda environment. You can disable the default shared Conda activation by removing the corresponding line from your `.bashrc` file.
16+
17+
5. **No Hosted Services**: The shared servers do not host any services (e.g., MiniO, WandB). Users are responsible for setting up their own services.
18+
19+
## Accessing Your Container
20+
21+
### SSH Access
22+
23+
To access your container via SSH, following the same steps as in RoseLab:
24+
25+
```bash
26+
ssh ubuntu@[server].ucsd.edu -p [your-ssh-port] -i path/to/your/private-key
27+
```
28+
29+
The credential email is similar to the RoseLab email, with the private key attached but without any credentials (since there is no service account). You are expected to set up your own password by running `sudo passwd ubuntu` after logging in.
30+
31+
## Resource Allocation
32+
33+
Each user container is allocated:
34+
- 10 CPU cores
35+
- 128 GB RAM
36+
- 128 GB root drive
37+
- Unlimited data drive (mounted at `/data/<username>`)
38+
39+
Check your allocated resources using similar commands as in RoseLab.
40+
41+
## File System
42+
43+
- Your home directory is located at `/home/ubuntu`
44+
- Your data drive is mounted at `/data/<username>`
45+
- Shared public data is accessible at `/data/public`
46+
47+
## Best Practices
48+
49+
1. **Data Storage**: Store large datasets and project files in your `/data/<username>` directory to preserve space on the root drive.
50+
51+
2. **File Sharing**: Use the `/data/public` folder for sharing files with other users.
52+
53+
3. **Port Usage**: Be mindful of the port mappings when setting up services. Use the provided host ports for external access.
54+
55+
4. **Resource Management**: Monitor your resource usage to ensure you stay within the allocated limits.
56+
57+
::: tip
58+
If the data drive is full, you (or your PI) would need to purchase your own additional storage, since Roselab admins cannot delete users' files on their behalf. Roselab admins can only provide guidance on mounting your storage and mapping it to your container. Contact the RoseLab admins for more information.
59+
:::
60+
61+
## Support
62+
63+
Roselab admins provide only limited support for the shared servers. Remember to keep your access credentials secure and do not share them with others.

0 commit comments

Comments
 (0)