...
Quantity | Name | Partition | Specification | Notes |
|---|---|---|---|---|
240x | prod-[001-240] | smp, smpht |
| For our test phase, we have split the compute nodes in two sets More information can be found on the slurm documentation. |
4x | fat-00[1-4] | fat, matlab |
| fat-00[3,4] are currently reserved for matlab users, this might change later |
1x | gpu-001 | gpu |
| A comparison of the two different GPUs can be found here:
|
1x4x | gpu-00[2-5] | gpu |
|
...
| Personal directories | Project directories | |||||
|---|---|---|---|---|---|---|
| Mountpoint | /albedo/home/$USER | /albedo/work/user/$USER | /albedo/scratch/user/$USER | /albedo/work/projects/$PROJECT | /albedo/scratch/projects/$PROJECT | /albedo/burst |
| Comes with | HPC_user account: https://id.awi.de → Start a new request/Bestellung → IT Service → HPC → Add to chart/In den Einkaufswagen | Apply for Quota here: https://cloud.awi.de/#/projects | -- | |||
| Block Quota | 100 GB (fixed) | 3 TB (fixed) | 50 TB (fixed) | 30 €/TB/yr (variable) | 10 €/TB/yr (variable) | |
| File Quota | 1e6 (fixed) | 3e6 (fixed) | max(1,log(1.5*BlockQuota)) * 1e6 | 3*max(1,log(1.5*BlockQuota)) * 1e6 | ||
| Delete | 90 days after user account expired | all data older than 90 days | 90 days after project expired | all data older then 90 days | after 10 days | |
| Security | Snapshots for 100 days | -- | Snapshots for 100 days | -- | -- | |
| Snapshots | /albedo/home/.snapshots/ | /albedo/work/user/.snapshots/ | -- | /albedo/work/projects/.snapshots/ | -- | |
| Owner:Group | $USER:hpc_user | $OWNER:$PROJECT | root:root | |||
| Permissions | 2700 → drwx--S--- | 2770 → rwxrws--- | 1777 → rwxwrxrwt | |||
| Focus | many small files | large files, large bandwidth | large files, large bandwidth | low latency, huge bandwidth | ||
...
Data Pools
...
| Markdown |
|---|
A data pool refers to a centralized storage space where large datasets are stored and managed, for easy and shared access by users. Data stored in pools is typically input data that is common to many users and it is not expected to change. For instance, input, boundary conditions and meshes for numerical models are typically stored in data pools, but also reanalysis data, and historical observations that will be accessed and processed by many users. Having a common pool to all users is very advantageous, since it avoids having identical copies of large datasets spreaded throught the file system.
In Albedo data pools are located in `/albedo/pool/<pool_name>`. That directory contains soft links to folders in **project directories** (`/albedo/work/projects/p_<project_name>`). If you would like to make a pool out of your data project please contact us (hpc@awi.de). If you'd like to know more about project directories and how to create one, please read https://spaces.awi.de/display/HELP/HPC+Data+Policy. |
Remote user storage (/isibhv)
...