Note: Files might be offline. If you want to access these files you can simply read them (and wait until they become online in background automatically) or you can execute an explicit stage command beforehand. If you want to read/copy more than one file staging is strongly recommended.
File Storage (POSIX, smb, nfs)
Read only Access
The Windows Way (smb)
Connect to \\hssrv2.dmawi.de\ within windows explorer (use the right mouse button and add a network device). You can either search for shared directories or directly connect with e.g., \\hssrv2.dmawi.de\projects\<project>.
The Linux Way (nfs)
The HSM file systems are shared and mounted automatically on most Linux clients (but not on laptops). A simple ls /hs/projects/ should do. If you should miss a directory please contact hsm-support@awi.de
Read/Write Access
The HSM system ist shared/mounted read only. To write data into the tape archive use one of the following options:
| Suggestion | Command | Important Notes |
|---|---|---|
 Best choice | rsync -e ssh -Pauv <file|dir> <username>@hssrv2.dmawi.de:<destination-dir> | rsync is the most versatile way of transfering data. E.g., it allows updates with the -u option. This ensures that only new files are copied (and overwritten), existing (unchanged) files are not touched. This is important to reduce tape access. You do not want to use -a, because this would stage all files from tape to the disk-cache for a complete file-comparison. When copying directories you need -r (recursive, already included in -a). |
| Fast choice | sftp filezilla | sftp provides fast way of transferring large amounts of data. Use your favorite ftp-client. However, note, that only two connections per user (per HSM server) are allowed. If you request more, your connection will terminate. sftp uses the secure ssh-protocol and should be preferred. Use port 22 for sftp. |
 Do not use! | scp <file|dir> <username>@hssrv2.dmawi.de:<destination-dir> | scp seems convenient, but it is slightly slower when transferring data compared to ftp and/or rsync. It also just overrides existing files and no update (like rsync -u) is possible. This would also create new tape copies, you do not want to do that!!! |
Note: If you have to archive many (>100 000) small (<100 MB) files this will stress the system more than necessary. Please zip or tar[.gz] your directories and upload these compressed files.
Object Storage (S3)
- ScoutAM provides a S3-gateway to access data.
- Currently this in the testing phase.
- We consider/plan to provide S3 storage via eResources in he future (Speculation: Q4/2024)
- Only TLS connections are possible. Please use this certificate: HSM_S3gw.cert.pem