...
The HSM system ist shared/mounted read only. To write data into the tape archive use one of the following options:
| Suggestion | Command | Important Notes |
|---|---|---|
 Best choice | rsync -e ssh -Pauv <file|dir> <username>@hssrv2.dmawi.de:<destination-dir> | rsync is the most versatile way of transfering data. E.g., it allows updates with the -u option. This ensures that only new files are copied (and overwritten), existing (unchanged) files are not touched. This is important to reduce tape access. You do not want to use -a, because this would stage all files from tape to the disk-cache for a complete file-comparison. When copying directories you need -r (recursive, already included in -a). |
| Fast choice | sftp filezilla | sftp providesfastway of transferring large amounts of data. Use your favorite ftp-client. However, note, that only two connections per user (per HSM server) are allowed. If you request more, your connection will terminate. sftp uses the secure ssh-protocol and should be preferred. Use port 22 for sftp. |
 Do not use! | scp <file|dir> <username>@hssrv2.dmawi.de:<destination-dir> | scp seems convenient, but it is slightly slower when transferring data compared to ftp and/or rsync. It also just overrides existing files and no update (like rsync -u) is possible. This would also create new tape copies, you do not want to do that!!! |
Note: If you have to archive many (>100 000) small (<100 MB) files this will stress the system more than necessary. Please zip or tar[.gz] your directories and upload these compressed files.
...
- ScoutAM provides a S3-gateway to access data.
- Currently this in the testing phase.
- We consider/plan to provide S3 storage via eResources in he future (Speculation: Q4/2024)
- Only TLS connections are possible. Please use
View file name use this certificate: HSM_S3gw.cert.pemheight 250