Suggestions/good to know
- Storing millions of files in one directory slows down any filesystem. Therefore we suggest to limit the number of files whenever possible (per design, workflow, zip, tar, ...)
- We suggest to limit the size of each individual file to a maximum of 500 GB per file. E.g. with
tar -cPf - $INDIRECTORY | pigz -c | split -a3 -d -b500GB - $OUTFILE.
- If you access(read) more than one file from the HSM, please stage all files you plan to access beforehand at once! This will decrease the overall access time significantly by reducing the necessary robotic accesses to a minimum. However, please limit yourself to access only about a dozen TB at once.
...
File Storage (POSIX, smb, nfs)
...