Versions Compared

Old Version 17

changes.mady.by.user Malte Thoma

Saved on

compared with

New Version 18

changes.mady.by.user Malte Thoma

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • (warning) Your (larger) Data is archived on tape, so it will take a few minutes to get it back (unless it is online or has a disk-copy).
  • (warning) You need a project to archive your data (apply for a project here: eResources).

Info
titlePlease Note

During the transition (in 2024) from hssrv1 (samfs) to hssrv2 (ScoutAM) resources are limits because:

  • Existing Tape drives (six per building) are split between old and new HSM system

  • We have to copy (rearchive) 600 tapes due to a tape recall

  • The new ScoutAM does not support automatic unloading after a certain idle time yet. Hence, all drives are occupied and before a stage request can start one drive has to be unloaded (and the tape inside must be rewound first).  This might take a few minutes.

  • → Suggestion: Please be patient, staging might take longer than you expect. Take a look at the scheduler to observe the progress. 


HSM at AWI

Four domains for tape archiving at AWI


DomainPurposePathDisk CopyDescriptionHow to apply

A

PANGAEA

/hs/platforms

(tick)

Archive of sensor.awi.de

Permanent archive for irrecoverable data. Metadata is needed for this domain. Please contact PANGAEA on how to submit your data.
/hs/usero
/hs/pangaea		(tick)PANGAEA
Note: Former /hs/usero has moved to /hs/pangaea/data/legacy/ on 2024-06-17
PProjects

/hs/projects
/hs/s3projects

(tick)Project data

Long term project data with predefined life time. A project can be created with eResources https://cloud.awi.de/#/projects 
The setgid on directories ensures that new (sub-)directories belong to the project (POSIX) group automatically.
Please use eResources to create a project and request storage resources. 

CDepricated

/hs/usera
/hs/userc
/hs/userm


Have vanished early 2020


IB, IPDesaster recovery/hs/isirep-...(minus)Project replica from the Isilons (Bhv, Pot)Daily (or weekly) automatic replication of online project data from the Isilon (when selected in eResources) in Bremerhaven and Potsdam, respectively. Used for disaster recovery only (=hopefully never (wink) ).
DInternal IT stuff/hs/backup(tick)samfs-dumps, ScoutFS-dumps, logfiles, VeeamIT internal use only
/hs/store(minus)10-year storing of expired user and project data
/hs/s3gateway
experimental storage

A disk copyis available for specific (smaller) files for some file systems. This allows a significantly faster access of offline files. The availability of this disk archive depends on the actual resources/usage and might change.

...