Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Your (larger) Data is archived on a tape, so it will take a while to get it back (unless it is online or has a disk-copy).
  2. You need a project to archive your data (apply for a project here: eResources).

HSM at AWI

Four domains of tape archiving at AWI

Image Added


DomainUsagePurpose
A(mainly) PANGAEA and SENSORPermanent archive for irrecoverable data. Metadata is needed for this domain. Please contact Stefanie Schumacher or Janine Felden for more information aboutPANGAEA and how to submit your data
POpen to all usersLong term project data with predefined life time. A project can be created with eResources https://cloud.awi.de/#/projects 
The setgid on directories ensures that new (sub-)directories belong to the project (POSIX) group automatically
IB, IPDesaster recoveryDaily (or weekly) automatic replication of online project data from the Isilon (when selected in eResources) in Bremerhaven and Potsdam, respectively
DInternal IT stuffFor internal IT use (used for additional backups and storing of expired user/project data)


Concept

Principle Idea 

  • HSM:  A (H)ierarchical (S)torage (M)anagement system consists of (at least) two storage systems: A cache speeds up access, and the hierarchy reduces cost. Based on a set of rules, data is stored on certain connected storage devices (tapes and optional disks).
  • ScoutFS is used at AWI since 2024 and supersedes samfs (used since decades before)  www.versity.com/products/scoutfs/  www.scoutfs.org
  • ScoutAM is used as (A)rchive (M)anager www.versity.com/products/scoutam/ and supersedes OHSM/VSM

...