Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • You can execute (some) commands on the ScoutAM servers using ssh hssrv2 <command>
  • The ScoutAM use your (standard) AWI $HOME. We suggest to create an ssh key pair with a passphrase (e.g., https://www.ssh.com/academy/ssh/keygen) there.
  • The tool saminfo.sh provides more options and can be extended on request. 
  • hssrv2 is redirected to three different servers ( hssrv2a.dmawi.de, hssrv2b.dmawi.de and hssrv2c.dmawi.de) for load balancing.  However, if you want access to a specific server, feel free to use it explicitly.
  • We Because hssrv2 is redirected to different hosts (load balancing) we recommend to add these lines to your ssh-your ~/.ssh/ssh_config
    Code Block
    languagebash
    title~/.ssh/config
    Host hssrv2*
       UserKnownHostsFile /dev/null
       StrictHostKeyChecking no
       LogLevel ERROR
  • The ScoutAM use your (standard) AWI $HOME. We suggest to create an ssh key pair with a passphrase (e.g., https://www.ssh.com/academy/ssh/keygen) there.
  • The help of tool saminfo.sh -h shows some options and can be extended on request. 

Specific taks

  • We use these file variables to provide some examples. Please note that the variable for several files have to formatted differently, depending on the preferred access method. 
    • single file
      • F=/hs/store/users/2023/2023-11-30_liegmahl/home_edvs1.tgz
    • directories
      • D="/hs/store/users/2023/2023-11-30_liegmahl"
    • multiple files:
      • DIR="store/users/2023/2023-11-30_liegmahl"FA=                       # Note: no "/hs/$DIR/*" here!
      • FBFA="/hs/$DIR/home_edvs1.tgz:/hs/$DIR/isibhv_personal.tgz:/hs/$DIR/isipd_home_pd.tgz*"
      • FC='"$DIR/home_edvs1.tgz","$DIR/isibhv_personal.tgz","$DIR/isipd_home_pd.tgz"'   # Note: "/hs/" is missing here!
  • Some additional tasks can be done with ssh hssrv2 saminfo.sh 
TaskRestAPIssh hssrvssh hssrv 'saminfo.sh ...'
Shortcut FileF=/hs/store/users/2023/2023-11-30_liegmahl/home_edvs1.tgz

If you have special characters (e.g., spaces, brackets, ...) in your filename: Try to avoid them. Yes, really try to avoid then! However, if are forced to use special characters it will get nasty. You have
a) have to quote  the filename and/or
b) protect the special characters and in the filename: F="/hs/platforms/WORM/aircraft/polar6/macs/exdata/P6-244_ANT_23_24_2311300801/20231130-150529_[Record\ All]/111498_RGB/09835_041255631_500.macs".
c) and in addition to quote the ssh command correctly (see example)

Shortcut Directory

D="/hs/store/users/2023/2023-11-30_liegmahl"

Shortcut Multiple Files

DIR="store/users/2023/2023-11-30_liegmahl"                       # Note: no "/hs" here!
FC='"$DIR/home_edvs1.tgz","$DIR/isibhv_personal.tgz","$DIR/isipd_home_pd.tgz"'



filestat 
(everything)
eval $CURL -X GET $SERV/file?path="$F"
eval $CURL  -X PUT  --data \'{\"path\":[$FC]}\' $SERV/batchfile

sls -D $F       # use -E to show
sls -D $FA    # md5 checksum
sls -D $D

ssh hssrv2 'saminfo.sh -ga -f'"$F"
ssh hssrv2 saminfo.sh -f $FBga -f"$D"
ssh hssrv2 saminfo.sh -ga -F$FL

filestat
(online/offline)
eval $CURL -X GET $SERV/file?path="$F" | jq -r .onlineblocks
eval $CURL  -X PUT  --data \'{\"path\":[$FC]}\' $SERV/batchfile | jq -r '.infos[] | {path, onlineblocks, error}'


ssh hssrv2 'saminfo.sh -o go -f "$F"'
ssh hssrv2 saminfo.sh -o go -f $FB"$D"
ssh hssrv2 saminfo.sh -go -F$FL

staging
eval $CURL -X POST $SERV/request/stage?path="$F"
eval $CURL -X PUT  --data \'{\"path\":[$FC]}\' $SERV/request/batchstage

(minus) These won't work. Please use saminfo.sh instead(minus) 
stage $F

stage $FF
stage -r $DIR$D

ssh hssrv2 'saminfo.sh -s -f'"$F"
ssh hssrv2 saminfo.sh -s $FB
-f"$D"
ssh hssrv2 saminfo.sh -s $DIR-F$FL

show scheduler state
eval $CURL -X GET $SERV/queues

 --

ssh hssrv2 saminfo.sh -S



 

 

mkdir
--

mkdir/hs/projects/<project>/newdir

--

release

release $F

release -r $DIR

 

quota

  

ssh hssrv2 saminfo.sh -q