Query and Retrieve old gstore data
Data archives on tape written via Gstore can be retrieved via
TSM commands, now wrapped in the scripts
qgstore.sh
and
rgstore.sh
.
Permissions
- Both scripts have to run under
sudo
- This means you have to be entered into the sudoers database by an admin!
Where does it work?
Due to the implementation of user/group ids and access rights in the original Gstore software, retrieval of these data
does not work on NFS shares.
- You cannot do it in your normal /u - home directory
- You cannot do it directly from outside GSI.
Therefore, the scripts have been placed on the
lustre.hpc.gsi.de
nodes, where retrieval can be done onto Lustre.
Query
$ ssh lustre.hpc.gsi.de
$ sudo /usr/local/bin/qgstore.sh /my-archive/
/my-archive/
could be something like
/fopi/
or
/cbm/
etc.
Retrieve
Go to
lustre.hpc.gsi.de
and create your target directory:
ssh lustre.hpc.gsi.de
$ cd /lustre/group/…
$ mkdir mytapedir
Run
rgstore
specifying that target directory with a trailing slash:
$ sudo /usr/local/bin/rgstore.sh /gstore_filespec mytapedir/
Example:
scientist@lustre.hpc:/lustre/fopi/scientist$ sudo /usr/local/bin/rgstore.sh /fopi/dstx/iqmd.geant.auau1000.zhm01.* mytapedir/
scientist@lustre.hpc:/lustre/fopi/scientist$ ls -l mytapedir
total 4
drwxr-sr-x 2 scientist fopi 4096 Mar 5 10:08 dstx
scientist@lustre.hpx:/lustre/fopi/scientist$ ls -l mytapedir/dstx
total 787530
-rw-r--r-- 1 scientist fopi 395514000 Mar 5 10:08 iqmd.geant.auau1000.zhm01.v1
-rw-r--r-- 1 scientist fopi 411264000 Mar 5 10:08 iqmd.geant.auau1000.zhm01.v2
[…]
--
ThomasRoth,
Christo - 2018-2020