JASMIN Tap

Coming soon NLDS

Due to space constraints, tape may need to be used on JASMIN

GWS by default have access to tape for additional users you must email the helpdesk

The easiest way to access the tape storage is via JDMA. Link to JDMA documentation

setting up JDMA

python -m venv ~/venvs/jdma-venv
source ~/venvs/jdma-venv/bin/activate
pip install git+https://github.com/cedadev/jdma_client
jdma init <email> -w <group-workspace-name>

Using JDMA

to view the tape storage by showing every get and put command

jdma request -f workspace -w <gws-name>

Each batch ID is a separate folder sent to tape, ideally, you label the folder that is being sent to tape something useful or tar’ed up folders with descriptive names.

To view files in a batch:

jdma -t files <batch-id>

you’ll probably need to pipe a grep command to help find single files, the least messy way would be to have batch ids to be single tarred folders that you out and fetch as one unit.

to send to tape:

jdma -s elastictape -w <group-workspace-name> migrate <foldername>

if the folder is not in the top level of the gws make sure to give full path to it.

To fetch from tape

Create a directory in which to put the folder in This is very important, find the batch ID and then give a list of files or easier just the whole top-level folder to stop things from getting messy.

 jdma -r jdma_downloads/ get <batch-id> <filelist.txt>

If you do not send to a separate folder the file permission can go haywire a lock the whole group out the the gws.

IMPORTANT TIPS

  • Never make a blank get request this will mess up the permissions of the entire gws for everyone!

  • Always create a new folder to which the got items will go.

  • Keep everything in clearly labelled folders separate for batch id

  • Never access the same batch id at the same time as anyone else - only the help desk can fix this.

  • for ease of access break things up or tar stuff e.g. restarts w1, w2, w3 separately so the tape storage is less of a maze to navigate