Data Management

Efficient data storage on CECI clusters

24 Jan 2023, 10:45

1h 15m

BST: Pasteur (Louvain-La-Neuve)

Speaker

Ariel Lozano (ULB)

Description

The CECI clusters are equipped with different storage solutions that you can use for managing your data. Each of them have different properties such as capacity, I/O performance, accessibility and data longevity as they are meant for different usages. In this presentation we will go through the different options we have on the clusters and explain how to organize your workflows to make an efficient and practical use of them.
Contents: Storage solutions on the CECI clusters   CECI environment variables for data location Data operations inside Slurm batch scripts	Prerequisite: Being able to login to cluster  Being familiar with a text editor  Being able to submit jobs with Slurm Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)
Type: Hands-on Target audience: Everyone Must: This session is a must-have for anyone who doesn't know where $HOME, $WORKDIR, $GLOBALSCRATCH, $LOCALSCRATCH or $CECIHOME points to.

Presentation materials

StoragesAtCECI_2023.pdf