Data Management (Data storage and transfer, filesystems, open data, data management plan)

Efficient data storage on CECI clusters

5 Dec 2023, 11:00

1h 45m

Shanon (Building Maxwell, first floor) (Louvain-La-Neuve)

Speaker

Ariel Lozano (ULB)

Description

The CECI clusters are equipped with different storage solutions that you can use for managing your data. Each of them have different properties such as capacity, I/O performance, accessibility and data longevity as they are meant for different usages. In this presentation we will go through the different options we have on the clusters and explain how to organize your workflows to make an efficient and practical use of them.
Contents: Storage solutions on the CECI clusters   CECI environment variables for data location Data operations inside Slurm batch scripts	Prerequisite: Being able to login to cluster  Being familiar with a text editor  Being able to submit jobs with Slurm Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.)
Type: Hands-on Target audience: Everyone Must: This session is a must-have for anyone who doesn't know where $HOME, $WORKDIR, $GLOBALSCRATCH, $LOCALSCRATCH or $CECIHOME points to.

Presentation materials

StoragesAtCECI_Dec2023.pdf