HPC Formation 2026

Session

Day 13: Handling Data on HPC

18 Feb 2027, 09:30

MERC04

39. NetCDF and HDF5: file formats for HPC

Mr Pierre-Yves Barriat (UCL/ELIC)

18/02/2027, 09:30

NetCDF and HDF5 are among the most widely used data formats in scientific computing. They provide efficient, portable, and self-describing ways to store large and complex datasets while supporting high-performance I/O on modern HPC systems. This session introduces both formats, explains their strengths and differences, and provides hands-on experience using Python, Fortran, and C to create,...

40. Data Privacy

Damien François (UCLouvain/CISM)

18/02/2027, 12:00

Data confidentiality is a critical aspect of scientific computing. Researchers working on HPC systems may handle unpublished results, personal data, industrial collaborations, or legally protected datasets. This session introduces the principles of secure data management on CÉCI clusters and presents the tools and best practices required to protect sensitive information while remaining...

41. Datalad: Control version system for large files

Damien François (UCLouvain/CISM)

18/02/2027, 14:00

DataLad is a data management and distribution tool built on top of Git and git-annex. It enables researchers to track datasets, code, and computational workflows in a reproducible manner while efficiently handling large files that would be impractical to store directly in Git. This session introduces DataLad as a solution for reproducible research, collaborative projects, and large-scale...