Learning how to use HPC infrastructure (part III: Code and Data Versioning)

Wednesday 16 Oct 2024, 09:30 → 16:00 Europe/Brussels

SUD 07 (Louvain-La-Neuve)

Versioning of documents, code and data is crucial to team collaboration and to reproducibility. This session is dedicated to Git, the ubiquitous distributed source management system, and to Datalad, a software based on Git to version datasets too large to be managed by Git alone.
Contents: GIT data versioning (git extension)	Prerequisite: None Type: presentation and hands on Must: This session is a must have for researchers handling code and/or data

1 Code Versioning (git)

You will learn git via a dedicated game.

Speaker: Dr Olivier Mattelaer (UCLouvain/CISM)

24_10_DVCS.pdf

git_cheatsheet.pdf

2 Data versioning

Everyone is familiar with code versioning, that allows recalling what modification was implementer in the code, by whom, when, and why. The same idea can be transposed to data, but requires a specific set of tools, and while Git is the de facto standard tool for code, it is not really suitable for data. Other options exist, either as a Git plugin, a standalone CLI tool, or a full-featured data management website. The landscape for data versioning will be presented in this session, with a focus on a simple to use and simple to install CLI tool: Datalad.

Contents: Specific aspects of data versioning vs code versioning The landscape of tools for data versioning Tutorial using Datalad

Prerequisite: Being able to use SSH with private keys  Being familiar with a text editor  Mastering the Linux command line and the GNU utilities (mkdir, cp, scp, etc.) Familiarity with code versioning

Type: Hands-on Target audience: Everyone Must: This session is interesting for users who must process data and recall what was done to which data piece.

Speaker: Damien François (UCLouvain/CISM)

dataversioning.pdf