Trained Deep Learning models on large clusters utilizing primarily PyTorch, DeepSpeed, Megatron, and Transformers frameworks. Conducted benchmark studies to assess the effectiveness of novel Machine Learning techniques, high-performance training tools and emerging hardware. Teached research scientists how to harness Deep Learning methodologies within a supercomputing environment (Jean Zay cluster).