Edition 2024 25mn ai-ml-engineering

Help ! Mes calculs sur GPU semblent non déterministes

Time 16:00 → 16:25
Room future-room
Language FR

Speaker

Paali Tandia

Paali Tandia

Senior ML Engineer @Hymaïa

Description

The widespread adoption of deep learning-based approaches and more recently the explosion of generative AI usage have established Nvidia GPUs as the accelerators of choice for these applications. However, the programming model offered by the CUDA API involves trade-offs regarding the reproducibility of certain calculations. This talk will immerse you in the world of Nvidia GPUs by covering what they are, how they are programmed, and why certain calculations don't always yield the same results through a concrete example.