learned about @LightningAI Thunder compiler from @lantiga at @NVIDIAGTC. Thunder is a source-to-source compiler for @PyTorch. It makes PyTorch programs faster by combining and using different hardware executors at once (ie: nvFuser, torch.compile, cuDNN, and TransformerEngine FP8). Works on single accelerators and in multi-GPU settings. Thunder aims to be usable, understandable, and extensible. #GTC24 code: github.com/Lightning-AI/ligh… tutorial: lightning.ai/lightning-ai/st…