# JIT-compiling PyTorch code into optimized kernels, # while requiring minimal code changes. # ``torch.compile`` accomplishes this by tracing through # your Python code, looking for PyTorch operations ...

This tutorial seeks to teach users about using profiling tools such as nvsys, rocprof, and the torch profiler in a simple transformers training loop. We will cover how to use the PyTorch profiler to ...