Any recommendations for material to know to do exactly this sort of optimization work (involving triton)? I guess it's a mix of knowing computer architecture and compilers?
Triton itself is fairly "easy", at least as far as "low level optimization languages" go. It's just (restricted) python. If you know PyTorch, you can muddle your way through Triton. They have a few tutorials.
Reading up on nvidia architectures, PTX, and CUDA are likely to improve your skill at Triton.
Yeah I've been able to kinda muddle my way through but progress is frustrating as I frequently get errors I don't understand. Was thinking maybe I should study compilers a bit and then I will be able to understand the triton source code better which will help me understand why I get errors.
