Add suggested PyTorch LLM optimizations #356
Description
Most of these optimizations should be easy to add: https://pytorch.org/blog/accelerating-generative-ai-2/
{{ message }}
Most of these optimizations should be easy to add: https://pytorch.org/blog/accelerating-generative-ai-2/