NVIDIA DeveloperAI Research
Overcoming Generative Recommender Latency: Deploying HSTU Models with NVIDIA Dynamo-Triton and PyTorch AOTI
突破生成式推薦延遲瓶頸：NVIDIA Dynamo-Triton 與 PyTorch AOTI 部署 HSTU 模型實戰
Learn how to deploy HSTU generative recommenders using NVIDIA Dynamo-Triton, PyTorch AOTI, and FlexKV caching to achieve up to a 5.93x speedup on Blackwell GPUs.
2 min read