Publication
Input-Dependent Power Usage in GPUs
Publication
Optimizing GPU Data Center Power
Publication
Memory Allocation under Hardware Compression
Tool
RetroInfer
Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system. RetroInfer is a novel system that rethinks the KV cache as vector storage within a GPU–CPU co-execution setup to…