Inside Agentic AI Workloads
Agentic workloads repeatedly re-enter model inference over growing state. We characterize how trajectories, KV-cache retention, and tool use shape serving demand.
Gimlet Labs Blog
A blog about our lab's research on high performance AI systems.
Previous Posts
Showing 2 previous posts tagged Partnerships.
Scaling low-latency inference with Gimlet Cloud and Cerebras
Gimlet brings Cerebras’ wafer-scale compute into Gimlet Cloud, enabling inference at up to 3,000 tokens per second while expanding the performance and efficiency available for agentic and real-time AI applications.
Building new benchmarks for the agentic era with MLCommons
Gimlet Labs is now a member of MLCommons, the nonprofit consortium behind MLPerf. Together, we'll help establish new open benchmarks for agentic inference.