Inference AI Infra in the World of Test-Time Compute

There’s room to rebuild the AI infrastructure stack: better software at inference-layer tooling, cheaper ways to handle GPU workloads, and optimizations that let AI apps scale without bleeding money.