Member of Technical Staff, Inference
Own the GPU inference serving layer and optimize model performance for high-throughput production workloads.
You will own the serving layer, including engine configuration, request routing, and performance optimization during traffic spikes. The role involves bringing new open-weight models to production quickly and ensuring high throughput per GPU.
Similar jobs

Product Engineer, Supply
Software engineer building core infrastructure for a physical luggage storage marketplace.
Senior Backend Engineer
Build backend infrastructure to help patients navigate and advocate for better healthcare outcomes.

Product Engineer - Growth
Growth engineer executing experiments to scale a physical cloud storage marketplace.