Instantly run popular and specialized models, including Llama3, Mixtral, and Stable Diffusion, optimized for peak latency, throughput, and context length.
Lines to first SFT step
Faster Proposal Assistance
Lines to first sft Step
Sub-second first-token latency
Lines to first sft Step
Sub-second first-token latency
