FireOptimizer: Customizing latency and quality for your production inference workload
Introducing FireOptimizer, our adaptation engine designed to customize and enhance AI model performance for your unique use cases.
Featured Blogs
Build Your Own Flight Recommendation System using FastAPI, SerpAPI, and Firefunction
8/29/2024
View Article
Building a RAG with Astro, FastAPI, SurrealDB and Llama 3.1
8/14/2024
View Article
How Fireworks evaluates quantization precisely and interpretably
8/1/2024
View Article
Introducing Llama 3.1 inference endpoints in partnership with Meta
7/23/2024
View Article
Fireworks AI Raises $52M Series B to Lead Industry Shift to Compound AI Systems
7/11/2024
View Article
How Cursor built Fast Apply using the Speculative Decoding API
6/23/2024
View Article
FireAttention V2: 12x faster to make Long Contexts practical for Online Inference
6/20/2024
View Article
Firefunction-v2: Function calling capability on par with GPT4o at 2.5x the speed and 10% of the cost
6/17/2024
View Article
Announcing custom models and on-demand H100s with 50%+ lower costs and latency than vLLM
6/3/2024
View Article
GPUs on-demand: Not serverless, not reserved, but some third thing
6/3/2024
View Article
Code Generation with Large Language Models - Fireworks AI Take
5/8/2024
View Article
Doomed to Code: How we Teamed Up with Fireworks AI at MistralAI Hackathon to Conquer the Shores of Hell
5/6/2024
View Article
Partnering with Meta to bring Llama 3 to Firework’s inference and fine-tuning
4/18/2024
View Article
Getting Started with Stability’s API Powered by Fireworks
4/17/2024
View Article
Optimizing Retrieval Augmented Generation (RAG) with MongoDB Atlas and Fireworks AI
3/21/2024
View Article
Fireworks launches fine-tuning service - Rapidly iterate on quality and scale to production through Fireworks inference
3/8/2024
View Article
Fireworks Platform Spring 2024 Updates
3/1/2024
View Article
FireFunction V1 - Fireworks’ GPT-4-level function calling model - 4x faster than GPT-4 and open weights
2/20/2024
View Article
Why do all LLMs need structured output modes?
2/20/2024
View Article
FireLLaVA: the first commercially permissive OSS LLaVA model
1/18/2024
View Article
FireAttention — Serving Open Source Models 4x faster than vLLM by quantizing with ~no tradeoffs
1/8/2024
View Article
Fireworks Raises the Quality Bar with Function Calling Model and API Release
12/20/2023
View Article
Mixtral 8x7B on Fireworks: faster, cheaper, even before the official release
12/14/2023
View Article
LLM Inference Performance Benchmarking (Part 1)
11/3/2023
View Article
New in Fireworks: Image-to-Image and ControlNet support for SSD-1B and SDXL!
11/2/2023
View Article
Fireworks.ai Achieves SOC 2 Type II and HIPAA Compliance
10/27/2023
View Article
Accelerating Code Completion with Fireworks Fast LLM Inference
10/11/2023
View Article
Fireworks.ai Now Available on LangChain Prompt Playground
10/2/2023
View Article
Simplifying Code Infilling with Code Llama and Fireworks.ai
9/12/2023
View Article
Speed, Python: Pick Two. How CUDA Graphs Enable Fast Python Code for Deep Learning
8/29/2023
View Article
Fireworks.ai: Fast, Affordable, Customizable Gen AI Platform
8/17/2023
View Article
Multi-Query Attention is All You Need
7/12/2023
View Article