NewJoin us for our inaugural conference, Forge 2026
Meta logo

Llama 2 70B

Ready
model path:accounts/fireworks/models/llama-v2-70b

Meta developed and publicly released the Llama 2 family of large language models (LLMs), a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama-2-Chat, are optimized for dialogue use cases. Llama-2-Chat models outperform open-source chat models on most benchmarks we tested, and in our human evaluations for helpfulness and safety, are on par with some popular closed-source models like ChatGPT and PaLM.

Llama 2 70B API Features

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 2 70B on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
3 JAN, 2024
Kind
Base model
Provider
Meta

Specifications

Calibrated
No
Mixture-of-Experts
No

Supporting Functionality

Fine-tuning
Not Supported
Serverless
Not Supported
Context Length
4.09k tokens
Function Calling
Not Supported
Embeddings
Not Supported
Rerankers
Not Supported
Supporting image input
Not Supported