NewJoin us for our inaugural conference, Forge 2026
Meta logo

Llama 3.1 405B Instruct

Ready
model path:accounts/fireworks/models/llama-v3p1-405b-instruct

The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes. The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks. 405B model is the most capable from the Llama 3.1 family. This model is served in FP8 closely matching reference implementation.

Llama 3.1 405B Instruct API Features

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 3.1 405B Instruct on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
19 JUL, 2024
Kind
Base model
Provider
Meta

Specifications

Calibrated
No
Mixture-of-Experts
No
Parameters
410B

Supporting Functionality

Fine-tuning
Not Supported
Serverless
Not Supported
Context Length
131k tokens
Function Calling
Supported
Embeddings
Not Supported
Rerankers
Not Supported
Supporting image input
Not Supported

Llama 3.1 405B Instruct FAQs

Llama 3.1 405B Instruct is a multilingual instruction-tuned large language model developed by Meta. It is the largest and most capable model in the Llama 3.1 family, which includes 8B, 70B, and 405B variants.