NewJoin us for the Forge keynote livestream on November 3rd
DocsLog inGet started
Meta logo

Llama 3 70B Instruct

Ready
model path:accounts/fireworks/models/llama-v3-70b-instruct
Deploy on demand

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks.

Llama 3 70B Instruct API Features

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 3 70B Instruct on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
18 APR, 2024
Kind
Base model
Provider
Meta
Huggingface
meta-llama/Meta-Llama-3-70B-Instruct

Specifications

Calibrated
Yes
Mixture-of-Experts
No
Parameters
70.5B

Supporting Functionality

Fine-tuning
Not Supported
Serverless
Not Supported
Context Length
8.19k tokens
Function Calling
Not Supported
Embeddings
Not Supported
Rerankers
Not Supported
Supporting image input
Not Supported

Llama 3 70B Instruct FAQs

Llama 3 70B Instruct is an instruction-tuned large language model developed by Meta, part of the Llama 3 family released in April 2024. It is optimized for assistant-style dialogue and natural language generation tasks.