Announcing our Series D and $1B ARR

Model Library
/Meta/Llama 3 70B Instruct
Meta Mark

Llama 3 70B Instruct

Ready
model path:accounts/fireworks/models/llama-v3-70b-instruct

Meta developed and released the Meta Llama 3 family of large language models (LLMs), a collection of pretrained and instruction tuned generative text models in 8 and 70B sizes. The Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks.

Llama 3 70B Instruct API Features

Fine-tuning

Docs

Llama 3 70B Instruct can be customized with your data to improve responses. Fireworks uses LoRA to efficiently train and deploy your personalized model

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 3 70B Instruct on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Llama 3 70B Instruct FAQs

Metadata

State
Ready
Created on
4/18/2024
Kind
Base model
Provider
Meta

Specification

Calibrated
Yes
Mixture-of-Experts
No
Parameters
70.5B

Supported Functionality

Fine-tuning
Supported
Serverless
Not supported
Context Length
8.19k tokens
Function Calling
Not supported
Embeddings
Not supported
Rerankers
Not supported
Support image input
Not supported