Serverless 2.0 is live: control reliability & speed without reserved capacity. Get Started.

Model Library
/Meta/Llama 3 8B
model path:accounts/fireworks/models/llama-v3-8b

Llama 3 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.

Llama 3 8B API Features

Fine-tuning

Docs

Llama 3 8B can be customized with your data to improve responses. Fireworks uses LoRA to efficiently train and deploy your personalized model

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 3 8B on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
11/21/2024
Kind
Base model
Provider
Meta

Specification

Calibrated
Yes
Mixture-of-Experts
No
Parameters
8.03B

Supported Functionality

Fine-tuning
Supported
Serverless
Not supported
Context Length
8.19k tokens
Function Calling
Not supported
Embeddings
Not supported
Rerankers
Not supported
Support image input
Not supported