NewJoin us for our inaugural conference, Forge 2026
NVIDIA logo

Llama 3.1 Nemotron 70B

Ready
model path:accounts/fireworks/models/llama-v3p1-nemotron-70b-instruct

Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries. This model was trained using RLHF on a Llama-3.1-70B-Instruct model. As of 1 Oct 2024, this model is #1 on all three automatic alignment benchmarks (verified tab for AlpacaEval 2 LC), edging out strong frontier models such as GPT-4o and Claude 3.5 Sonnet.

Llama 3.1 Nemotron 70B API Features

On-demand Deployment

Docs

On-demand deployments allow you to use Llama 3.1 Nemotron 70B on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
16 OCT, 2024
Kind
Base model
Provider
NVIDIA

Specifications

Calibrated
Yes
Mixture-of-Experts
No
Parameters
70.5B

Supporting Functionality

Fine-tuning
Not Supported
Serverless
Not Supported
Context Length
131k tokens
Function Calling
Not Supported
Embeddings
Not Supported
Rerankers
Not Supported
Supporting image input
Not Supported