Excited to launch a multi-year partnership bringing Fireworks to Microsoft Azure Foundry! Learn more

Model Library
/NVIDIA Nemotron 3 Super 120B A12B FP8

NVIDIA Nemotron 3 Super 120B A12B FP8

fireworks/nvidia-nemotron-3-super-120b-a12b-fp8

    Nemotron-3-Super-120B-A12B-FP8 is a large language model trained by NVIDIA for agentic, reasoning, and conversational tasks. It uses a hybrid Latent MoE architecture with interleaved Mamba-2 and MoE layers, plus Multi-Token Prediction (MTP) for faster generation. 12B active / 120B total parameters. Supports English, French, German, Italian, Japanese, Spanish, and Chinese.

    NVIDIA Nemotron 3 Super 120B A12B FP8 API Features

    On-demand Deployment

    Docs

    On-demand deployments give you dedicated GPUs for NVIDIA Nemotron 3 Super 120B A12B FP8 using Fireworks' reliable, high-performance system with no rate limits.

    Metadata

    State
    Unknown
    Created on
    N/A
    Kind
    Unknown
    Provider
    N/A

    Specification

    Calibrated
    No
    Mixture-of-Experts
    No
    Parameters
    N/A

    Supported Functionality

    Fine-tuning
    Not supported
    Serverless
    Not supported
    Context Length
    262.1k tokens
    Function Calling
    Not supported
    Embeddings
    Not supported
    Rerankers
    Not supported
    Support image input
    Not supported