Fireworks AI raises $250M Series C to power the future of enterprise AI. Read more

Model Library
/Meta/Llama 3.1 405B Instruct
Meta Mark

Llama 3.1 405B Instruct

Ready
fireworks/llama-v3p1-405b-instruct

    The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes. The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks. 405B model is the most capable from the Llama 3.1 family. This model is served in FP8 closely matching reference implementation.

    Fireworks Features

    On-demand Deployment

    Docs

    On-demand deployments give you dedicated GPUs for Llama 3.1 405B Instruct using Fireworks' reliable, high-performance system with no rate limits.

    Metadata

    State
    Ready
    Created on
    7/19/2024
    Kind
    Base model
    Provider
    Meta
    Hugging Face
    Llama-3.1-405B-Instruct

    Specification

    Calibrated
    No
    Mixture-of-Experts
    No
    Parameters
    410.1B

    Supported Functionality

    Fine-tuning
    Not supported
    Serverless
    Not supported
    Serverless LoRA
    Supported
    Context Length
    131.1k tokens
    Function Calling
    Supported
    Embeddings
    Not supported
    Rerankers
    Not supported
    Support image input
    Not supported