Fireworks AI raises $250M Series C to power the future of enterprise AI. Read more

Model Library
/Meta/Llama 3 70B Instruct (HF version)
Meta Mark

Llama 3 70B Instruct (HF version)

Ready
fireworks/llama-v3-70b-instruct-hf

    Meta’s Llama 3 instruction tuned models are optimized for dialogue use cases and outperform many of the available open source chat models on common industry benchmarks. Llama 3 70B Instruct (HF Version) is the original, FP16 version of Llama 3 70B Instruct whose results should be consistent with the official Hugging Face implementation.

    Llama 3 70B Instruct (HF version) API Features

    Fine-tuning

    Docs

    Llama 3 70B Instruct (HF version) can be customized with your data to improve responses. Fireworks uses LoRA to efficiently train and deploy your personalized model

    On-demand Deployment

    Docs

    On-demand deployments give you dedicated GPUs for Llama 3 70B Instruct (HF version) using Fireworks' reliable, high-performance system with no rate limits.

    Metadata

    State
    Ready
    Created on
    4/21/2024
    Kind
    Base model
    Provider
    Meta
    Hugging Face
    Meta-Llama-3-70B-Instruct

    Specification

    Calibrated
    No
    Mixture-of-Experts
    No
    Parameters
    70.6B

    Supported Functionality

    Fine-tuning
    Supported
    Serverless
    Not supported
    Serverless LoRA
    Supported
    Context Length
    8.2k tokens
    Function Calling
    Not supported
    Embeddings
    Not supported
    Rerankers
    Not supported
    Support image input
    Not supported