Fireworks AI raises $250M Series C to power the future of enterprise AI. Read more

Model Library
/Mistral/Mistral 7B
Mistral Logo Icon

Mistral 7B

Ready
fireworks/mistral-7b

    The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters utilizing Grouped-query attention (GQA) for faster inference and Sliding window attention (SWA) to handle longer sequences at a lower cost.

    Mistral 7B API Features

    On-demand Deployment

    Docs

    On-demand deployments give you dedicated GPUs for Mistral 7B using Fireworks' reliable, high-performance system with no rate limits.

    Metadata

    State
    Ready
    Created on
    10/6/2023
    Kind
    Base model
    Provider
    Mistral
    Hugging Face
    Mistral-7B-v0.1

    Specification

    Calibrated
    No
    Mixture-of-Experts
    No
    Parameters
    7B

    Supported Functionality

    Fine-tuning
    Not supported
    Serverless
    Not supported
    Serverless LoRA
    Supported
    Context Length
    32.8k tokens
    Function Calling
    Not supported
    Embeddings
    Not supported
    Rerankers
    Not supported
    Support image input
    Not supported