Mixtral MoE 8x22B Instruct API & Playground

Mixtral MoE 8x22B Instruct v0.1 is the instruction-tuned version of Mixtral MoE 8x22B v0.1 and has the chat completions API enabled.

Mixtral MoE 8x22B Instruct API Features

On-demand Deployment

Docs

On-demand deployments allow you to use Mixtral MoE 8x22B Instruct on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State

Ready

Created on

17 APR, 2024

Kind

Base model

Provider

Mistral

Huggingface

mistralai/Mixtral-8x22B-Instruct-v0.1

Specifications

Calibrated

Mixture-of-Experts

Yes

Parameters

143B

Supporting Functionality

Fine-tuning

Not Supported

Serverless

Not Supported

Context Length

65.5k tokens

Function Calling

Supported

Embeddings

Not Supported

Rerankers

Not Supported

Supporting image input

Not Supported