Toppy M 7B API & Playground

A wild 7B parameter model that merges several models using the new task_arithmetic merge method from mergekit.

Toppy M 7B API Features

On-demand Deployment

On-demand deployments allow you to use Toppy M 7B on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State

Ready

Created on

2/29/2024

Kind

Base model

Provider

Undi95

Hugging Face

Undi95/Toppy-M-7B

Specification

Calibrated

Mixture-of-Experts

Parameters

7.24B

Supported Functionality

Fine-tuning

Not supported

Serverless

Not supported

Context Length

32.7k tokens

Function Calling

Not supported

Embeddings

Not supported

Rerankers

Not supported

Support image input

Not supported