NewJoin us for our inaugural conference, Forge 2026
DocsLog inGet started
Deepseek logo

DeepSeek Coder 7B Base

Ready
model path:accounts/fireworks/models/deepseek-coder-7b-base
Deploy on demand

Deepseek Coder is composed of a series of code language models, each trained from scratch on 2T tokens, with a composition of 87% code and 13% natural language in both English and Chinese. Deepseek Coder 6.7B Base is a 6.7B parameter model with Multi-Head Attention trained on 2 trillion tokens by employing a window size of 16K and an extra fill-in-the-blank task

DeepSeek Coder 7B Base API Features

On-demand Deployment

Docs

On-demand deployments allow you to use DeepSeek Coder 7B Base on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
15 MAR, 2024
Kind
Base model
Provider
Deepseek
Huggingface
deepseek-ai/deepseek-coder-6.7b-base

Specifications

Calibrated
No
Mixture-of-Experts
No
Parameters
6.91B

Supporting Functionality

Fine-tuning
Not Supported
Serverless
Not Supported
Context Length
4.09k tokens
Function Calling
Not Supported
Embeddings
Not Supported
Rerankers
Not Supported
Supporting image input
Not Supported

DeepSeek Coder 7B Base FAQs

DeepSeek Coder 7B Base is a base language model developed by DeepSeek AI as part of its DeepSeek Coder family. The model is trained from scratch on 2 trillion tokens, with a composition of 87% code and 13% natural language in English and Chinese. It uses a fill-in-the-blank auxiliary task during training.