Serverless 2.0 is live: control reliability & speed without reserved capacity. Get Started.

Model Library
/Meta/Llama Guard v2 8B
Meta Mark

Llama Guard v2 8B

Ready
model path:accounts/fireworks/models/llama-guard-2-8b

Meta Llama Guard 2 is an 8B parameter Llama 3-based LLM safeguard model. Similar to Llama Guard, it can be used for classifying content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts as an LLM – it generates text in its output that indicates whether a given prompt or response is safe or unsafe, and if unsafe, it also lists the content categories violated.

Llama Guard v2 8B API Features

Fine-tuning

Docs

Llama Guard v2 8B can be customized with your data to improve responses. Fireworks uses LoRA to efficiently train and deploy your personalized model

On-demand Deployment

Docs

On-demand deployments allow you to use Llama Guard v2 8B on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.

Metadata

State
Ready
Created on
4/18/2024
Kind
Base model
Provider
Meta

Specification

Calibrated
Yes
Mixture-of-Experts
No
Parameters
8.03B

Supported Functionality

Fine-tuning
Supported
Serverless
Not supported
Context Length
8.19k tokens
Function Calling
Not supported
Embeddings
Not supported
Rerankers
Not supported
Support image input
Not supported