Snorkel Mistral PairRM DPO
Readymodel path:accounts/fireworks/models/snorkel-mistral-7b-pairrm-dpo
A fine-tuned version of the Mistral-7B model developed by Snorkel using PairRM for response ranking and Direct Preference Optimization (DPO) for model adaptation and refinement.
On-demand deployments allow you to use Snorkel Mistral PairRM DPO on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits.