A fine-tuned version of the Mistral-7B model developed by Snorkel using PairRM for response ranking and Direct Preference Optimization (DPO) for model adaptation and refinement.
On-demand deployments give you dedicated GPUs for Snorkel Mistral PairRM DPO using Fireworks' reliable, high-performance system with no rate limits.
Learn MoreSnorkel
32768
$0.2
