A fine-tuned version of Mistral-7B trained on the OpenOrca dataset, based on the dataset generated for Microsoft Research's Orca Paper. Developed using OpenChat packing, and trained using Axolotl.
Fine-tuningDocs | Mistral 7B OpenOrca can be customized with your data to improve responses. Fireworks uses LoRA to efficiently train and deploy your personalized model |
On-demand DeploymentDocs | On-demand deployments allow you to use Mistral 7B OpenOrca on dedicated GPUs with Fireworks' high-performance serving stack with high reliability and no rate limits. |
