Delta-Vector/Rei-12B

Delta-Vector/Rei-12B is a 12 billion parameter causal language model, fine-tuned on a Mistral-Nemo-Instruct base, designed to replicate the prose quality of the Claude 3 series models (Sonnet and Opus). It utilizes a prototype Magnum V5 datamix and is optimized for generating high-quality, nuanced text, making it suitable for creative writing and complex conversational tasks. The model supports a 32768 token context length, enhancing its ability to handle extensive inputs and maintain coherence over long interactions.

Warm
Public
12B
FP8
32768
License: mit
Hugging Face

No reviews yet. Be the first to review!