Epiculous/Crimson_Dawn-v0.2

Crimson_Dawn-v0.2 is a 12 billion parameter language model developed by Epiculous, based on Mistral-Nemo-Base-2407, and fine-tuned with RSLoRA. This model features a 32768 token context length and is specifically trained using the ChatML format for conversational and instructional tasks. It incorporates significantly more training data than its predecessor, focusing on improved performance in instruction following.

Warm
Public
12B
FP8
32768
License: apache-2.0
Hugging Face