M4-ai/NeuralReyna-Mini-1.8B-v0.2

M4-ai/NeuralReyna-Mini-1.8B-v0.2 is a 1.8 billion parameter language model, fine-tuned using DPO on the Intel/orca_dpo_pairs dataset, building upon the aloobun/Reyna-Mini-1.8B-v0.2 base. This model, with a 32768 token context length, is designed for capabilities in coding, math, science, roleplay, and function calling. It is trained on OpenAI's ChatML prompt format, making it suitable for diverse conversational and task-oriented applications.

Warm
Public
1.8B
BF16
32768
License: apache-2.0
Hugging Face

No reviews yet. Be the first to review!