nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated

nbeerbower/Mahou-1.5-mistral-nemo-12B-lorablated is a 12 billion parameter language model created by nbeerbower, developed through a merge of flammenai/Mahou-1.5-mistral-nemo-12B and nbeerbower/Mistral-Nemo-12B-abliterated-LORA using the task arithmetic method. This model, with a 32768 token context length, is designed for general language tasks, demonstrating an average performance of 26.45 on the Open LLM Leaderboard evaluations. Its unique composition aims to leverage the strengths of its constituent models for diverse applications.

Warm
Public
12B
FP8
32768
License: apache-2.0
Hugging Face

No reviews yet. Be the first to review!