Yhyu13/LMCocktail-10.7B-v1

Yhyu13/LMCocktail-10.7B-v1 is a 10.7 billion parameter language model created by Yhyu13, formed by merging the SOLAR-10.7B-Instruct-v1.0 and rishiraj/meow models. This model leverages a novel merging technique to combine the strengths of its base models, which were top-ranked on the Open LLM Leaderboard for models under 13B parameters. With a 4096-token context length, LMCocktail-10.7B-v1 demonstrates strong performance in instruction following and complex reasoning, notably excelling in tasks that challenge typical LLM hallucination tendencies.

Warm
Public
10.7B
FP8
4096
License: llama2
Hugging Face