freewheelin/free-solar-evo-v0.1

free-solar-evo-v0.1 is a 10.7 billion parameter language model developed by Freewheelin, based on the S-SOLAR-10.7B-v1.5 architecture. This model leverages an evolutionary model merge method, inspired by the Sakana project, to enhance its capabilities. With a context length of 4096 tokens, it is designed for general language tasks, offering a balanced approach to performance and efficiency.

Warm
Public
10.7B
FP8
4096
License: mit
Hugging Face

No reviews yet. Be the first to review!