Guilherme34/Firefly-V2

Guilherme34/Firefly-V2 is a 3.2 billion parameter language model created by Guilherme34, formed by merging Guilherme34/Firefly and SicariusSicariiStuff/Impish_LLAMA_3B using a task arithmetic merge method. This model is designed for general text generation tasks, leveraging the combined strengths of its constituent models. It utilizes a bfloat16 dtype for efficient processing and supports a context length of 32768 tokens.