Deathsquad10/TinyLlama-1.1B-Remix-V.2

Deathsquad10/TinyLlama-1.1B-Remix-V.2 is a 1.1 billion parameter Llama-architecture model, fine-tuned from TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T. It adopts the same architecture and tokenizer as Llama 2, making it compatible with existing Llama-based projects. This model is specifically fine-tuned as a chat model using a Zephyr-like training recipe, leveraging UltraChat and UltraFeedback datasets for conversational capabilities. Its compact size and chat optimization make it suitable for applications requiring efficient, dialogue-oriented language processing.

Warm
Public
1.1B
BF16
2048
License: apache-2.0
Hugging Face

No reviews yet. Be the first to review!