Deathsquad10/TinyLlama-1.1B-Remix-V.2
Deathsquad10/TinyLlama-1.1B-Remix-V.2 is a 1.1 billion parameter Llama-architecture model, fine-tuned from TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T. It adopts the same architecture and tokenizer as Llama 2, making it compatible with existing Llama-based projects. This model is specifically fine-tuned as a chat model using a Zephyr-like training recipe, leveraging UltraChat and UltraFeedback datasets for conversational capabilities. Its compact size and chat optimization make it suitable for applications requiring efficient, dialogue-oriented language processing.