TinyLlama/TinyLlama-1.1B-Chat-v1.0

TinyLlama-1.1B-Chat-v1.0 is a 1.1 billion parameter Llama 2-based conversational model developed by the TinyLlama project, trained on 3 trillion tokens with a 2048-token context length. This compact model is fine-tuned using the Zephyr training recipe, leveraging UltraChat for initial instruction tuning and UltraFeedback with DPO for alignment. It is designed for chat applications requiring a restricted computation and memory footprint.