habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1

The habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1 is a 1.1 billion parameter instruction-tuned causal language model, fine-tuned from TinyLlama-1.1B-intermediate-step-715k-1.5T. Developed by habanoz, this model was instruction-tuned using the OpenAssistant/oasst_top1_2023-08-25 dataset with QLoRA. It is designed for general instruction-following tasks, offering a compact solution for applications requiring a smaller, efficient language model.

Warm
Public
1.1B
BF16
2048
License: apache-2.0
Hugging Face