GritLM/GritLM-7B-KTO

GritLM/GritLM-7B-KTO is a 7 billion parameter generative representational instruction-tuned language model developed by Niklas Muennighoff and ContextualAI. This model unifies text representation (embedding) and text generation, achieving state-of-the-art performance in both tasks. It is a KTO-finetuned version of GritLM-7B, which is based on Mistral 7B, and features an 8192-token context length. Its primary strength lies in its dual capability for high-quality text generation and robust text embeddings.