VAGOsolutions/SauerkrautLM-Gemma-2b

VAGOsolutions/SauerkrautLM-Gemma-2b is a 2.5 billion parameter instruction-tuned model developed jointly by VAGO solutions and Hyperspace.ai, based on Google's Gemma-2b architecture. This model is specifically fine-tuned for German and English bilingual capabilities, utilizing a novel laser-QLoRA training technique to enhance performance, particularly in math abilities, while preserving prior knowledge. It offers an 8192 token context length and is optimized for general language tasks with a focus on German language skills.