AIDC-AI/Marco-LLM-ES

AIDC-AI's Marco-LLM-ES is a 7.6 billion parameter Transformer-based language model specifically fine-tuned for common languages used in Spain, including Catalan, Basque, Galician, and Spanish. It has undergone extensive continued pretraining on approximately 50 billion tokens to enhance its capabilities in these targeted languages. The model features an improved tokenizer adaptive to multiple languages and is intended for further adaptation via post-training methods like SFT or RLHF for specific use cases.