Qwen/Qwen3-8B-Base

Qwen3-8B-Base is an 8.2 billion parameter causal language model developed by Qwen, part of the Qwen3 series. Pre-trained on 36 trillion tokens across 119 languages, it features an expanded, higher-quality corpus and architectural refinements like qk layernorm. This base model excels in broad language modeling, general knowledge acquisition, and improved reasoning skills, making it suitable for diverse foundational NLP tasks.