Qwen/Qwen3-4B-Base

Qwen/Qwen3-4B-Base is a 4.0 billion parameter causal language model developed by Qwen, part of the Qwen3 series. Pre-trained on 36 trillion tokens across 119 languages, it features architectural refinements and a three-stage pre-training process focusing on broad language modeling, reasoning skills, and long-context comprehension up to 32,768 tokens. This base model is designed for general language understanding and generation tasks, leveraging an expanded, high-quality multilingual corpus.