unsloth/Qwen3-4B-Base

unsloth/Qwen3-4B-Base is a 4.0 billion parameter causal language model developed by Qwen, part of the Qwen3 series. Pre-trained on 36 trillion tokens across 119 languages, it features an expanded, higher-quality corpus and architectural refinements like qk layernorm. This model excels in broad language modeling, general knowledge acquisition, and improved reasoning skills, with a context length of 32,768 tokens.