Qwen/Qwen3-0.6B-Base

Qwen/Qwen3-0.6B-Base is a 0.6 billion parameter causal language model developed by Qwen, part of the Qwen3 series. Pre-trained on 36 trillion tokens across 119 languages, it features an expanded, high-quality corpus and architectural refinements like qk layernorm. This model is designed for broad language modeling and general knowledge acquisition, with a focus on improving reasoning skills and long-context comprehension up to 32,768 tokens.