Qwen/Qwen2-72B-Instruct

Qwen2-72B-Instruct is a 72.7 billion parameter instruction-tuned causal language model developed by Qwen, part of the new Qwen2 series. It is built on the Transformer architecture with SwiGLU activation and group query attention, and features an improved tokenizer for multilingual and code support. This model demonstrates strong performance across language understanding, generation, multilingual capabilities, coding, mathematics, and reasoning benchmarks, and supports an extended context length of up to 131,072 tokens.