LLM360/Amber

LLM360/Amber is a 7 billion parameter English language model built with the LLaMA architecture, developed by LLM360 as part of its Pebble model series. This model is specifically released to make LLM training knowledge accessible, offering 360 model checkpoints and full data sequences under an Apache 2.0 license. While not a state-of-the-art model, Amber provides a transparent and comprehensive resource for understanding LLM training processes and intermediate results.