princeton-nlp/Llama-3-Instruct-8B-DPO

princeton-nlp/Llama-3-Instruct-8B-DPO is an 8 billion parameter language model developed by princeton-nlp, based on the Llama-3 architecture with an 8192-token context length. This model is fine-tuned using the SimPO (Simple Preference Optimization) method, which utilizes a reference-free reward. It is designed for instruction-following tasks, leveraging its DPO-based optimization for improved conversational and response generation capabilities.