princeton-nlp/Llama-3-Base-8B-SFT-RDPO

princeton-nlp/Llama-3-Base-8B-SFT-RDPO is an 8 billion parameter Llama-3-based language model developed by Princeton NLP. It is fine-tuned using the SimPO (Simple Preference Optimization with a Reference-Free Reward) method, as detailed in their research preprint. This model is designed for tasks benefiting from advanced preference optimization techniques, offering enhanced performance in areas where traditional reward models might fall short. Its 8192-token context length supports processing moderately long inputs.