Danielbrdz/Barcenas-Llama3-8b-ORPO
Danielbrdz/Barcenas-Llama3-8b-ORPO is an 8 billion parameter language model based on Llama 3, specifically fine-tuned from VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct. This model utilizes the novel ORPO training method and was trained on the reciperesearch/dolphin-sft-v0.1-preference dataset, which incorporates GPT-4 improved conversational data. It is optimized for enhanced conversational capabilities, making it suitable for dialogue-focused applications.