mlx-community/Meta-Llama-3.1-70B-Instruct-bf16-CORRECTED

The mlx-community/Meta-Llama-3.1-70B-Instruct-bf16-CORRECTED model is a 70 billion parameter instruction-tuned language model, converted to MLX format from Meta's Llama-3.1-70B-Instruct. This model is designed for efficient deployment and inference within the MLX ecosystem, leveraging its 32768 token context length for complex conversational and generative AI tasks. It is particularly suited for developers working with Apple silicon, offering optimized performance for large-scale language processing applications. Its primary strength lies in following instructions and generating coherent, contextually relevant text.

Warm
Public
70B
FP8
32768
License: llama3.1
Hugging Face

No reviews yet. Be the first to review!