campedersen/cad0-mini

The campedersen/cad0-mini is a compact 0.5 billion parameter language model. Designed for efficiency, it features an exceptionally long context window of 131072 tokens, enabling it to process and understand extensive amounts of information. This model is particularly suited for tasks requiring deep contextual understanding over very long sequences, such as document analysis or extended conversational AI.

Warm
Public
0.5B
BF16
32768
License: mit
Hugging Face

No reviews yet. Be the first to review!