BramVanroy/fietje-2

Fietje-2 is a 2.7 billion parameter causal language model developed by BramVanroy, adapted from Microsoft's Phi-2 architecture. It is specifically tailored for Dutch text generation, having been continuously pretrained on 28 billion Dutch tokens from sources like Wikipedia and CulturaX. This model offers an efficient solution for Dutch language tasks, performing comparably to larger models twice its size.