Dutch ModernBERT encoders (144M, 230M) pretrained from scratch with JAX/Flax on TPU, on mC4, CulturaX and FineWeb-2.
Yeb Havinga PRO
yhavinga
AI & ML interests
None yet
Recent Activity
updated a collection about 1 hour ago
Dutch ModernBERT (dmbert) updated a collection about 1 hour ago
Dutch ModernBERT (dmbert) updated a collection about 1 hour ago
Dutch ModernBERT (dmbert)Organizations
spaces 4
pinned
Sleeping
Featured
5
Netherator - teller of tales from the Netherlands
🧙
Generate Dutch text based on a given prompt
Running
Agents
8
Dutch Tokenizer Arena
⚡
Explore and compare tokenizers
Sleeping
8
Pre-training Dutch T5 and UL2 Models, evaluation and model lists
🚀
Explore and compare Dutch T5 models
Runtime error
5
Rosetta - translate between Dutch and English
Translate text between English and Dutch
models 27
yhavinga/modernbert-dutch-base-wide
Fill-Mask • 0.3B • Updated • 24 • 3
yhavinga/dmbert-230m-fineweb2
Fill-Mask • 0.3B • Updated • 64
yhavinga/dmbert-230m-culturax
Fill-Mask • 0.3B • Updated • 8
yhavinga/dmbert-230m-mc4
Fill-Mask • 0.3B • Updated • 8
yhavinga/dmbert-144m-mc4
Fill-Mask • 0.2B • Updated • 10
yhavinga/GLM-4.7-REAP-40p-GGUF
218B • Updated • 78 • 2
yhavinga/gpt-neo-1.3B-dutch
Text Generation • 1B • Updated • 81 • 4
yhavinga/t5-v1.1-base-dutch-cased
0.2B • Updated • 96 • 1
yhavinga/t5-base-dutch
0.2B • Updated • 115 • 7
yhavinga/dutch-llama-tokenizer
Updated • 2
datasets 12
yhavinga/mc4_nl_cleaned
Viewer • Updated • 165M • 59 • 16
yhavinga/squad-nl-mini
Viewer • Updated • 3.33k • 31
yhavinga/culturax_dutch_test
Viewer • Updated • 1k • 22
yhavinga/fineweb_edu_score_gt_4_test
Viewer • Updated • 1k • 12
yhavinga/Openhermes-2.5-dutch-97k
Viewer • Updated • 97.2k • 34 • 4
yhavinga/squad_v2_dutch
Viewer • Updated • 142k • 84 • 4
yhavinga/orpo-dpo-mix-dutch-40k
Viewer • Updated • 43.1k • 23 • 3
yhavinga/ccmatrix
Updated • 4.02k • 27
yhavinga/imdb_dutch
Viewer • Updated • 100k • 44
yhavinga/open_subtitles_en_nl
Viewer • Updated • 3.05M • 49 • 3