Open Source arXiv cs.CL

DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling

DantinoXJAX/Flaxlanguage generationbenchmarking

Language generation research increasingly spans three paradigms: autoregressive decoding, discrete masked diffusion, and continuous flow-matching. Comparing them is difficult because each typically lives in a separate codebase, meaning measured differences can reflect implementation details rather than the paradigms themselves.

DantinoX addresses this by providing an open-source JAX/Flax library in which a single modular Transformer backbone serves all three paradigms. Switching the generation paradigm, attention mechanism, or hardware topology requires only a configuration change, while the backbone architecture, tokenizer, initialization strategy, and training infrastructure remain consistent.

This design supports controlled cross-paradigm comparisons within one API for training, streaming inference, and benchmarking.

Read original →

← Back to home