Contains the DFM-Mimir datasets from v1 and onwards.
Schneider-Kamp Lab
university
AI & ML interests
- Ressource constrained language modelling - Evaluation - Low-Bandwidth Distributed Training - Quantization - Medical Language Modelling - AI x Human
Recent Activity
View all activity
Papers
FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes