AI & ML interests

Datasets and evaluation results for Mulligan: Performance-Guided Data Collection for Efficient On-Robot Learning.

Recent Activity

Organization Card

Mulligan

Performance-Guided Data Collection for Efficient On-Robot Learning

Project · Paper · Code · Policy Arena

Release release-1: 221 LeRobot trajectory datasets, 2 simulation evaluation bundles and 180 model repositories (596 checkpoints). Every repository is MIT licensed and tagged release-1. Derived views share episodes with their raw parents, so read a card's role and parent before combining datasets.

TaskDatasetsModelsCollection
Insert Marker (real-marker-d2)4320real-marker-d2-6ab2fb65f74c1c6cd807e8c4
Thread Nut (real-square-d2)4421real-square-d2-6ab2fb7db2157ae28cbbbbce
Route Cable (real-routing-d2)6335real-routing-d2-6ab2fb7d730388cfe7aaa3f5
Square-Narrow (sim-square-narrow)3550simulation-square-narrow-6ab2fb7d7046e56db7bd2c72
Square-Broad (sim-square-broad)3854simulation-square-broad-6ab2fb7def3ad8e8f0b05681

Datasets

Insert Marker, 43 datasets
Thread Nut, 44 datasets
Route Cable, 63 datasets
Square-Narrow, 35 datasets
Square-Broad, 38 datasets

cNN is a collection increment, rNN a model round and bNN a recorded evaluation session. An rNN-eval dataset joins every evaluation session of one task and round on the initial state. Evaluation recordings can train later models, so check the consuming model's card before treating one as held out.

Models

596 checkpoints in 180 repositories: every checkpoint that collected, scored or was evaluated in the released datasets. Each card lists its training run config, training and validation datasets and evaluation results. .pt files are PyTorch pickles; load them only from a source you trust.

Insert Marker, 20 model repositories
Thread Nut, 21 model repositories
Route Cable, 35 model repositories
Square-Narrow, 50 model repositories
Square-Broad, 54 model repositories

Pin the release-1 tag or its commit for reproducible reads. Generated from the release manifests of ankile/mulligan.