robotics-transformer-x.github.io - Open X-Embodiment: Robotic Learning Datasets and RT-X Models

Description: RT-X

Example domain paragraphs

Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models, with general pretrained backbones serving as a starting point for many applications. Can such a consolidation happen in robotics? Conventionally, robotic learning methods train a separate model for every application, every robot, and even every environment. Can we instead train “g

move red pepper to tray

pick ice cream

Links to robotics-transformer-x.github.io (52)