diffusion-rosie.github.io - Scaling Robot Learning with Semantically Imagined Experience

Description: RT-1: Robotics Transformer

Example domain paragraphs

To Appear at RSS 2023

We propose using text-guided diffusion models for data augmentation for robot learning. These augmentations can produce photorealistic images for learning downstream tasks such as manipulation.

Recent advances in robot learning have shown promise in enabling robots to perform a variety of manipulation tasks and generalize to novel scenarios. One of the key contributing factors to this progress is the scale of robot data used to train the models. To obtain large-scale datasets, prior approaches have relied on either demonstrations requiring high human involvement or engineering-heavy autonomous data collection schemes, both of which are challenging to scale. To mitigate this issue, we propose an al

Links to diffusion-rosie.github.io (6)