anyskill.github.io - AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents

Description: Deformable Neural Radiance Fields creates free-viewpoint portraits (nerfies) from casually captured videos.

open-vocabulary (2) physical skill (2) interactive agent (2)

Example domain paragraphs

Traditional approaches in physics-based motion generation, centered around imitation learning and reward shaping, often struggle to adapt to new scenarios. To tackle this limitation, we propose AnySkill , a novel hierarchical method that learns physically plausible interactions following open-vocabulary instructions . Our approach begins by developing a set of atomic actions via a low-level controller trained via imitation learning. Upon receiving an open-vocabulary textual instruction, AnySkill employs a h

AnySkill model

Note : Select a motion from dropdown and drag to move your view.

Links to anyskill.github.io (1)