videoswap.github.io - VideoSwap

Description: VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

videoswap (1)

Example domain paragraphs

📖 TL;DR : VideoSwap can swap users' customized concepts into videos while preserving the background . The target swap will align the semantic point trajectory (extracted from the source video or edited by users through dragging ).

Current diffusion-based video editing primarily focuses on structure-preserved editing by utilizing various dense correspondences to ensure temporal consistency and motion alignment. However, these approaches are often ineffective when the target edit involves a shape change.

To embark on video editing with shape change, we explore customized video subject swapping in this work, where we aim to replace the main subject in a source video with a target subject having a distinct identity and potentially different shape.

Links to videoswap.github.io (6)