Description: Deformable Neural Radiance Fields creates free-viewpoint portraits (nerfies) from casually captured videos.
nerf (144) d-nerf (50) nerfies (49)
The framework of Bidirectional Diffusion. It jointly trains a 3D diffusion in SDF ℒ space and a 2D diffusion in multi-view image ℕ space, which are both enhanced by foundation models and interconnected by bidirectional guidance to achieve consistent denoising between two domains.
The overall architecture : Interactive3D contains two stages with distinct 3D representations: (I) Gaussian Splatting for flexible user interactions such as add/remove parts; geometry transformation; deformable or rigid dragging and semantic editing, (II) the Gaussian blobs are converted to InstantNGP using NeRF distillation and fine-tined by our Interactive Hash Refinement Module.
The overall architecture : Interactive3D grants users precise control over the generative process through extensive 3D interaction capabilities. Interactive3D is constructed in two cascading stages, utilizing distinct 3D representations. The first stage employs Gaussian Splatting for direct user interaction, allowing modifications and guidance of the generative direction at any intermediate step through (i) Adding and Removing components, (ii) Deformable and Rigid Dragging, (iii) Geometric Transformations,