Jia-Bin Huang
Zhi Hao Lin
Anand Bhattad
Paper Code (coming soon!) Reconstruction, Normal, Albedo, Shading, Visibility, Semantics Abstract We show how to build a model that allows realistic, free-viewpoint renderings of a scene under novel lighting conditions from video. Our method -- UrbanIR : Urban Scene Inverse Rendering -- computes an inverse graphics representation from the video. UrbanIR jointly infers shape, albedo, visibility, and sun and sky illumination from a single video of unbounded outdoor scenes with unknown lighting. UrbanIR uses v
* By changing sunlight direction explicitly, UrbanIR simulates sharp and geometry-aware shadow.
* With proposed visibility optimization (right), UrbanIR generates high-quality shadow volume and enables realistic object insertion. * Please note that the object casts shadow on the neural scene, and the scene also casts shadow on the object. * Left: without visibility optimization, Right: with visibility optimization
Jia-Bin Huang
Zhi Hao Lin
Anand Bhattad