Description: BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis
We present a method for reconstructing high-quality meshes of large unbounded real-world scenes suitable for photorealistic novel view synthesis. We first optimize a hybrid neural volume-surface scene representation designed to have well-behaved level sets that correspond to surfaces in the scene. We then bake this representation into a high-quality triangle mesh, which we equip with a simple and fast view-dependent appearance model based on spherical Gaussians. Finally, we optimize this baked representatio
Our method bakes a hybrid VolSDF/mip-NeRF 360 scene representation into a triangle mesh, then optimizes a lightweight view-dependent appearance model to reproduce the training images. The final color of the rendered mesh is a sum of spherical Gaussian lobes (queried with the outgoing view direction) and a diffuse color. These parameters are stored per-vertex on the underlying mesh.
Something something? or delete. could be like mipnerf360/volsdf, something that uses spherical gaussians? idk
Jon Barron
Ben Mildenhall
Richard Szeliski
Phogzone | A portfolio for Peter Hedman
Dor Verbin
Lior Yariv
Tegmark Group
PL-NeRF
Wenjie Zhao
Jaehyeok Bae
Ben Mildenhall