Description: We present NeX, a new approach to novel view synthesis based on enhancements of multiplane image (MPI) that can reproduce NeXt-level view-dependent effects---in real time.
real time (651) nerf (140) view synthesis (5) multiplane image (1) neural basis (1) basis expansion (1)
We present NeX, a new approach to novel view synthesis based on enhancements of multiplane image (MPI) that can reproduce NeXt-level view-dependent effects---in real time. Unlike traditional MPI that uses a set of simple RGBα planes, our technique models view-dependent effects by instead parameterizing each pixel as a linear combination of basis functions learned from a neural network. Moreover, we propose a hybrid implicit-explicit modeling strategy that improves upon fine detail and produces state-of-the-
*A high-end GPU recommended for High and VR modes.
This table shows the average FPS for the scenes in Shiny and Real Forward-Facing datasets. The rendering was done in real time using Google Chrome’s WebGL on a machine with an NVIDIA RTX3090. (Profiling done without Vertical Synchronization (Vsync) to go beyond the monitor’s frame rate)
Supasorn Suwajanakorn
Boosting View Synthesis with Residual Transfer
Light Field Neural Rendering
Learning Neural Light Fields with Ray-Space Embedding Networks
RepurposeGANs
Jiraphon Yenphraphai