geoaware2drepusingcad.github.io - Learning Geometric-aware Properties in 2D Representation Using Lightweight CAD Models, or Zero Real 3D Pairs

Example domain paragraphs

Cross-modal training using a 2D-3D paired dataset, e.g., multi-view images/scene scans, presents an effective way to enhance 2D scene understanding by introducing geometric and view-invariance priors into 2D features. However, the need for large-scale scene datasets limits their further im- provements and scalability. This paper explores an alternative learning method by leveraging a lightweight and publicly available type of 3D data, i.e., CAD models. We construct a 3D space with geometric-aware alignment

The semantic segmentation results are fine-tuned and conducted on NYUv2 dataset.

Links to geoaware2drepusingcad.github.io (2)

diffusionlight.github.io DiffusionLight: Light Probes for Free by Painting a Chrome Ball
pattaramaneea.github.io Pattaramanee Arsomngern