Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with

111 Pages·2017·5.52 MB·English

by  Robert Maier

Intrinsic3D: High-Quality 3D Reconstruction by
Joint Appearance and Geometry Optimization
with Spatially-Varying Lighting
R. Maier1,2, K. Kim1, D. Cremers2, J. Kautz1, M. Nießner2,3
Fusion Ours
1 NVIDIA 2 TU Munich 3 Stanford University
International Conference on Computer Vision 2017
Overview
• Motivation & State-of-the-art
• Approach
• Results
• Conclusion
2
Overview
• Motivation & State-of-the-art
• Approach
• Results
• Conclusion
3
Motivation
• Recent progress in Augmented Reality (AR) /
Virtual Reality (VR)
Microsoft HoloLens HTC Vive
4
Motivation
• Recent progress in Augmented Reality (AR) /
Virtual Reality (VR)
Microsoft HoloLens HTC Vive
• Requirement of high-quality 3D content for AR,
VR, Gaming …
NVIDIA VR Funhouse
5
Motivation
• Recent progress in Augmented Reality (AR) /
Virtual Reality (VR)
Microsoft HoloLens HTC Vive
• Requirement of high-quality 3D content for AR,
VR, Gaming …
• Usually: manual modelling (e.g. Maya)
NVIDIA VR Funhouse
6
Motivation
• Recent progress in Augmented Reality (AR) /
Virtual Reality (VR)
Microsoft HoloLens HTC Vive
• Requirement of high-quality 3D content for AR,
VR, Gaming …
• Usually: manual modelling (e.g. Maya)
• Wide availability of commodity RGB-D sensors:
efficient methods for 3D reconstruction
NVIDIA VR Funhouse
Asus Xtion
7
Motivation
• Recent progress in Augmented Reality (AR) /
Virtual Reality (VR)
Microsoft HoloLens HTC Vive
• Requirement of high-quality 3D content for AR,
VR, Gaming …
• Usually: manual modelling (e.g. Maya)
• Wide availability of commodity RGB-D sensors:
efficient methods for 3D reconstruction
• Challenge: how to reconstruct high-quality 3D NVIDIA VR Funhouse
models with best-possible geometry and color
from low-cost depth sensors?
Asus Xtion
8
State-of-the-art
RGB-D based 3D Reconstruction
• Goal: stream of RGB-D frames of a scene → 3D shape that maximizes the geometric
consistency
9
State-of-the-art
RGB-D based 3D Reconstruction
• Goal: stream of RGB-D frames of a scene → 3D shape that maximizes the geometric
consistency
• Real-time, robust, fairly accurate geometric reconstructions
KinectFusion, 2011
“KinectFusion: Real-time Dense
Surface Mapping and Tracking”,
Newcombeet al., ISMAR 2011. 10