The paper introduces Structured Polarization, a first-of-its-kind depth and reflectance sensing method using structured light of polarized light, referred to as SPIDeRS. The key idea is to project structured light patterns of varied angle of linear polarization (AoLP). By using structured polarization patterns and an RGB-polarimetric camera, the method can realize invisible depth and texture capture. Polarization also enables direct recovery of surface normals and reflectance properties of the target surface.
The authors implement SPIDeRS by assembling a projector-camera system with an RGB-polarimetric camera and a polarization projector whose AoLP can be controlled in the throw at each pixel. They derive a novel method to accurately decode the reflected AoLP structured pattern, accounting for ambient light and polarimetric reflection.
The results show that the method successfully reconstructs object shapes of various materials and is robust to diffuse reflection and ambient light. It can also estimate the reflectance and per-pixel surface normals, which can be used for relighting the object. The authors believe SPIDeRS opens a new avenue of research and practical use of polarization in visual sensing.
To Another Language
from source content
arxiv.org
Key Insights Distilled From
by Tomoki Ichik... at arxiv.org 04-02-2024
https://arxiv.org/pdf/2312.04553.pdfDeeper Inquiries