- Open Access
Specular highlights detection and reduction with multi-flash photography
Journal of the Brazilian Computer Society volume 12, pages 35–42 (2006)
We present a novel method to reduce the effect of specularities in digital images. Our approach relies on a simple modification of the capture setup: a multi-flash camera is used to take multiple pictures of the scene, each one with a differently positioned light source. We then formulate the problem of specular highlights reduction as solving a Poisson equation on a gradient field obtained from the input images. The obtained specular reduced image is further refined in a matting process with the maximum composite of the input images. Experimental results are demonstrated on real and synthetic images. The entire setup can be conceivably packaged into a self-contained device, no larger than existing digital cameras.
R. Raskar, K. Tan, R. Feris, J. Yu, and M. Turk, “A non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging,”SIGGRAPH’ 04 / ACM Transactions on Graphics (to appear), 2004.
S. Nayar, X. Fang, and T. Boult, “Removal of specularities using color and polarization,” inInternational Conference on Computer Vision and Pattern Recognition, New York City, USA, 1993, pp. 583–590.
M. Oren and S. Nayar, “A theory of specular surface geometry,”International Journal of Computer Vision, vol. 2, pp. 105–124, 1997.
M. Osadchy, D. Jacobs, and R. Ramamoorthi, “Using specularities for recognition,” inInternational Conference on Computer Vision, Nice, France, 2003.
G. Klinker, S. Shafer, and T. Kanade, “The measurement of highlights in color images,”International Journal of Computer Vision, vol. 2, pp. 7–32, 1988.
L. Wolff and T. Boult, “Constraining object features using a polarization reflectance model,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 16, no. 6, pp. 635–657, 1991.
S. Lee,Understanding of Surface Reflections in Computer Vision by Color and Multiple Views, Ph.D. thesis, University of Pennsylvania, 1991.
M. Cohen, A. Colburn, and S. Drucker, “Image stacks,” Tech. Rep. MSR-TR-2003-40, Microsoft Research, 2003.
D. Akers, F. Losasso, J. Klingner, M. Agrawala, J. Rick, and P. Hanrahan, “Conveying Shape and Features with Image-Based Relighting,” inIEEE Visualization, 2003.
R. Feris, M. Turk, R. Raskar, K. Tan, and G. Ohashi, “Exploiting Depth Discontinuities for Vision-based Fingerspelling Recognition,” inIEEE Workshop on Real-time Vision for Human-Computer Interaction (in conjunction with CVPR’04), Washington DC, USA, 2004.
K. Tan, J. Kobler, P. Dietz, R. Feris, and R. Raskar, “Shape-Enhanced Surgical Visualizations and Medical Illustrations with Multi-Flash Imaging,” inConference on Medical Image Computing and Computer Assisted Intervention, France, 2004.
Y. Weiss, “Deriving intrinsic images from image sequences,” inProceedings of International Conference on Computer Vision, 2001, pp. 68–75.
R. Frankot and R. Chellappa, “A method for enforcing integrability in shape from shading algorithms,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 439–451, 1988.
R. Fattal, D. Lischinski, and M. Werman, “Gradient Domain High Dynamic Range Compression,” inProceedings of SIGGRAPH 2002. ACM SIGGRAPH, 2002, pp. 249–256.
W. Press, S. Teukolsky, W. Vetterling, and B. Flannery,Numerical Recipes in C: The Art of Scientific Computing, Pearson Education, 1992.
M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, “Image inpainting,” inSiggraph 2000, Computer Graphics Proceedings. 2000, pp. 417–424, ACM Press / ACM SIGGRAPH / Addison Wesley Longman.
P. Tan, S. Lin, L. Quan, and H. Shum, “Highlight removal by illumination-constrained inpainting.,” inInternational Conference on Computer Vision (ICCV’03), 2003, pp. 164–169.
About this article
Cite this article
Feris, R., Raskar, R., Tan, KH. et al. Specular highlights detection and reduction with multi-flash photography. J Braz Comp Soc 12, 35–42 (2006). https://doi.org/10.1007/BF03192386
- Multi-Flash Imaging
- Poisson Equation