Multimedia Technology and Telecommunications Lab

Handheld scanning with depth cameras

Home Page


Research Areas








Novel real-time depth acquisition devices, like Microsoft Kinect, allow a very fast and simple acquisition of 3D views. These sensors have been used in many applications but their employment for 3D scanning purposes is a very challenging task due to the limited accuracy and reliability of their data. We proposed a 3D reconstruction pipeline explicitly targeted to the Kinect. The proposed scheme aims at obtaining a reliable reconstruction that is not affected by the limiting issues of these cameras and is at the same time simple and fast in order to allow to use the Kinect sensor as an handheld scanner. A novel algorithm for the extraction of salient points exploiting both depth and color data is firstly proposed. Then the extracted points are then used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views produced by the Kinect even when the geometry information is not sufficient to constrain the registration. Experimental results show how the proposed approach is able to produce reliable 3D reconstructions from the Kinect data. An improved version of the approach [2] has been applied to the reconstruction of cultural heritage objects.

Related Papers:

----[1] E. Cappelletto, P. Zanuttigh, G.M. Cortelazzo
"Handheld scanning with 3D cameras"
           Proceedings of MMSP 2013 (
Top 10% Paper Award)
-------- Pula, Italy, October, 2013.

      [2] E. Cappelletto, P. Zanuttigh, G. M. Cortelazzo,
            "3D Scanning of Cultural Heritage with Consumer Depth Cameras",
             Multimedia Tools and Applications, 2014

---For all the IEEE Publications: (c) IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE