106. The 3D object recognition with environmental adaptability based on VFH descriptor and region growing segmentation

Zhuang Peng1, Jinbao Chen2, Dong Han3, Meng Chen4

1AVIC Chengdu Aircraft Industrial (Group) Co., Ltd., Chengdu, China

2, 3Nanjing University of Aeronautics and Astronautics, Nanjing, China

4Shanghai Institute of Aerospace Systems Engineering, Shanghai, China

1Corresponding author

E-mail: 1zhuanggeph@nuaa.edu.cn, 2chenjbao@nuaa.edu.cn, 3han_dongnuaa@126.com, 4workmailcm@126.com

Received 12 May 2015; received in revised form 4 October 2016; accepted 17 October 2016

DOI https://doi.org/10.21595/jme.2016.16050

Abstract. 3D object recognition is a basic research in the machine vision field. Microsoft KINECT V2 is utilized to collect external environmental information. The point cloud file is obtained after processing the collected information. In order to filter the point cloud and obtain point cloud model of a single object in the environment after region growing segmentation, the point cloud is applied to point cloud library. Then, the VFH descriptor of the point cloud model is calculated. After inputting point cloud model of the trained target, the point cloud model with the minimum CHI square distance between the VFH descriptor of the target and VFH descriptor of the point cloud model can be found. The 3D object corresponding to the found model is the identified object. For the 3D object recognition in an unfamiliar environment, the algorithm of 3D object recognition with environmental adaptability is proposed. After the 3D object recognition system built, the physical verification is conducted about the proposed algorithm. Giving the target model, the system successfully identifies the 3D object in the unfamiliar environment, that demonstrates the correctness of the algorithm.

Keywords: VFH descriptor, region growing segmentation, CHI square distance, environmental adaptability, 3D object recognition.


[1]        Dong S., Williams B. Learning and recognition of hybrid manipulation motions in variable environments using probabilistic flow tubes. International Journal of Social Robotics, Vol. 4, Issue 4, 2012, p. 357‑368.

[2]        Tombari F., Salti S., Di Stefano L. Unique signatures of histograms for local surface description. Computer Vision, Springer Berlin Heidelberg, Vol. 6313, 2010, p. 356‑369.

[3]        Mian A., Bennamoun M., Owens R. On the repeatability and quality of keypoints for local feature‑based 3d object retrieval from cluttered scenes. International Journal of Computer Vision, Vol. 89, Issues 2‑3, 2010, p. 348‑361.

[4]        Sukno F. M., Waddington J. L., Whelan P. F. Comparing 3D descriptors for local search of craniofacial landmarks. Advances in Visual Computing, Springer Berlin Heidelberg, Vol. 7432, 2012, p. 92‑103.

[5]        Liu Guangcan. Machine Learning Based Object Recognition. Dissertation, Shanghai Jiao Tong University, 2013, (in Chinese).

[6]        Guo Y., Sohel F., Bennamoun M., et al. Rotational projection statistics for 3D local surface description and object recognition. International Journal of Computer Vision, Vol. 105, Issue 1, 2013, p. 63‑86.

[7]        Steder B., Rusu R. B., Konolige K., et al. NARF: 3D range image features for object recognition. Workshop on Defining and Solving Realistic Perception Problems in Personal Robotics at the IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 40, 2010.

[8]        Zou G., Hua J., Dong M., et al. Surface matching with salient keypoints in geodesic scale space. Computer Animation and Virtual Worlds, Vol. 19, Issues 3‑4, 2008, p. 399‑410.

[9]        Rusu R. B., Marton Z. C., Blodow N., et al. Towards 3D point cloud based object maps for household environments. Robotics and Autonomous Systems, Vol. 56, Issue 11, 2008, p. 927‑941.

[10]     Rabbani T., van den Heuvel F., Vosselmann G. Segmentation of point clouds using smoothness constraint. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. 36, Issue 5, 2006, p. 248‑253.

[11]     Rusu R. B., Bradski G., Thibaux R., et al. Fast 3d recognition and pose using the viewpoint feature histogram. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2010, p. 2155‑2162.

Cite this article

Peng Zhuang, Chen Jinbao, Han Dong, Chen Meng The 3D object recognition with environmental adaptability based on VFH descriptor and region growing segmentation. Journal of Measurements in Engineering, Vol. 4, Issue 4, 2016, p. 195‑200.


Journal of Measurements in Engineering. December 2016, Volume 4, Issue 4

JVE International Ltd. ISSN Print 2335-2124, ISSN Online 2424-4635, Kaunas, Lithuania