标题：3D Attention-Driven Depth Acquisition for Object Identification
作者：Xu, Kai; Shi, Yifei; Zheng, Lintao; Zhang, Junyu; Liu, Min; Huang, Hui; Su, Hao; Cohen-Or, Daniel; Chen, Baoquan
通讯作者：Chen, BQ;Huang, H;Huang, H
作者机构：[Xu, Kai; Shi, Yifei; Zheng, Lintao; Liu, Min] Natl Univ Def Technol, HPCL, Changsha, Hunan, Peoples R China.; [Xu, Kai; Chen, Baoquan] Shandong Uni 更多
会议名称：ACM SIGGRAPH Asia Conference
来源：ACM TRANSACTIONS ON GRAPHICS
关键词：3D acquisition; depth camera; next-best-view; object identification;; attention-based model; shape classification
摘要：We address the problem of autonomously exploring unknown objects in a scene by consecutive depth acquisitions. The goal is to reconstruct the scene while online identifying the objects from among a large collection of 3D shapes. Fine-grained shape identification demands a meticulous series of observations attending to varying views and parts of the object of interest. Inspired by the recent success of attention-based models for 2D recognition, we develop a 3D Attention Model that selects the best views to scan from, as well as the most informative regions in each view to focus on, to achieve efficient object recognition. The region-level attention leads to focus-driven features which are quite robust against object occlusion. The attention model, trained with the 3D shape collection, encodes the temporal dependencies among consecutive views with deep recurrent networks. This facilitates order-aware view planning accounting for robot movement cost. In achieving instance identification, the shape collection is organized into a hierarchy, associated with pre-trained hierarchical classifiers. The effectiveness of our method is demonstrated on an autonomous robot (PR) that explores a scene and identifies the objects to construct a 3D scene model.