光电子技术, 2014, 34 (2): 140, 网络出版: 2014-06-30
基于体分割重建的增强现实交互系统
An Augmented Reality Interaction System Based on Volume Segmentation and Reconstruction
增强现实 人机交互 物体分割 分层渲染 体素碰撞检测 augmented reality human-computer interaction objects segmentation layer rendering voxel collision detecting
摘要
利用手持彩色和深度摄像头(Kinect)作为图像采集设备, 在KinectFusion算法的基础上进行了扩展, 实现了一个人与虚拟屏幕直接触碰交互的增强现实系统。本文提出一种腐蚀膨胀的方法提取场景中的运动物体, 借助深度图采用分层渲染的方法实现虚实物体互遮挡效果, 最后采用一种体素碰撞检测的方法解决人与屏幕的碰撞检测问题。系统的实现过程中采取GPU并行处理, 显著提高了算法速度。
Abstract
We extend the KinectFusion algorithm and implement an augmented reality system that allows the interaction between human and a virtual touchable screen. A RGB-D camera (Kinect) is used as the capture equipment. A corrosion-expansion method to extract the moving objects in the scene is presented. The mutual occlusion problem is solved by layer rendering method with depth map. A kind of voxel-based method is used to detect the collision between human and virtual screen.
李佳宁, 张骏飞, 李阳, 王梁昊, 李东晓, 张明. 基于体分割重建的增强现实交互系统[J]. 光电子技术, 2014, 34(2): 140. LI Jianing, ZHANG Junfei, LI Yang, WANG Lianghao, LI Dongxiao, ZHANG Ming. An Augmented Reality Interaction System Based on Volume Segmentation and Reconstruction[J]. Optoelectronic Technology, 2014, 34(2): 140.