基于体分割重建的增强现实交互系统

李佳宁; 张骏飞; 李阳; 王梁昊; 李东晓; 张明

光电子技术, 2014, 34 (2): 140, 网络出版: 2014-06-30

基于体分割重建的增强现实交互系统

An Augmented Reality Interaction System Based on Volume Segmentation and Reconstruction

论文大纲

李佳宁 ^1,2,*张骏飞 ^1,2李阳 ^1,2王梁昊 ^1,2李东晓 ^1,2张明 ^1,2

作者单位

¹ 浙江大学信息与电子工程学系, 杭州 310027

² 浙江省信息网络技术重点实验室, 杭州 310027

增强现实人机交互物体分割分层渲染体素碰撞检测 augmented reality human-computer interaction objects segmentation layer rendering voxel collision detecting

摘要

利用手持彩色和深度摄像头(Kinect)作为图像采集设备, 在KinectFusion算法的基础上进行了扩展, 实现了一个人与虚拟屏幕直接触碰交互的增强现实系统。本文提出一种腐蚀膨胀的方法提取场景中的运动物体, 借助深度图采用分层渲染的方法实现虚实物体互遮挡效果, 最后采用一种体素碰撞检测的方法解决人与屏幕的碰撞检测问题。系统的实现过程中采取GPU并行处理, 显著提高了算法速度。

Abstract

We extend the KinectFusion algorithm and implement an augmented reality system that allows the interaction between human and a virtual touchable screen. A RGB-D camera (Kinect) is used as the capture equipment. A corrosion-expansion method to extract the moving objects in the scene is presented. The mutual occlusion problem is solved by layer rendering method with depth map. A kind of voxel-based method is used to detect the collision between human and virtual screen.

参考文献

[1] Kato, Hirokazu, and Mark Billinghurst. Marker tracking and hmd calibration for a video-based augmented reality conferencing system［C］. 2nd IEEE and ACM International Workshop on Augmented Reality. San Francisco, CA, 1999:85-94.

[2] Klein G, Murray D. Parallel tracking and mapping for small AR workspaces［C］. 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. Nara, 2007: 225-234.

[3] Hilliges O, Kim D, Izadi S, et al. HoloDesk: direct 3d interactions with a situated see-through display［C］. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems. ACM, 2012: 2421-2430.

[4] Izadi S,Kimo, Hilliges O,et al. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera［Ｃ］. Proceedings of the 24th annual ACM symposium on User interface software and technology. 2011:559-568.

[5] Low K L. Linear least-squares optimization for point-to-plane icp surface registration［R］. Chapel Hill, University of North Carolina, 2004.

[6] Soille P. Morphological image analysis: principles and applications［M］. Springer-Verlag New York, Inc., 2003.

李佳宁, 张骏飞, 李阳, 王梁昊, 李东晓, 张明. 基于体分割重建的增强现实交互系统[J]. 光电子技术, 2014, 34(2): 140. LI Jianing, ZHANG Junfei, LI Yang, WANG Lianghao, LI Dongxiao, ZHANG Ming. An Augmented Reality Interaction System Based on Volume Segmentation and Reconstruction[J]. Optoelectronic Technology, 2014, 34(2): 140.

基于体分割重建的增强现实交互系统

关于本站 Cookie 的使用提示

全站搜索

基于体分割重建的增强现实交互系统

相关论文

相关资讯

关于本站 Cookie 的使用提示

全站搜索