首页 > 论文 > 光学学报 > 38卷 > 6期(pp:611001--1)

一种聚焦式光场成像去混叠方法

A Method of Eliminating Artifacts in Focused Light Field Imaging

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

聚焦式光场成像克服了传统光场成像空间分辨率不足的缺点,但牺牲角度采样会导致重聚焦过程中非聚集平面出现混叠现象,不仅影响重聚焦的视觉效果,而且严重影响离焦响应分析的准确性。提出一种基于滑动窗口图像融合加自适应中值滤波的光场成像方法来弥补角度采样的欠缺,从而有效防止非聚焦平面出现混叠现象。对于输入的四维光场数据,选取合适的窗口尺寸并让窗口以特定步长在子图像中滑动。对每一次滑动均进行一次基本的光场重聚焦计算成像,得到多视角光场数据,然后对多视角数据进行融合得到一个焦平面的重聚焦图像。对一系列窗口尺寸重复上述计算即可得到聚焦堆栈。使用尺寸与聚焦窗口大小呈线性相关的滤波核心对聚焦堆栈的各层图像进行自适应滤波,即可在整个聚焦堆栈内有效消除混叠现象。使用Todor数据集对此方法进行测试,结果表明该方法不仅显著改善了非聚焦平面的视觉效果,也大幅提高了离焦响应的准确性。

Abstract

Focused light field imaging has overcome the disadvantages of low spatial resolution in traditional light field imaging, but the induced artifacts at out-of-focus planes due to sacrificing the angle sampling density. This not only affects the visual appearance of the image but also severely decreases the accuracy of defocus response analysis. We present a method based on sliding window fusion and adaptive median filtering, which can improve the angle resolution and eliminate the artifacts at out-of-focus planes. A window with an appropriate size is selected to slide in the sub-images of the four-dimensional light field data with a specific step. Basic light field refocusing algorithm is conducted on each slide to produce multi-view data, which are then fused to get a refocused image at a corresponding plane. The focal stack can be obtained by changing the window size and repeating the above calculation. Each layer of the focal stack is filtered by an adaptive median filter with the kernel size being linearly correlated with the window size. As a result, artifacts can be removed in the whole focal stack. Todor dataset is used to test the proposed method. The results show that the proposed method improves the visual appearance at out-of-focus planes, and the accuracy of defocus response.

Newport宣传-MKS新实验室计划
补充资料

中图分类号:TP391.41

DOI:10.3788/aos201838.0611001

所属栏目:成像系统

基金项目:国家自然科学基金(51505404, 51675456)、上海浦江计划(16PJ1404300)

收稿日期:2017-12-01

修改稿日期:2017-12-29

网络出版日期:--

作者单位    点击查看

刘润兴:上海交通大学机械与动力工程学院, 上海 200240
任明俊:上海交通大学机械与动力工程学院, 上海 200240
肖高博:上海交通大学机械与动力工程学院, 上海 200240

联系人作者:任明俊(renmj@sjtu.edu.cn)

备注:刘润兴(1992-),男,硕士研究生,主要从事光场成像方面的研究。E-mail: liurunxing@sjtu.edu.cn

【1】Adelson E H, Bergen J R. The plenoptic function and the elements of early vision[J]. Computational Models of Visual Processing, 1991, 1∶3-20.

【2】Levoy M, Hanrahan P. Light field rendering[C]∥Conference on Computer Graphics and Interactive Techniques, ACM, 1996: 31-42.

【3】Adelson E H, Wang J Y A. Single lens stereo with a plenoptic camera[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 14(2): 99-105.

【4】Ng R, Levoy M, Bredif M, et al. Light field photography with a hand-held plenopic camera[R]. Stanford Tech Report CTSR, 2005.

【5】Levoy M, Ng R, Adams A, et al. Light field microscopy[C]∥ACM SIGGRAPH, 2006: 924-934.

【6】Prevedel R, Yoon Y G, Hoffmann M, et al. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy[J]. Nature Methods, 2014, 11(7): 727-730.

【7】Vaish V, Wilburn B, Joshi N, et al. Using plane + parallax for calibrating dense camera arrays[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2004, 1: I-2-I-9.

【8】Wanner S, Goldluecke B. Variational light field analysis for disparity estimation and super-resolution[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(3): 606-619.

【9】Wang T C, Efros A A, Ramamoorthi R. Occlusion-aware depth estimation using light-field cameras[C]∥Proceedings of the IEEE International Conference on Computer Vision, 2015: 3487-3495.

【10】Jeon H G, Park J, Choe G, et al. Accurate depth map estimation from a lenslet light field camera[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015: 1547-1555.

【11】Johannsen O, Sulc A, Goldluecke B. What sparse light field coding reveals about scene structure[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016: 3262-3270.

【12】Xiao Z L. Camera array based light field imaging and depth estimation[D]. Xi′an: Northwestern Polytechnical University, 2014: 30-52.
肖照林. 基于相机阵列的光场成像与深度估计方法研究[D]. 西安: 西北工业大学, 2014: 30-52.

【13】Levoy M, Chen B, Vaish V, et al. Synthetic aperture confocal imaging[J]. ACM Transactions on Graphics, 2004, 23(3): 825-834.

【14】Xia Z Y, Tian Y Z, Liang E , et al. Infrared light field imaging based on camera array[J]. Acta Optica Sinica, 2017, 37(9): 0911002.
夏朝阳, 田勇志, 梁二军, 等. 基于相机阵列的红外光场成像[J]. 光学学报, 2017, 37(9): 0911002.

【15】Goldluecke B. Globally consistent depth labeling of 4D light fields[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2012: 41-48.

【16】Georgiev T. Chunev G, Lumsdaine A. Superresolution with the focused plenoptic camera[C]. SPIE, 2012, 7873: 78730X.

【17】Birklbauer C, Bimber O. Panorama light-field imaging[J]. Computer Graphics Forum, 2014, 33(2): 43-52.

【18】Zhou Z L. Research on light field imaging technology[D]. Hefei: University of Science and Technology of China, 2012: 20-60.
周志良. 光场成像技术研究[D]. 合肥: 中国科学技术大学, 2012: 20-60.

【19】Nie Y F, Xiangli B, Zhou Z L.Advances in light field photography technique[J]. Journal of Graduate University of Chinese Academy of Sciences, 2011, 28(5): 563-572.
聂云峰, 相里斌, 周志良. 光场成像技术进展[J]. 中国科学院研究生院学报, 2011, 28(5): 563-572.

【20】Zhang C P, Wang Q.Survey on imaging model and calibration of light field camera[J].Chinese Journal of Lasers, 2016, 43(6): 0609004.
张春萍, 王庆. 光场相机成像模型及参数标定方法综述[J]. 中国激光, 2016, 43(6): 0609004.

【21】Sun J Y, Sun J, Xu C L, et al. A calibration method of focused light field cameras based on light field images[J]. Acta Optica Sinica, 2017, 37(5): 0515002.
孙俊阳, 孙俊, 许传龙, 等. 一种基于光场图像的聚焦光场相机标定方法[J]. 光学学报, 2017, 37(5): 0515002.

【22】Ghasemi A, Vetterli M. Scale-invariant representation of light field images for object recognition and tracking[C]. SPIE, 2014, 9020: 902015.

【23】Sang X Z, Yu X B, Chen D, et al. Research progress on three-dimensional optical display technology[J]. Laser and Optoelectronics Progress, 2017, 54(5): 050006.
桑新柱, 于迅博, 陈铎, 等. 三维光显示技术研究进展[J]. 激光与光电子学进展, 2017, 54(5): 050006.

【24】Lin H, Chen C, Kang S B, et al. Depth recovery from light field using focal stack symmetry[C]∥Proceedings of the IEEE International Conference on Computer Vision, 2015: 3451-3459.

【25】Broad T, Grierson M. Light field completion using focal stack propagation[C]∥ACM SIGGRAPH, 2016: 54.

【26】Tao M W, Hadap S, Malik J, et al. Depth from combining defocus and correspondence using light-field cameras[C]∥Proceedings of the IEEE International Conference on Computer Vision, 2013: 673-680.

【27】Tao M W, Srinivasan P P, Hadap S, et al. Shape estimation from shading, defocus, and correspondence using light-field angular coherence[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(3): 546-560.

【28】Lumsdaine A, Georgiev T. The focused plenoptic camera[C]∥Proceedings of the IEEE International Conference on Computational Photography, 2010: 1-8.

【29】Perwass C, Wietzke L. Single lens 3D-camera with extended depth-of-field[C]. SPIE, 2012, 8291: 829108.

【30】Georgeiv T, Zheng K C, Curless B, et al. Spatio-angular resolution tradeoffs in integral photography[C]. Eurographics Symposium on Rendering, 2006: 263-272.

【31】Xiao Z, Wang Q, Zhou G, et al. Aliasing detection and reduction in plenoptic imaging[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014: 3326-3333.

【32】Xiao Z L, Wang Q, Zhou G Q, et al. A mulit-scale anti-aliasing rendering alogorithm for the light field imaging[J]. Journal of Computer-Aided Design and Computer Graphics, 2014, 26(7): 1126-1134.
肖照林, 王庆, 周果清, 等. 针对光场图像的多尺度抗混叠绘制方法[J]. 计算机辅助设计与图形学学报, 2014, 26(7): 1126-1134.

【33】Georgiev T, Lumsdaine A. Reducing plenoptic camera artifacts[J]. Computer Graphics Forum, 2010, 29(6): 1955-1968.

【34】Wanner S, Fehr J, Jahne B. Generating EPI representations of 4D light fields with a single lens focused plenoptic camera[C]∥Advances in Visual Computing, Lecture Notes in Computer Science, 2011, 6938: 90-101.

【35】Georgiev T, Lumsdaine A. Focused plenoptic camera and rendering[J]. Journal of Electronic Imaging, 2010, 19(2): 021106.

【36】Lumsdaine A, Chunev G, Georgiev T. Plenoptic rendering with interactive performance using GPUs[C]. SPIE, 2012, 8295: 829513.

【37】Nayar S K, Nakagawa Y. Shape from focus[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(8): 824-831.

引用该论文

Liu Runxing,Ren Mingjun,Xiao Gaobo. A Method of Eliminating Artifacts in Focused Light Field Imaging[J]. Acta Optica Sinica, 2018, 38(6): 0611001

刘润兴,任明俊,肖高博. 一种聚焦式光场成像去混叠方法[J]. 光学学报, 2018, 38(6): 0611001

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF