首页 > 论文 > 光学学报 > 41卷 > 3期(pp:0315001--1)

聚焦型光场相机等效多相机模型及其运动恢复结构应用 (封面文章)

Equivalent Multi-Camera Model of Focused Plenoptic Camera and Its Application in Structure from Motion (Cover Paper)

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

聚焦型光场相机在运动恢复结构(SFM)和场景重建等领域中的作用日益显现。但是传统SFM算法因聚焦型光场相机具有特殊的结构而难以直接应用。针对这一问题,提出一种完整的聚焦型光场相机等效多目相机模型。在此基础上,利用传统多目相机的SFM算法,给出了适用于聚焦型光场相机的位姿估计算法示例和点云三角化算法示例。最后,通过仿真实验和真实场景重建实验验证了本文等效多目相机模型和SFM算法的正确性,进而表明聚焦型光场相机的SFM问题可以等价为多目相机的SFM问题。

Abstract

Focused plenoptic cameras have played an increasingly important role in fields like structure from motion (SFM) and scene reconstruction. However, the traditional SFM algorithms cannot be directly applied to focused plenoptic cameras due to the special structures of the cameras. In order to solve this problem, we proposed a complete equivalent multi-camera model of focused plenoptic cameras. On this basis, we employed the SFM algorithms of the traditional multi-camera to give the algorithm examples suitable for focused plenoptic cameras with regard to pose estimation and point cloud triangulation. Finally, the experimental results of simulations and real scene reconstruction verify the correctness of the equivalent multi-camera model and the SFM algorithms, further indicating that the SFM problem of focused plenoptic cameras can be equivalent to that of multi-camera.

广告组1 - 空间光调制器+DMD
补充资料

中图分类号:TP391.4; O439

DOI:10.3788/AOS202141.0315001

所属栏目:机器视觉

基金项目:国家自然科学基金(61902419)

收稿日期:2020-08-03

修改稿日期:2020-09-15

网络出版日期:2021-02-01

作者单位    点击查看

刘青松:海军航空大学, 山东 烟台 264001国防科技大学前沿交叉学科学院, 湖南 长沙 410073
谢晓方:海军航空大学, 山东 烟台 264001
张烜喆:国防科技大学前沿交叉学科学院, 湖南 长沙 410073
田瑜:国防科技大学计算机学院, 湖南 长沙 410073
许晓军:国防科技大学前沿交叉学科学院, 湖南 长沙 410073

联系人作者:谢晓方(Xiexf208@sina.com)

【1】Song X L, Li S, Gu M T, et al. Three-dimensional reconstruction of micro-scale flow field based on light field microscopic imaging [J]. Acta Optica Sinica. 2019, 39(10): 1011002.
宋祥磊, 李舒, 顾梦涛, 等. 光场显微成像微尺度流场三维重建方法研究 [J]. 光学学报. 2019, 39(10): 1011002.

【2】Sun F S, Han X. Multi-objective fast ranging method based on microlens array light field camera [J]. Acta Optica Sinica. 2019, 39(8): 0815001.
孙福盛, 韩燮. 基于微透镜阵列型光场相机的多目标快速测距方法 [J]. 光学学报. 2019, 39(8): 0815001.

【3】Liu H F, Zhou W, Cai X S, et al. Three-dimensional particle tracking velocimetry based on light field imaging [J]. Acta Optica Sinica. 2020, 40(1): 0111014.
刘慧芳, 周骛, 蔡小舒, 等. 基于光场成像的三维粒子追踪测速技术 [J]. 光学学报. 2020, 40(1): 0111014.

【4】Ng R, Levoy M, Bredif M, et al. -02[2020-07-21] . http:∥graphics.stanford.edu/papers/lfcamera/lfcamera-150dpi.pdf. 2005.

【5】Ng R, Levoy M, Brédif M, et al. Light field photography with a hand-held plenoptic camera [J]. Computer Science Technical Report CSTR. 2005, 2(11): 1-11.Ng R, Levoy M, Brédif M, et al. Light field photography with a hand-held plenoptic camera [J]. Computer Science Technical Report CSTR. 2005, 2(11): 1-11.

【6】Heinly J, Sch?nberger J L, Dunn E, et al. Reconstructing the world* in six days[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 7-12, 2015, Boston, MA, USA. New York: , 2015, 3287-3295.

【7】Snavely N, Simon I, Goesele M, et al. Scene reconstruction and visualization from community photo collections [J]. Proceedings of the IEEE. 2010, 98(8): 1370-1390.Snavely N, Simon I, Goesele M, et al. Scene reconstruction and visualization from community photo collections [J]. Proceedings of the IEEE. 2010, 98(8): 1370-1390.

【8】Sch?ps T, Sattler T, H?ne C, et al. Large-scale outdoor 3D reconstruction on a mobile device [J]. Computer Vision and Image Understanding. 2017, 157: 151-166.

【9】Sch?nberger J L, Frahm J M. Structure-from-motion revisited[C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, 2016, Las Vegas, NV, USA. New York: , 2016, 4104-4113.

【10】Johannsen O, Sulc A, Goldluecke B. On linear structure from motion for light field cameras[C]∥2015 IEEE International Conference on Computer Vision (ICCV), December 7-13, 2015, Santiago, Chile. New York: , 2015, 720-728.

【11】Zhang Y L, Yu P H, Yang W, et al. Ray space features for plenoptic structure-from-motion[C]∥2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy. New York: , 2017, 4641-4649.

【12】Nousias S, Lourakis M, Bergeles C. Large-scale, metric structure from motion for unordered light fields[C]∥2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 15-20, 2019, Long Beach, CA, USA. New York: , 2019, 3287-3296.

【13】Zeller N, Quint F, Stilla U. From the calibration of a light-field camera to direct plenoptic odometry [J]. IEEE Journal of Selected Topics in Signal Processing. 2017, 11(7): 1004-1019.Zeller N, Quint F, Stilla U. From the calibration of a light-field camera to direct plenoptic odometry [J]. IEEE Journal of Selected Topics in Signal Processing. 2017, 11(7): 1004-1019.

【14】Lumsdaine A, Georgiev T. The focused plenoptic camera[C]∥2009 IEEE International Conference on Computational Photography (ICCP), April 16-17, 2009, San Francisco, CA, USA. New York: , 2009, 1-8.

【15】Georgiev T, Lumsdaine A. The multifocus plenoptic camera [J]. Proceedings of SPIE. 2012, 8299: 829908.

【16】Bok Y, Jeon H, Kweon I S. Geometric calibration of micro-lens-based light field cameras using line features [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2016, 39(2): 287-300.Bok Y, Jeon H, Kweon I S. Geometric calibration of micro-lens-based light field cameras using line features [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2016, 39(2): 287-300.

【17】Stolfi J. Primitives for computational geometry [D]. Stanford: Stanford University. 1988, 189-197.

【18】Kneip L, Furgale P. OpenGV: , 2014, 1-8.

【19】Fischler M A, Bolles R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography [J]. Communications of the ACM. 1981, 24(6): 381-395.

【20】Li H, Hartley R, Kim J. A linear approach to motion estimation using generalized camera models[C]∥2008 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), June 23-28, 2008. Anchorage, AK, USA. New York: , 2008, 1063-6919.

【21】Kneip L, Furgale P, Siegwart R. Using multi-. camera systems in robotics: , 2013, 3770-3776.

【22】Hartley R I, Sturm P. Triangulation [J]. Computer Vision and Image Understanding. 1997, 68(2): 146-157.

【23】Hartley R, Zisserman A. Multiple view geometry in computer vision[M]. Cambridge: , 2004.

【24】Liu Q S, Xie X F, Zhang X Z, et al. Checkerboard corner detection algorithm for calibration of focused plenoptic camera [J]. Acta Optica Sinica. 2020, 40(14): 1415002.
刘青松, 谢晓方, 张烜喆, 等. 用于聚焦型光场相机标定的棋盘角点检测算法 [J]. 光学学报. 2020, 40(14): 1415002.

引用该论文

Liu Qingsong,Xie Xiaofang,Zhang Xuanzhe,Tian Yu,Xu Xiaojun. Equivalent Multi-Camera Model of Focused Plenoptic Camera and Its Application in Structure from Motion[J]. Acta Optica Sinica, 2021, 41(3): 0315001

刘青松,谢晓方,张烜喆,田瑜,许晓军. 聚焦型光场相机等效多相机模型及其运动恢复结构应用[J]. 光学学报, 2021, 41(3): 0315001

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF