激光与光电子学进展, 2021, 58 (18): 1811013, 网络出版: 2021-09-03  

多相机系统:成像增强及应用 下载: 1485次特邀综述

Multi-Camera System: Imaging Enhancement and Application
作者单位
南京大学电子科学与工程学院, 江苏 南京 210023
引用该论文

郭珮瑶, 蒲志远, 马展. 多相机系统:成像增强及应用[J]. 激光与光电子学进展, 2021, 58(18): 1811013.

Peiyao Guo, Zhiyuan Pu, Zhan Ma. Multi-Camera System: Imaging Enhancement and Application[J]. Laser & Optoelectronics Progress, 2021, 58(18): 1811013.

参考文献

[1] Brady D J, Pang W B, Li H, et al. Parallel cameras[J]. Optica, 2018, 5(2): 127-137.

[2] 戴琼海, 索津莉, 季向阳, 等. 计算摄像学: 全光视觉信息的计算采集[M]. 北京: 清华大学出版社, 2016.

    Dai QH, Suo JL, Ji XY, et al.Computational photography: computational capture of plenoptic visual information[M]. Beijing: Tsinghua University Press, 2016.

[3] Barbastathis G, Ozcan A, Situ G H. On the use of deep learning for computational imaging[J]. Optica, 2019, 6(8): 921-943.

[4] Cao X, Yue T, Lin X, et al. Computational snapshot multispectral cameras: toward dynamic capture of the spectral world[J]. IEEE Signal Processing Magazine, 2016, 33(5): 95-108.

[5] ManekarR, TayalK, KumarV, et al. End-to-end learning for phase retrieval[C] //ICML workshop on ML Interpretability for Scientific Discovery, July 13-18, 2020, Virtual Event. Cambridge: PMLR, 2020.

[6] Yao Y, Zuo M, Dong Y, et al. Polarization imaging feature characterization of different endometrium phases by machine learning[J]. OSA Continuum, 2021, 4(6): 1776-1791.

[7] 索津莉, 刘烨斌, 季向阳, 等. 计算摄像学: 核心、方法与应用[J]. 自动化学报, 2015, 41(4): 669-685.

    Suo J L, Liu Y B, Ji X Y, et al. Computational photography: keys, methods and applications[J]. Acta Automatica Sinica, 2015, 41(4): 669-685.

[8] Adelson EH, Bergen JR. The plenoptic function and the elements of early vision[M] // Landy M, Movshon J A. Computational models of visual processing. Cambridge, The MIT Press, 1991.

[9] 左超, 冯世杰, 张翔宇, 等. 深度学习下的计算成像: 现状、挑战与未来[J]. 光学学报, 2020, 40(1): 0111003.

    Zuo C, Feng S J, Zhang X Y, et al. Deep learning based computational imaging: status, challenges, and future[J]. Acta Optica Sinica, 2020, 40(1): 0111003.

[10] 邵晓鹏, 刘飞, 李伟, 等. 计算成像技术及应用最新进展[J]. 激光与光电子学进展, 2020, 57(2): 020001.

    Shao X P, Liu F, Li W, et al. Latest progress in computational imaging technology and application[J]. Laser & Optoelectronics Progress, 2020, 57(2): 020001.

[11] 方璐, 戴琼海. 计算光场成像[J]. 光学学报, 2020, 40(1): 0111001.

    Fang L, Dai Q H. Computational light field imaging[J]. Acta Optica Sinica, 2020, 40(1): 0111001.

[12] NomuraY, ZhangL, Nayar SK. Scene collages and flexible camera arrays[C] //Proceedings of the 18th Eurographics Conference on Rendering Techniques, May 25, 2007, Grenoble, France. Geneve: Eurographics Association, 2007: 127- 138.

[13] Lin X, Liu Y B, Wu J M, et al. Spatial-spectral encoded compressive hyperspectral imaging[J]. ACM Transactions on Graphics, 2014, 33(6): 1-11.

[14] Land MF, Nilsson DE. Lens eyes on land[M] //Animal eyes. Oxford: Oxford University Press, 2012: 94- 129.

[15] MildenhallB, Srinivasan PP, TancikM, et al. NeRF: representing scenes as neural radiance fields for view synthesis[M] //Vedaldi A, Bischof H, Brox T, et al. Computer vision-ECCV 2020. Lecture notes in computer science. Cham: Springer, 2020: 405- 421.

[16] . Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.

[17] Lucas BD, KanadeT. An iterative image registration technique with an application to stereo vision[C] //IJCAI’81: Proceedings of the 7th International Joint Conference on Artificial Intelligence, August 24-28, 1981, Vancouver, BC, Canada. San Francisco: William Kaufmann, 1981.

[18] de ToneD, MalisiewiczT, RabinovichA. Deep image homography estimation[EB/OL]. (2016-06-13)[2021-05-25]. https://arxiv.org/abs/1606.03798.

[19] Dai JF, Qi HZ, Xiong YW, et al.Deformable convolutional networks[C] //2017 IEEE International Conference on Computer Vision (ICCV), October 22-29, 2017, Venice, Italy.New York: IEEE Press, 2017: 764- 773.

[20] Liu Y, Chen X, Wang Z F, et al. Deep learning for pixel-level image fusion: recent advances and future prospects[J]. Information Fusion, 2018, 42: 158-173.

[21] Kaur H, Koundal D, Kadyan V. Image fusion techniques: a survey[J]. Archives of Computational Methods in Engineering, 2021: 1-23.

[22] Li S T, Kang X D, Hu J W. Image fusion with guided filtering[J]. IEEE Transactions on Image Processing, 2013, 22(7): 2864-2875.

[23] Lohmann A W. Scaling laws for lens systems[J]. Applied Optics, 1989, 28(23): 4996-4998.

[24] Kopf J, Uyttendaele M, Deussen O, et al. Capturing and viewing gigapixel images[J]. ACM Transactions on Graphics, 2007, 26(3): 93.

[25] Brady D J, Gehm M E, Stack R A, et al. Multiscale gigapixel photography[J]. Nature, 2012, 486(7403): 386-389.

[26] Zhang JN, Zhu TY, Zhang AK, et al.Multiscale-VR: multiscale gigapixel 3D panoramic videography for virtual reality[C] //2020 IEEE International Conference on Computational Photography (ICCP), April 24-26, 2020, St. Louis, MO, USANew York: IEEE Press, 2020: 1- 12.

[27] Wilburn B, Joshi N, Vaish V, et al. High performance imaging using large camera arrays[J]. ACM Transactions on Graphics, 2005, 24(3): 765-776.

[28] Ding CQ, MaZ. Multi-camera color correction via hybrid histogram matching[EB/OL]. [2020-05-31]. https://box.nju.edu.cn/f/ef598961b2bf4c1a8dae/.

[29] Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International Journal of Computer Vision, 2004, 60(2): 91-110.

[30] Cossairt OS, MiauD, Nayar SK. Gigapixel computational imaging[C] //2011 IEEE International Conference on Computational Photography (ICCP), April 8-10, 2011, Pittsburgh, PA, USA.New York: IEEE Press, 2011: 1- 8.

[31] Son H S, Marks D L, Hahn J, et al. Design of a spherical focal surface using close-packed relay optics[J]. Optics Express, 2011, 19(17): 16132-16138.

[32] Yuan X Y, Ji M Q, Wu J M, et al. A modular hierarchical array camera[J]. Light, Science & Applications, 2021, 10(1): 37.

[33] Yuan XY, FangL, Dai QH, et al.Multiscale gigapixel video: a cross resolution image matching and warping approach[C] //2017 IEEE International Conference on Computational Photography (ICCP), May 12-14, 2017, Stanford, CA, USA. New York: IEEE Press, 2017: 1- 9.

[34] ShechtmanE, CaspiY, IraniM. Increasing space-time resolution in video[M] //Heyden A, Sparr G, Nielsen M, et al. Computer vision-ECCV 2002. Lecture notes in computer science. Heidelberg: Springer, 2002, 2350: 753- 768.

[35] WilburnB, JoshiN, VaishV, et al.High-speed videography using a dense camera array[C] //Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004, June 27-July 2, 2004, Washington, DC, USA.New York: IEEE Press, 2004, II

[36] Wang T C, Zhu J Y, Kalantari N K, et al. Light field video capture using a learning-based hybrid imaging system[J]. ACM Transactions on Graphics, 2017, 36(4): 1-13.

[37] ChengM, MaZ, AsifS, et al. A dual camera system for high spatiotemporal resolution video acquisition[J/OL]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020. [2020-05-31]. https:∥ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9052471.

[38] Debevec PE, MalikJ. Recovering high dynamic range radiance maps from photographs[C] //ACM SIGGRAPH 2008 classes on-SIGGRAPH’08, August 11-15, 2008, Los Angeles, California.New York: ACM Press, 2008: 1- 10.

[39] Chen Y Y, Jiang G Y, Yu M, et al. Learning stereo high dynamic range imaging from a pair of cameras with different exposure parameters[J]. IEEE Transactions on Computational Imaging, 2020, 6: 1044-1058.

[40] Lee B, Song B C. Multi-image high dynamic range algorithm using a hybrid camera[J]. Signal Processing: Image Communication, 2015, 30: 37-56.

[41] Froehlich J, Grandinetti S, Eberhardt B, et al. Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays[J]. Proceedings of SPIE, 2014, 9023: 90230X.

[42] Tocci M D, Kiser C, Tocci N, et al. A versatile HDR video production system[J]. ACM Transactions on Graphics, 2011, 30(4): 1-10.

[43] Huo Y Q, Yang F, Dong L, et al. Physiological inverse tone mapping based on retina response[J]. The Visual Computer, 2014, 30(5): 507-517.

[44] BanterleF, LeddaP, DebattistaK, et al.Expanding low dynamic range videos for high dynamic range applications[C] //Proceedings of the 24th Spring Conference on Computer Graphics-SCCG’08, April 21-23, 2008, Budmerice, Slovakia.New York: ACM Press, 2010: 33- 41.

[45] Lin HY, Chang WZ. High dynamic range imaging for stereoscopic scene representation[C] //2009 16th IEEE International Conference on Image Processing (ICIP), November 7-10, 2009, Cairo, Egypt.New York: IEEE Press, 2009: 4305- 4308.

[46] Selmanovic E, Debattista K, Bashford-Rogers T, et al. Enabling stereoscopic high dynamic range video[J]. Signal Processing: Image Communication, 2014, 29(2): 216-228.

[47] Bätz M, Richter T, Garbas J U, et al. High dynamic range video reconstruction from a stereo camera setup[J]. Signal Processing: Image Communication, 2014, 29(2): 191-202.

[48] Park W J, Ji S W, Kang S J, et al. Stereo vision-based high dynamic range imaging using differently-exposed image pair[J]. Sensors, 2017, 17(7): 1473.

[49] Heo Y S, Lee K M, Lee S U. Depth maps and high-dynamic range image generation from alternating exposure multiview images[J]. Journal of Electronic Imaging, 2017, 26(4): 043006.

[50] Pu ZY, Guo PY, Asif MS, et al. Robust high dynamic range (HDR) imaging with complex motion and parallax[M] //Ishikawa H, Liu C L, Pajdla T, et al. Computer vision-ACCV 2020. Lecture notes in computer science. Cham: Springer, 2021, 12623: 134- 149.

[51] Orozco RR, LoscosC, MartinI, et al. HDR multiview image sequence generation[M] //High dynamic range video. Amsterdam: Elsevier, 2017: 61- 86.

[52] Pizer SM, Johnston RE, Ericksen JP, et al.Contrast-limited adaptive histogram equalization: speed and effectiveness[C] //Proceedings of the First Conference on Visualization in Biomedical Computing, May 22-25, 1990, Atlanta, GA, USANew York: IEEE Press, 1990: 337- 345.

[53] Jobson D J, Rahman Z, Woodell G A. A multiscale retinex for bridging the gap between color images and the human observation of scenes[J]. IEEE Transactions on Image Processing, 1997, 6(7): 965-976.

[54] Liu J Y, Xu D J, Yang W H, et al. Benchmarking low-light image enhancement and beyond[J]. International Journal of Computer Vision, 2021, 129(4): 1153-1184.

[55] Petschnigg G, Szeliski R, Agrawala M, et al. Digital photography with flash and no-flash image pairs[J]. ACM Transactions on Graphics, 2004, 23(3): 664-672.

[56] Krishnan D, Fergus R. Dark flash photography[J]. ACM Transactions on Graphics, 2009, 28(3): 1-11.

[57] WangJ, Xue TF, Barron JT, et al.Stereoscopic dark flash for low-light photography[C] //2019 IEEE International Conference on Computational Photography (ICCP), May 15-17, 2019, Tokyo, Japan.New York: IEEE Press, 2019: 1- 10.

[58] Dong X, Li W X. Shoot high-quality color images using dual-lens system with monochrome and color cameras[J]. Neurocomputing, 2019, 352: 22-32.

[59] Guo PY, MaZ. Low-light color imaging via dual camera acquisition[M] //Ishikawa H, Liu C L, Pajdla T, et al. Computer vision-ACCV 2020. Lecture notes in computer science. Cham: Springer, 2021, 12623: 150- 167.

[60] 刘亿. 光学专题研究报告: 手机摄像头持续创新, 多方位支撑技术升级[R]. 厦门: 长城国瑞证券, 2020.

    LiuY. Special research report on optics: continuous innovation of mobile camera and upgrading of multi-directional support technology[R]. Xiamen: Great Wall Glory Securities Co., LTD, 2020.

[61] Brady D J, Fang L, Ma Z. Deep learning for camera data acquisition, control, and image estimation[J]. Advances in Optics and Photonics, 2020, 12(4): 787-846.

郭珮瑶, 蒲志远, 马展. 多相机系统:成像增强及应用[J]. 激光与光电子学进展, 2021, 58(18): 1811013. Peiyao Guo, Zhiyuan Pu, Zhan Ma. Multi-Camera System: Imaging Enhancement and Application[J]. Laser & Optoelectronics Progress, 2021, 58(18): 1811013.

引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!