激光与光电子学进展, 2020, 57 (16): 161011, 网络出版: 2020-08-05
基于短视频图像的立木深度图生成算法 下载: 1608次
Tree Depth Image Generation Algorithm Based on Short Video Images
图像处理 立木图像 深度图 立木图像分割 光束法平差 密集立体匹配 image processing tree images depth images tree images segmentation bundle adjustment dense stereo matching
摘要
针对深度相机受环境光干扰大而导致立木深度图获取困难的问题,提出一种基于小运动短视频图像的立木深度图生成算法。该算法对分割后获取的亚像素角点进行跟踪和匹配,利用光束法平差估计相机参数;利用平面扫描法对图像序列进行密集立体匹配、去噪得到立木深度图。使用智能手机采集1~2 s小运动的立木短视频图像验证所提算法的有效性,生成的立木深度图在主观效果上有显著提升。在深度图像数据库NYU depth v2上进行验证,均方根误差为60.58,相对误差为0.34。实验结果表明:自然环境下利用该算法可有效生成精细的立木深度图,不需要深度相机、相机标定以及大量RGB(Red,Green,Blue)图像、深度图的训练,能有效节省数据采集和存储的开销,研究结果可为立木的可视化重建、立木因子的测量等提供参考。
Abstract
Focusing on the issue of ambient light interference affecting a depth camera and difficulty in obtaining the tree depth images, tree depth image generation algorithm based on small motion short video images is proposed. The algorithm tracks and matches the subpixel corners obtained after segmentation, uses the bundle adjustment to estimate the camera parameters. Intensive stereo matching and denoising of image sequences using plane scanning method to obtain tree depth images. The effectiveness of the proposed algorithm is verified using smartphones by collecting short video images of 1-2 s small movements, and the generated tree depth images exhibited a significant improvement in subjective effect. Verification on the depth image database NYU depth v2 revealed root mean square error is 60.58 and relative error is 0.34. Experiment results show that using this algorithm in a natural setting, a fine tree depth images can be effectively generated without the need for depth cameras, camera calibration, and training of a large number of RGB (Red, Green, Blue) images and depth images, which can reduce the data collection and storage costs. The research findings can provide a reference for the visual reconstruction of standing wood and measurement of the standing wood factor.
杨红, 徐爱俊. 基于短视频图像的立木深度图生成算法[J]. 激光与光电子学进展, 2020, 57(16): 161011. Hong Yang, Aijun Xu. Tree Depth Image Generation Algorithm Based on Short Video Images[J]. Laser & Optoelectronics Progress, 2020, 57(16): 161011.