激光与光电子学进展, 2020, 57 (18): 181509, 网络出版: 2020-09-02   

基于空时特征和注意力机制的无参考视频质量评价 下载: 1009次

No Reference Video Quality Assessment Based on Spatio-Temporal Features and Attention Mechanism
朱泽 1桑庆兵 1,2,*张浩 1
作者单位
1 江南大学物联网工程学院, 江苏 无锡 214122
2 江苏省模式识别与计算智能工程实验室, 江苏 无锡 214122
摘要
随着视频技术的飞速发展,越来越多的视频应用逐步进入人们的生活中,因此对视频质量的研究很有意义。基于卷积神经网络和循环神经网络强大的特征提取能力并结合注意力机制,提出一种无参考视频质量评价算法。该算法首先利用VGG(Visual Geometry Group)网络提取失真视频的空域特征,然后利用循环神经网络提取失真视频的时域特征,引入注意力机制对视频的空时特征进行重要度计算,根据重要度得到视频的整体特征,最后通过全连接层回归得到视频质量的评价分数。在3个公开视频数据库上的实验结果表明,预测结果与人类主观质量评分具有较好的一致性,与最新的视频质量评价算法相比具有更好的性能。
Abstract
With the rapid development of video technology, more and more video applications gradually enter people's lives, Therefore, conducting research on video quality is very meaningful. Herein, a no-reference video quality assessment algorithm based on the powerful feature-extraction capabilities of convolutional neural networks and recurrent neural networks combined with the attention mechanism is proposed. This algorithm first extracts the spatial features of the distorted videos by using the Visual Geometry Group (VGG) network, the distortion of video airspace feature extraction. Further, we use cycle time-domain features of neural networks to extract the video distortion. Then the introduced attention mechanism important degree for the space-time characteristics of the video is calculated according to the important degree of the overall characteristics of the video. Finally, regression of the entire connection layer is performed to obtain the evaluation score of the video quality. Experiment results on three public video databases show that the predicted results are in good agreement with human subjective quality scores and have better performance than the latest video quality evaluation algorithms.

朱泽, 桑庆兵, 张浩. 基于空时特征和注意力机制的无参考视频质量评价[J]. 激光与光电子学进展, 2020, 57(18): 181509. Ze Zhu, Qingbing Sang, Hao Zhang. No Reference Video Quality Assessment Based on Spatio-Temporal Features and Attention Mechanism[J]. Laser & Optoelectronics Progress, 2020, 57(18): 181509.

本文已被 1 篇论文引用
被引统计数据来源于中国光学期刊网
引用该论文: TXT   |   EndNote

相关论文

加载中...

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!