太赫兹科学与电子信息学报, 2020, 18 (2): 298, 网络出版: 2020-05-28  

基于自适应下采样和超分重建的图像压缩框架

Image compression framework based on adaptive sub-sampling and super-resolution reconstruction
作者单位
四川大学 电子信息学院,四川 成都 610065
摘要
针对联合图像专家组(JPEG)标准设计了一种基于自适应下采样和超分辨力重建的图像压缩编码框架。在编码器端,为待编码的原始图像设计了多种不同的下采样模式和量化模式,通过率失真优化算法从 多种模式中选择最优的下采样模式(DSM)和量化模式(QM),最后待编码图像将在选择的模式下进行下采样和JPEG编码;在解码器端,采用基于卷积神经网络的超分辨力重建算法对解码后的下采样图像进行重建。此外, 所提出的框架扩展到JPEG2000压缩标准下同样有效可行。仿真实验结果表明,相比于主流的编解码标准和先进的编解码方法,提出的框架能有效地提升编码图像的率失真性能,并能获得更好的视觉效果。
Abstract
An image compression coding framework based on adaptive sub-sampling and super-resolution reconstruction is designed for the Joint Photographic Experts Group(JPEG) standard. At the encoder side, a variety of Different Sampling Modes(DSM) and Quantization Modes(QM) are designed for the original image to be encoded. Then, the rate distortion optimization algorithm selects the optimal downsampling and quantization modes from various modes. Finally, the image to be encoded will be sampled and compressed by the standard JPEG compression under the selected optimal mode. In the decoder side, the super-resolution reconstruction algorithm based on convolutional neural network is utilized to reconstruct the decoded sub-sampled image. In addition, the proposed framework is also effective and feasible under the JPEG2000 compression standard. The experimental results show that compared with the mainstream coding and decoding standards and advanced encoding and decoding methods, the framework can effectively improve the rate distortion performance and obtain better visual effects.
参考文献

[1] BRUCKSTEIN A,ELAD M,KIMMEL R. Down-scaling for better transform compression[J]. IEEE Transactions on Image

    Processing, 2003,12(9):1132-1144.

    BRUCKSTEIN A,ELAD M,KIMMEL R. Down-scaling for better transform compression[J]. IEEE Transactions on Image Processing, 2003,12(9):1132-1144.

    BRUCKSTEIN A,ELAD M,KIMMEL R. Down-scaling for better transform compression[J]. IEEE Transactions on Image Processing, 2003,12(9):1132-1144.

[2] ZHANG Jian,XIONG Ruiqin,ZHAO Chen,et al. CONCOLOR: constrained non-convex low-rank model for image deblocking[J]. IEEE Transactions on Image Processing, 2016,25(3):1246-1259.

    ZHANG Jian,XIONG Ruiqin,ZHAO Chen,et al. CONCOLOR: constrained non-convex low-rank model for image deblocking[J]. IEEE Transactions on Image Processing, 2016,25(3):1246-1259.

    IEEE Transactions on Image Processing, 2016,25(3):1246-1259.

    ZHANG Jian,XIONG Ruiqin,ZHAO Chen,et al. CONCOLOR: constrained non-convex low-rank model for image deblocking[J].

[3] Processing, 2006,15(9):2513-2521.

    LIN Weisi,LI Dong. Adaptive downsampling to improve image compression at low bit rates[J]. IEEE Transactions on Image

    LIN Weisi,LI Dong. Adaptive downsampling to improve image compression at low bit rates[J]. IEEE Transactions on Image Processing, 2006,15(9):2513-2521.

    LIN Weisi,LI Dong. Adaptive downsampling to improve image compression at low bit rates[J]. IEEE Transactions on Image Processing, 2006,15(9):2513-2521.

[4] CHEN Honggang,HE Xiaohai,MA Minglang,et al. Low bit rates image compression via adaptive block downsampling and super resolution[J]. Journal of Electronic Imaging, 2016,25(1):013004.

    CHEN Honggang,HE Xiaohai,MA Minglang,et al. Low bit rates image compression via adaptive block downsampling and super resolution[J]. Journal of Electronic Imaging, 2016,25(1):013004.

    super resolution[J]. Journal of Electronic Imaging, 2016,25(1):013004.

    CHEN Honggang,HE Xiaohai,MA Minglang,et al. Low bit rates image compression via adaptive block downsampling and

[5] LI Yang,SUN Xiaoyan,XIONG Hongkai,et al. Incorporating primal sketch based learning into low bit-rate image compression[C]// IEEE International Conference on Image Processing. San Antonio:IEEE, 2007:173-176.

    LI Yang,SUN Xiaoyan,XIONG Hongkai,et al. Incorporating primal sketch based learning into low bit-rate image compression[C]// IEEE International Conference on Image Processing. San Antonio:IEEE, 2007:173-176.

    LI Yang,SUN Xiaoyan,XIONG Hongkai,et al. Incorporating primal sketch based learning into low bit-rate image compression[C]//

    IEEE International Conference on Image Processing. San Antonio:IEEE, 2007:173-176.

[6] DONG C,LOY C C,HE K M,et al. Learning a deep convolutional network for image super-resolution[C]// European Conference on Computer Vision. Berlin:Springer Verlag, 2014:184-199.

    DONG C,LOY C C,HE K M,et al. Learning a deep convolutional network for image super-resolution[C]// European Conference on

    DONG C,LOY C C,HE K M,et al. Learning a deep convolutional network for image super-resolution[C]// European Conference on Computer Vision. Berlin:Springer Verlag, 2014:184-199.

    Computer Vision. Berlin:Springer Verlag, 2014:184-199.

[7] DONG C,LOY C C,TANG X. Accelerating the super-resolution convolutional neural network[C]// European Conference on Computer Vision. Amsterdam:Springer, 2016:391-407.

    DONG C,LOY C C,TANG X. Accelerating the super-resolution convolutional neural network[C]// European Conference on

    DONG C,LOY C C,TANG X. Accelerating the super-resolution convolutional neural network[C]// European Conference on Computer Vision. Amsterdam:Springer, 2016:391-407.

    Computer Vision. Amsterdam:Springer, 2016:391-407.

[8] 李素梅,雷国庆,范如. 基于卷积神经网络的深度图超分辨力重建[J]. 光学学报, 2017,37(12):1210002. (LI Sumei,LEI Guoqing,FAN Ru. Depth map super-resolution based on deep convolutional neural networks[J]. Acta Optica Sinica,2017,37(12):1210002.)

    李素梅,雷国庆,范如. 基于卷积神经网络的深度图超分辨力重建[J]. 光学学报, 2017,37(12):1210002. (LI Sumei,

    李素梅,雷国庆,范如. 基于卷积神经网络的深度图超分辨力重建[J]. 光学学报, 2017,37(12):1210002. (LI Sumei,LEI Guoqing,FAN Ru. Depth map super-resolution based on deep convolutional neural networks[J]. Acta Optica Sinica,2017,37(12):1210002.)

    2017,37(12):1210002.)

    LEI Guoqing,FAN Ru. Depth map super-resolution based on deep convolutional neural networks[J]. Acta Optica Sinica,

[9] 徐冉,张俊格,黄凯奇. 利用双通道卷积神经网络的图像超分辨力算法[J]. 中国图象图形学报, 2016,21(5):556-564.

    徐冉,张俊格,黄凯奇. 利用双通道卷积神经网络的图像超分辨力算法[J]. 中国图象图形学报, 2016,21(5):556-564.(XU Ran,ZHANG Junge,HUANG Kaiqi. Image super-resolution using two-channel convolutional neural networks[J]. Journal ofImage and Graphics, 2016,21(5):556-564.)

    徐冉,张俊格,黄凯奇. 利用双通道卷积神经网络的图像超分辨力算法[J]. 中国图象图形学报, 2016,21(5):556-564.(XU Ran,ZHANG Junge,HUANG Kaiqi. Image super-resolution using two-channel convolutional neural networks[J]. Journal ofImage and Graphics, 2016,21(5):556-564.)

    (XU Ran,ZHANG Junge,HUANG Kaiqi. Image super-resolution using two-channel convolutional neural networks[J]. Journal of

    Image and Graphics, 2016,21(5):556-564.)

[10] 胡长胜,詹曙,吴从中. 基于深度特征学习的图像超分辨力重建[J]. 自动化学报, 2017,43(5):814-821. (HU Changsheng,ZHAN Shu,WU Congzhong. Image super-resolution based on deep learning features[J]. Acta Automatica Sinica, 2017,43(5):814-821.)

    胡长胜,詹曙,吴从中. 基于深度特征学习的图像超分辨力重建[J]. 自动化学报, 2017,43(5):814-821. (HU Changsheng,

    胡长胜,詹曙,吴从中. 基于深度特征学习的图像超分辨力重建[J]. 自动化学报, 2017,43(5):814-821. (HU Changsheng,ZHAN Shu,WU Congzhong. Image super-resolution based on deep learning features[J]. Acta Automatica Sinica, 2017,43(5):814-821.)

    43(5):814-821.)

    ZHAN Shu,WU Congzhong. Image super-resolution based on deep learning features[J]. Acta Automatica Sinica, 2017,

[11] KIM J,LEE J K,LEE K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the

    IEEE Conference on Computer Vision and Pattern Recognition. Washington,USA:IEEE Computer Society, 2016:1646-

    KIM J,LEE J K,LEE K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington,USA:IEEE Computer Society, 2016:1646-1654.

    KIM J,LEE J K,LEE K M. Accurate image super-resolution using very deep convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Washington,USA:IEEE Computer Society, 2016:1646-1654.

    1654.

[12] CHEN H,HE X,REN C,et al. CISRDCNN:super-resolution of compressed images using deep convolutional neural networks[J].Neurocomputing, 2018(285):204-219.

    CHEN H,HE X,REN C,et al. CISRDCNN:super-resolution of compressed images using deep convolutional neural networks[J].Neurocomputing, 2018(285):204-219.

[13] ZEYDE R,ELAD M,PROTTER M. On single image scale-up using sparse-representations[C]// International Conference on Curves and Surfaces. Avignon,France:[s.n.], 2010:711-730.

    ZEYDE R,ELAD M,PROTTER M. On single image scale-up using sparse-representations[C]// International Conference on Curves and Surfaces. Avignon,France:[s.n.], 2010:711-730.

[14] HUANG J B,SINGH A,AHUJA N. Single image super-resolution from transformed self-exemplars[C]// IEEE Conference on Computer Vision and Pattern Recognition. Boston,USA:IEEE Computer Society, 2015:5197-5206.

    HUANG J B,SINGH A,AHUJA N. Single image super-resolution from transformed self-exemplars[C]// IEEE Conference on Computer Vision and Pattern Recognition. Boston,USA:IEEE Computer Society, 2015:5197-5206.

[15] WEBER A G. The USC-SIPI image database version 5[J]. USC-SIPI Report, 1997(315):1-24.

    WEBER A G. The USC-SIPI image database version 5[J]. USC-SIPI Report, 1997(315):1-24.

[16] KRIZHEVSKY A,SUTSKEVER I,HINTON G E. Image net classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012(1):1097-1105.

    KRIZHEVSKY A,SUTSKEVER I,HINTON G E. Image net classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012(1):1097-1105.

[17] DABOV K,FOI A,EGIAZARIAN K. Image denoising with block-matchin g and 3D filter i n g[J]. Proceedings of Society of Photo-Optical Instrumentation Engineers, 2006(6064):354-365.

    DABOV K,FOI A,EGIAZARIAN K. Image denoising with block-matchin g and 3D filter i n g[J]. Proceedings of Society of Photo-Optical Instrumentation Engineers, 2006(6064):354-365.

张达明, 何小海, 任超, 吴晓红, 李兴龙, 范梦. 基于自适应下采样和超分重建的图像压缩框架[J]. 太赫兹科学与电子信息学报, 2020, 18(2): 298. ZHANG Daming, HE Xiaohai, REN Chao, WU Xiaohong, LI Xinglong, FAN Meng. Image compression framework based on adaptive sub-sampling and super-resolution reconstruction[J]. Journal of terahertz science and electronic information technology, 2020, 18(2): 298.

关于本站 Cookie 的使用提示

中国光学期刊网使用基于 cookie 的技术来更好地为您提供各项服务,点击此处了解我们的隐私策略。 如您需继续使用本网站,请您授权我们使用本地 cookie 来保存部分信息。
全站搜索
您最值得信赖的光电行业旗舰网络服务平台!