首页 > 论文 > 激光与光电子学进展 > 54卷 > 9期(pp:93001--1)

基于直方图分层映射的近红外光谱预处理算法

Near Infrared Spectral Pre-Processing Algorithm Based on Histogram Layering Mapping

  • 摘要
  • 论文信息
  • 参考文献
  • 被引情况
  • PDF全文
分享:

摘要

为解决近红外光谱快速检测乳品成分及含量时光谱数据的预处理问题, 提出一种基于直方图分层映射技术的近红外光谱主成分得分重置(SR)预处理方法。以葡萄糖氯化钠水溶液三组分样品中的葡萄糖含量、鲜牛奶样品中的乳糖含量为定量检测目标, 进行散射光谱主成分得分累计贡献率的分层分段规定化映射预处理, 利用偏最小二乘(PLS)回归分析建模手段, 对相应近红外光谱中的糖含量信息进行测试及分析。结果表明, 经过SR预处理后, 牛奶中乳糖含量PLS模型的校正集样品交互验证预测偏差降低23.9%, 实际预测偏差降低27.8%; 验证集实际预测偏差降低16.7%。该SR光谱预处理方法兼顾光谱、参考值及组分相关性等多尺度信息, 以实现光谱信息增强去噪, 能避免有用信息误删, 防止不充分拟合及过拟合。

Abstract

In order to solve the pre-processing problem of spectral data in near infrared rapid detection analysis of content of milk components, a pre-processing algorithm for score resetting (SR) of principal components (PC) in the near infrared spectrum on the basis of histogram layering mapping technology is proposed. With glucose content in the three components samples consisting of glucose, NaCl and water, and lactose content in the fresh milk samples, as the detecting objects, cumulative contribution rates of the near infrared scattering spectral PC scores are pre-processed by means of mapping by layer and by piece. Furthermore, partial least squares (PLS) regression analysis method is used for modeling, thereby test and analysis of sugar content information in corresponding near infrared spectra are completed. The results show that after SR pretreatment, the predicted deviation of the calibration curve of the milk lactose content PLS model is reduced by 23.9%, the actual prediction deviation is reduced by 27.8%, and the actual prediction deviation of the verification set is reduced by 16.7%. This SR spectral preprocessing method takes into account multi-scale information such as spectra, reference content value and component correlation to realize spectral information denoising enhancement. Therefore, false deletion of useful information can be avoided, and inadequate fitting and overfitting can be prevented.

投稿润色
补充资料

中图分类号:O433.4

DOI:10.3788/lop54.093001

所属栏目:光谱学

基金项目:国家自然科学基金(11574065)

收稿日期:2017-01-19

修改稿日期:2017-03-21

网络出版日期:--

作者单位    点击查看

王丽杰:哈尔滨理工大学测控技术与通信工程学院, 黑龙江 哈尔滨 150080哈尔滨理工大学测控技术与仪器黑龙江省高校重点实验室, 黑龙江 哈尔滨 150080
杨羽翼:哈尔滨理工大学测控技术与通信工程学院, 黑龙江 哈尔滨 150080哈尔滨理工大学测控技术与仪器黑龙江省高校重点实验室, 黑龙江 哈尔滨 150080
代敏:哈尔滨理工大学测控技术与通信工程学院, 黑龙江 哈尔滨 150080哈尔滨理工大学测控技术与仪器黑龙江省高校重点实验室, 黑龙江 哈尔滨 150080
高玮:哈尔滨理工大学应用科学学院, 黑龙江 哈尔滨 150080

联系人作者:王丽杰(wlj@hrbust.edu.cn)

备注:(1971-), 女, 博士, 教授, 主要从事精密仪器及机械方面的研究。

【1】Wang Y W, Ding W, Kou L P, et al. A non-destructive method to assess freshness of raw bovine milk using FT-NIR spectroscopy[J]. Journal of Food Science and Technology, 2015, 52(8): 5305-5310.

【2】Chu Xiaoli, Lu Wanzhen. Research and application progress of near infrared spectroscopy analytical technology in China in the past five years[J]. Spectroscopy and Spectral Analysis, 2014, 34(10): 2595-2605.
褚小立, 陆婉珍. 近五年我国近红外光谱分析技术研究与应用进展[J]. 光谱学与光谱分析, 2014, 34(10): 2595-2605.

【3】Fu Bo, Hu Yongxiang, Liu Rong, et al. Near-infrared measurement with medium concentration sample as reference[J]. Acta Optica Sinica, 2016, 36(2): 0230003.
傅 博, 胡永翔, 刘 蓉, 等. 基于中等浓度样品参考测量的近红外光谱检测方法[J]. 光学学报, 2016, 36(2): 0230003.

【4】Lu Wanzhen. Modern near infrared spectra analysis technology[M]. Beijing: China Petrochemical Press, 2000.
陆婉珍. 现代近红外光谱分析技术[M]. 北京: 中国石化出版社, 2000.

【5】Andersson C A. Direct orthogonalization[J]. Chemometrics and Intelligent Laboratory Systems, 1999, 47(1): 51-63.

【6】Fearn T. On orthogonal signal correction[J]. Chemometrics and Intelligent Laboratory Systems, 2000, 50(1): 47-52.

【7】Li Yaping, Zhang Guangjun, Li Qingbo. Application of O2-PLS in experimental study on non-invasive measurement of blood glucose[J]. Acta Optica Sinica, 2010, 30(3): 854-860.
李亚萍, 张广军, 李庆波. 基于O2-PLS方法的血糖无损检测实验研究[J]. 光学学报, 2010, 30(3): 854-860.

【8】Lu Wanzhen, Yuan Hongfu, Chu Xiaoli. Near infrared spectrometer[M]. Beijing: Chemical Industry Press, 2010: 27-30.
陆婉珍, 袁洪福, 褚小立. 近红外光谱仪器[M]. 北京: 化学工业出版社, 2010: 27-30.

【9】Chu Xiaoli, Yuan Hongfu, Lu Wanzhen. Progress and application of spectral data pretreatment and wavelength selection methods in NIR analytical technique[J]. Progress in Chemistry, 2004,16(4): 528-542.
褚小立, 袁洪福, 陆婉珍. 近红外分析中光谱预处理及波长选择方法进展与应用[J]. 化学进展, 2004, 16(4): 528-542.

【10】Wang L J, Zhou Z, Qin Y, et al. Analysis of data mining method for near infrared spectral data of dairy products based orthogonality[C]. International Conference of Electronic Engineering and Information Science, 2014, 981: 641-646.

【11】Gonzalez R C, Woods R E. Digital image processing[M]. Ruan Qiuqi, Transl. 2nd ed. Beijing: Publishing House of Electronics Industry, 2007: 70-84.
Gonzalez R C, Woods R E Eddins S L. 数字图像处理[M]. 阮秋琦, 译. 2版. 北京: 电子工业出版社, 2007: 70-84.

【12】Lim J, Kim G, Mo C, et al. Detection of melamine in milk powders using near-infrared hyperspectral imaging combined with regression coefficient of partial least square regression model[J]. Talanta, 2016, 151: 183-191.

【13】Yu Shimiao, Lu Wei, Liang Kun, et al. Study on prediction of germination rate of rice seeds using hyperspectral imaging combined with PCA and GRNN[J]. Laser & Optoelectronics Progress, 2015, 52(11): 113001.
于施淼, 卢 伟, 梁 琨, 等. 基于高光谱成像技术结合PCA-GRNN的糙米发芽率检测方法研究[J]. 激光与光电子学进展, 2015, 52(11): 113001.

【14】Chen Wenfei. Research of image enhancement based on probability theory[D]. Wuhan: Wuhan University, 2011.
陈文飞. 基于概率统计方法的图像增强研究[D]. 武汉: 武汉大学, 2011.

【15】Nie Chao. Efficient image enhancement algorithm research based on histogram[D]. Hangzhou: Hangzhou Dianzi University, 2014: 27-29.
聂 超. 基于直方图的高效图像增强算法研究[D]. 杭州: 杭州电子科技大学, 2014: 27-29.

【16】Liu Bo, Hu Zhengping, Wang Chengru. Multi-level interactive image enhancement algorithm based on fuzzy relaxation iterative procedure[J]. Optical Technique, 2009, 35(1): 131-134.
刘 博, 胡正平, 王成儒. 基于模糊松弛迭代的分层图像增强算法[J]. 光学技术, 2009, 35(1): 131-134.

【17】Wang Lijie. Research on rapid measuring method and system for milk constituents detecting by near infared spectrum[D]. Harbin: Harbin University of Science and Technology, 2006: 80-82.
王丽杰. 快速检测牛奶成分的近红外光谱测量方法及系统研究[D]. 哈尔滨: 哈尔滨理工大学, 2006: 80-82.

引用该论文

Wang Lijie,Yang Yuyi,Dai Min,Gao Wei. Near Infrared Spectral Pre-Processing Algorithm Based on Histogram Layering Mapping[J]. Laser & Optoelectronics Progress, 2017, 54(9): 093001

王丽杰,杨羽翼,代敏,高玮. 基于直方图分层映射的近红外光谱预处理算法[J]. 激光与光电子学进展, 2017, 54(9): 093001

您的浏览器不支持PDF插件,请使用最新的(Chrome/Fire Fox等)浏览器.或者您还可以点击此处下载该论文PDF