融合心率变异性与表情的非接触心理压力检测 下载: 1182次
Non-Contact Psychological Stress Detection Combining Heart Rate Variability and Facial Expressions
北京理工大学光电学院北京市精密光电测试仪器与技术重点实验室, 北京 100081
图 & 表
图 1. 心理压力评估模型的建立过程
Fig. 1. Process of the establishing a psychological stress assessment model
下载图片 查看原文
图 2. 非接触式HRV的提取流程
Fig. 2. Extraction flow chart of the non-contact HRV
下载图片 查看原文
图 3. HRV提取程中的信号图。(a)灰度均值;(b)处理后的脉搏波信号;(c) R-R间期的时序图
Fig. 3. Signal diagram during HRV extraction. (a) Mean gray value; (b) pulse wave signal after processing; (c) timing diagram of R-R interval
下载图片 查看原文
图 4. 实验装置图
Fig. 4. Diagram of the experimental setup
下载图片 查看原文
图 5. HRV特征分布的盒形图。(a) Mean HR;(b) SDNN;(c) PNN50;(d) RMSSD;(e) NLF;(f) NHF;(g) XLF/XHF;(h) XSD2;(i) D2
Fig. 5. Box plot of the HRV feature distribution. (a) Mean HR; (b) SDNN; (c) PNN50; (d) RMSSD; (e) NLF; (f) NHF; (g) XLF/XHF; (h) XSD2; (i) D2
下载图片 查看原文
图 6. 表情压力值的盒形图
Fig. 6. Box plot of the expression pressure value
下载图片 查看原文
表 1HRV的时域分析指标
Table1. Time domain analysis indicators of the HRV
Index | Definition | Unit | Meaning |
---|
Mean HR | the average number ofheartbeats per minute | BPM | reflect the heart beat rate | PNN50 | the heart rate of adjacent R-R intervalsgreater than 50ms as a percentageof all NN intervals | % | reflect the activity ofparasympathetic nerve | SDNN | | ms | reflect the level that the heart ratevariability deviates from the average | RMSSD | | ms | measure the regulation effect ofparasympathetic nerve on heart rate |
|
查看原文
表 2HRV频域分析指标
Table2. Frequency domain analysis indicators of the HRV
Index | Definition | Unit | Meaning |
---|
XVLF | ultra low frequency power (≤0.04 HZ) | ms2 | related to body adjustment | XLF | low frequency power(0.04--0.15 HZ) | ms2 | reflect the activity of sympathetic nerve | XHF | high frequency power(0.15--0.4 HZ) | ms2 | reflect the activity of parasympathetic nerve | NLF | NLF=×100% | % | standardized low frequency power,direct response to the activity ofsympathetic nerve.TP:total power | NHF | NHF=×100% | % | standardized high frequency power,direct response to the activity ofparasympathetic nerve.TP:total power | XLF/XHF | power ratio of low frequencyband to high frequency band | - | reflect the balance of sympatheticand parasympathetic nerves | PVLF | peak point of ultra low frequency power | Hz | - | PLF | peak point of low frequency power | Hz | - | PHF | peak point of high frequency power | Hz | - |
|
查看原文
表 3HRV的非线性分析指标
Table3. Non-linear analysis indicators of the HRV
Index | Definition | Unit | Meaning |
---|
XSD1 | the standard deviation of thevertical line in the Poincaré chart | ms | related to sympathetic nerve activity | XSD2 | the standard deviation along themarked line in the Poincaré chart | ms | related to parasympathetic nerve activity | D2 | correlation dimension | - | reflect the heart's ability toadapt to the environment | α1 | short-term volatility slope in trend volatility analysis | - | - | α2 | long-term volatility slope in trend volatility analysis | - | - |
|
查看原文
表 4HRV的结果
Table4. Results of the HRV
Name | Normal | Stress |
---|
Mean HR /BPM | 78.231 | 84.421 | PNN50 /% | 33.882 | 29.164 | SDNN /ms | 52.034 | 46.424 | RMSSD /ms | 38.623 | 33.862 | XVLF /ms2 | 52.317 | 42.347 | XLF /ms2 | 375.427 | 327.135 | XHF /ms2 | 961.326 | 613.463 | NLF /% | 28.085 | 34.779 | NHF /% | 71.915 | 65.221 | XLF/XHF | 0.417 | 0.541 | PVLF /Hz | 0.039 | 0.039 | PLF /Hz | 0.110 | 0.117 | PHF /Hz | 0.285 | 0.297 | XSD1 /ms | 38.457 | 37.837 | XSD2 /ms | 41.626 | 31.976 | D2 | 3.541 | 2.036 | α1 | 0.668 | 0.636 | α2 | 0.220 | 0.236 |
|
查看原文
表 5使用HRV与人脸表情训练的结果
Table5. Results of training using HRV and facial expressions
Model | Kernel type | Gamma | C | Accuracy /% |
---|
SVM | Gaussiankernel function | 0.002 | 6.679 | 81.4 |
|
查看原文
表 6对比实验的结果
Table6. Results of the comparative experimentsunit: %
Method | Accuracy |
---|
HRV feature in Ref. [10] | 65.1 | HRV feature in ours | 73.9 | Expression | 71.9 | HRV & Expression | 81.4 |
|
查看原文
孔令琴, 陈飞, 赵跃进, 董立泉, 刘明, 惠梅. 融合心率变异性与表情的非接触心理压力检测[J]. 光学学报, 2021, 41(3): 0310003. Lingqin Kong, Fei Chen, Yuejin Zhao, Liquan Dong, Ming Liu, Mei Hui. Non-Contact Psychological Stress Detection Combining Heart Rate Variability and Facial Expressions[J]. Acta Optica Sinica, 2021, 41(3): 0310003.