Resolve Domain Conflicts for Generalizable Remote Physiological Measurement
MM '23: Proceedings of the 31st ACM International Conference on Multimedia(2024)
摘要
Remote photoplethysmography (rPPG) technology has become increasingly popular
due to its non-invasive monitoring of various physiological indicators, making
it widely applicable in multimedia interaction, healthcare, and emotion
analysis. Existing rPPG methods utilize multiple datasets for training to
enhance the generalizability of models. However, they often overlook the
underlying conflict issues across different datasets, such as (1) label
conflict resulting from different phase delays between physiological signal
labels and face videos at the instance level, and (2) attribute conflict
stemming from distribution shifts caused by head movements, illumination
changes, skin types, etc. To address this, we introduce the DOmain-HArmonious
framework (DOHA). Specifically, we first propose a harmonious phase strategy to
eliminate uncertain phase delays and preserve the temporal variation of
physiological signals. Next, we design a harmonious hyperplane optimization
that reduces irrelevant attribute shifts and encourages the model's
optimization towards a global solution that fits more valid scenarios. Our
experiments demonstrate that DOHA significantly improves the performance of
existing methods under multiple protocols. Our code is available at
https://github.com/SWY666/rPPG-DOHA.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要