A dual-encoder network based on multi-layer feature fusion for infrared and visible image fusion
International Journal of Machine Learning and Cybernetics(2024)
摘要
Infrared and visible image fusion (IVIF) is to achieve the fused images with multimodal complementary information of source images. To effectively fuse the complementary information, a dual-encoder network based on multi-layer feature fusion for IVIF is proposed, which can effectively fuse the features of source images at different levels. Specifically, a deep semantic information fusion module (DSIFM) is constructed to merge the deep-level features of the network at different scales. Meanwhile, considering the difference between infrared and visible features, a shallow-middle information fusion module (SMIFM) is built to integrate the shallow and middle features obtained by two encoders with the deep features delivered by the network. Furthermore, a joint loss function including sensitivity loss and structural similarity loss is defined to preserve the salient targets and texture features of source images in the fusion result. Qualitative and quantitative experimental results confirm the superiority of the proposed method over state-of-the-art approaches. Specifically, our method improves the MI and SSIM metrics by 60.78 https://github.com/yotick/IJMLC .
更多查看译文
关键词
Infrared and visible image fusion,Dual-encoder network,Multi-layer feature fusion,Joint loss function
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要