Explainable Unfolding Network For Joint Edge-Preserving Depth Map Super-Resolution.

Although color-guided depth map super-resolution methods based on deep learning have achieved great progress, these methods are not explainable and their super-resolution results are suffered from texture-copying and boundary blurring problems. In order to alleviate these problems, we propose an explainable depth map super-resolution network by unfolding edge-constrained optimization model, dubbed Ex-DSRNet. First, we propose an edge reconstruction network to recover accurate edge information, then feed edge information and color information into different depth map reconstruction networks to reconstruct depth information. Finally, a high-fidelity network is proposed to fuse the above two kinds of depth information to obtain high-quality depth map. A large number of experimental results have demonstrated that the proposed Ex-DSRNet can compete against many state-of-the-art depth map super-resolution methods in term of root mean square error.