DIFFERENTIABLE PROGRAMMING A LA MOREAU
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)(2022)
Abstract
The notion of a Moreau envelope is central to the analysis of first-order optimization algorithms for machine learning and signal processing. We define a compositional calculus adapted to Moreau envelopes and show how to apply it to deep networks, and, more broadly, to learning systems equipped with automatic differentiation and implemented in the spirit of differentiable programming.
MoreTranslated text
Key words
Moreau envelope,differentiable programming,mathematical optimization,deep learning
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined