A Review on Main Optimization Method of ALBERT in Natural Language Processing

This paper mainly sorts out the related research and optimization route of the ALBERT [1] model released by Google and introduces the main application scenarios and model combination directions of ALBERT. Experiments by many researchers show that: The current research direction of this model is mainly focused on different application scenarios and combined with other improved models, only a few researchers will improve and optimize the structure of the model itself. Through literature research, this paper also looks forward to the possible future development direction of ALBERT.