Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models

Zeman Li, Xinwei Zhang,Peilin Zhong, Yuan Deng,Meisam Razaviyayn,Vahab Mirrokni

arxiv(2024)

引用 0|浏览0
暂无评分
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要