Bandwidth Characterization of DeepSpeed on Distributed Large Language Model Training
IEEE International Symposium on Performance Analysis of Systems and Software（2024）
关键词
Bandwidth Characterization,Distributed Training,Large Language Model,Microsoft DeepSpeed,Megatron-LM
AI 理解论文
溯源树
样例
生成溯源树，研究论文发展脉络
Chat Paper
正在生成论文摘要