Olatunji Ruwase

基本信息

浏览量：126

职业迁徙

个人简介

My current research is in systems and convergence techniques for efficient large-scale training and serving of deep learning models.

研究兴趣

论文共 48 篇作者统计合作学者相似作者

按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选

Quant-LLM: Accelerating the Serving of Large Language Models Via FP6-Centric Algorithm-System Co-Design on Modern GPUs

Haojun Xia,Zhen Zheng,Xiaoxia Wu,Shiyang Chen,Zhewei Yao,Stephen Youn,Arash Bakhtiari, Michael Wyatt,Donglin Zhuang,Zhongzhu Zhou,Olatunji Ruwase,Yuxiong He,Shuaiwen Leon Song

PROCEEDINGS OF THE 2024 USENIX ANNUAL TECHNICAL CONFERENCE, ATC 2024pp.699-713, (2024)

引用0浏览0EI引用

Domino: Eliminating Communication in LLM Training Via Generic Tensor Slicing and Overlapping

Guanhua Wang,Chengming Zhang, Zheyu Shen,Ang Li,Olatunji Ruwase

arxiv（2024）

引用0浏览0引用

FastPersist: Accelerating Model Checkpointing in Deep Learning

Guanhua Wang,Olatunji Ruwase, Bing Xie,Yuxiong He

CoRR (2024)

引用0浏览0EI引用

Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding

Zhenyu Zhang,Runjin Chen,Shiwei Liu,Zhewei Yao,Olatunji Ruwase,Beidi Chen,Xiaoxia Wu,Zhangyang Wang

CoRR (2024)

引用0浏览0EI引用

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer

Jinghan Yao,Sam Ade Jacobs,Masahiro Tanaka,Olatunji Ruwase,Aamir Shafi, Hari Subramoni,Dhabaleswar K. Panda

CoRR (2024)

引用0浏览0EI引用

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design

Haojun Xia,Zhen Zheng,Xiaoxia Wu, Shiyang Chen,Zhewei Yao,Stephen Youn,Arash Bakhtiari,Michael Wyatt,Donglin Zhuang,Zhongzhu Zhou,Olatunji Ruwase,Yuxiong He,Shuaiwen Leon Song

CoRR (2024)

引用8浏览0EI引用

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah Abdin,Jyoti Aneja,Hany Awadalla,Ahmed Awadallah,Ammar Ahmad Awan,Nguyen Bach, Amit Bahree,Arash Bakhtiari,Jianmin Bao,Harkirat Behl,Alon Benhaim,Misha Bilenko,Johan Bjorck,Sébastien Bubeck, Martin Cai, Qin Cai,Vishrav Chaudhary, Dong Chen,Dongdong Chen,Weizhu Chen,Yen-Chun Chen, Yi-Ling Chen,Hao Cheng, Parul Chopra,Xiyang Dai, Matthew Dixon,Ronen Eldan,Victor Fragoso,Jianfeng Gao, Mei Gao, Min Gao, Amit Garg,Allie Del Giorno,Abhishek Goswami,Suriya Gunasekar, Emman Haider,Junheng Hao,Russell J. Hewett, Wenxiang Hu, Jamie Huynh,Dan Iter,Sam Ade Jacobs,Mojan Javaheripi,Xin Jin,Nikos Karampatziakis,Piero Kauffmann, Mahoud Khademi, Dongwoo Kim,Young Jin Kim,Lev Kurilenko,James R. Lee,Yin Tat Lee,Yuanzhi Li, Yunsheng Li,Chen Liang,Lars Liden, Xihui Lin,Zeqi Lin,Ce Liu,Liyuan Liu,Mengchen Liu, Weishung Liu,Xiaodong Liu,Chong Luo,Piyush Madan, Ali Mahmoudzadeh, David Majercak,Matt Mazzola,Caio César Teodoro Mendes,Arindam Mitra, Hardik Modi,Anh Nguyen,Brandon Norick,Barun Patra, Daniel Perez-Becker, Thomas Portet,Reid Pryzant,Heyang Qin, Marko Radmilac,Liliang Ren,Gustavo de Rosa,Corby Rosset, Sambudha Roy,Olatunji Ruwase,Olli Saarikivi,Amin Saied,Adil Salim,Michael Santacroce,Shital Shah,Ning Shang,Hiteshi Sharma,Yelong Shen,Swadheen Shukla,Xia Song,Masahiro Tanaka, Andrea Tupini, Praneetha Vaddamanu, Chunyu Wang,Guanhua Wang,Lijuan Wang, Shuohang Wang,Xin Wang, Yu Wang, Rachel Ward, Wen,Philipp Witte, Haiping Wu, Xiaoxia Wu,Michael Wyatt, Bin Xiao,Can Xu,Jiahang Xu,Weijian Xu,Jilong Xue, Sonali Yadav,Fan Yang, Jianwei Yang, Yifan Yang,Ziyi Yang,Donghan Yu, Lu Yuan, Chenruidong Zhang,Cyril Zhang, Jianwen Zhang,Li Lyna Zhang,Yi Zhang, Yue Zhang, Yunan Zhang,Xiren Zhou

CoRR (2024)

引用410浏览0EI引用

410

Universal Checkpointing: Efficient and Flexible Checkpointing for Large Scale Distributed Training

Xinyu Lian,Sam Ade Jacobs,Lev Kurilenko,Masahiro Tanaka,Stas Bekman,Olatunji Ruwase,Minjia Zhang

arxiv（2024）

引用0浏览0引用

A Hybrid Tensor-Expert-Data Parallelism Approach to Optimize Mixture-of-Experts Training

Siddharth Singh,Olatunji Ruwase,Ammar Ahmad Awan,Samyam Rajbhandari,Yuxiong He,Abhinav Bhatele

PROCEEDINGS OF THE 37TH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, ACM ICS 2023pp.203-214, (2023)

引用0浏览0EI引用

SHARP: an Adaptable, Energy-Efficient Accelerator for Recurrent Neural Networks

Reza Yazdani Aminabadi,Olatunji Ruwase,Minjia Zhang,Yuxiong He,Jose-Maria Arnau,Antonio Gonzalez

ACM Transactions on Embedded Computing Systems（2023）

引用17浏览0EI引用

加载更多

作者统计

合作学者

合作机构

D-Core

合作者
学生
导师

暂无相似学者，你可以通过学者研究领域进行搜索筛选

数据免责声明

页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果，我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问，可以通过电子邮件方式联系我们：report@aminer.cn

RSDE

论文共 48 篇作者统计合作学者相似作者