Supporting Data Compression in PnetCDF

Kaiyuan Hou,Qiao Kang,Sunwoo Lee,Ankit Agrawal,Alok Choudhary,Wei-keng Liao

2021 IEEE International Conference on Big Data (Big Data)（2021）

引用 1|浏览6

暂无评分

摘要

Recently, the dramatic increase of the data amounts drives up the demand for data compression among HPC applications. Although many file systems and I/O middlewares have incorporated compression features, few high-level parallel I/O libraries support data compression due to the challenges of achieving scalable performance on HPC systems. This paper presents the design and implementation of the var...

查看译文

关键词

File systems,Scalability,Layout,Data compression,Big Data,Libraries,Supercomputers

AI 理解论文

溯源树

样例

生成溯源树，研究论文发展脉络

Chat Paper

正在生成论文摘要