GEO-WMS: an improved approach to geoscientific workflow management system on HPC

Jiaxu Guo,Yidan Xu,Haohuan Fu,Wei Xue,Lin Gan, Mengxuan Tan, Tingye Wu, Yutong Shen, Xianwei Wu,Liang Hu,Xilong Che

CCF TRANSACTIONS ON HIGH PERFORMANCE COMPUTING(2023)

引用 1|浏览1
暂无评分
摘要
With the increasing complexity of scientific computing, it is imperative to enhance the efficiency and ease of High Performance Computing (HPC) utilization. Scientific workflow is introduced to that aim, but the current infrastructure still needs optimization. In this paper, we discuss the current problems based on scientific computing scenarios and design a more user-friendly workflow system solution targeting HPC services. In the proposed solution, we introduce a structured method to describe the workflow and employ a more user-friendly interface for scientific workflows to bring a better experience than traditional command line approaches. We have integrated a variety of methods to enhance the user experience during geoscience experiments. Data analytics are being used to make more intelligent recommendations to users. Runtime predictions help users to better plan their schedules for research. The statistics of the testing period and user feedback show that the proposed workflow management system can effectively save the operating time and complexity of the scientists, while saving computing resources. Our proposed system has a variety of advantageous features, including the ease of use, uniform specification with scalability, improved utilization of computing resources, and exemplary significance.
更多
查看译文
关键词
HPC,Scientific workflow,Numerical simulation,Regression analysis
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要