Reducing Waste in Extreme Scale Systems through Introspective Analysis
2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS)(2016)
摘要
Resilience is an important challenge for extreme-scale supercomputers. Today, failures in supercomputers are assumed to be uniformly distributed in time. However, recent studies show that failures in high-performance computing systems are partially correlated in time, generating periods of higher failure density. Our study of the failure logs of multiple supercomputers show that periods of higher failure density occur with up to three times more than the average. We design a monitoring system that listens to hardware events and forwards important events to the runtime to detect those regime changes. We implement a runtime capable of receiving notifications and adapt dynamically. In addition, we build an analytical model to predict the gains that such dynamic approach could achieve. We demonstrate that in some systems, our approach can reduce the wasted time by over 30%.
更多查看译文
关键词
Supercomputers,Fault Tolerance,Resilience,Silent Data Corruption,Soft Errors,Introspective Systems
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络