Python Code Parallelization, Challenges and Alternatives

Justo Gonzalez, Julian Taylor,Sandra Castro,Jeff Kern, Jens Knudstrup, Stefano Zampieri, Alisdair Manning,Sanjay Bhatnagar,Lindsey Davis,Kumar Golap, Jim Jacobs, Takeshi Nakazato, Dirk Petry,Martin Pokorny, Urvashi Rao,James Robnett,Darrell Schiebel,Kanako Sugimoto,Takahiro Tsutsumi,Akeem Wells,Stewart J. Williams

Astronomical Society of the Pacific Conference Series(2019)

引用 0|浏览3
暂无评分
摘要
In the last few years the development of Python code for science and data reduction purposes has gained significant popularity. ESO itself uses a Python-based archiving system for VLT and ALMA data. Also the data reduction suite for ALMA data is python-based. Rapid development is fostered by a big community and a wide range of already available packages. However Python enforces locking mechanisms, to ensure thread safety, that effectively reduce the capacity of Python to use only one core. In this context a number of alternatives have been developed by the community to emulate actual multi-threading and make parallel processing easier to use from Python, preserving interactivity.
更多
查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要