Info Hub Distinguished Lecture - HPC, Data, and Knowledge in Scale: Some Fundamental and Practice in I/O Systems
Supporting the below United Nations Sustainable Development Goals:支持以下聯合國可持續發展目標：支持以下联合国可持续发展目标：
While deep learning’s success hinges on its ability to process vast amounts of data, computing systems struggle to keep up with this demand, leading to performance bottlenecks. Data access has become a killer bottleneck for high-performance computing (HPC) for AI, where AI itself can help mitigate this issue. In this talk, we explore the challenges posed by the knowledge-in-scale movement and discuss potential solutions from an I/O system perspective. We present our recent work at Illinois Tech’s Gnosis Research Center, starting from the Hermes multi-tiered I/O buffering system. Hermes optimizes data movement in deep memory hierarchy systems, benefiting both HPC for AI and AI for HPC. We then address broader data movement issues relevant to AI and big data applications. We conclude this talk by sharing examples of our I/O solutions tailored specifically for deep learning workloads.
Dr. Xian-He Sun is a University Distinguished Professor, the Ron Hochsprung Endowed Chair of Computer Science, and the director of the Gnosis Research Center for accelerating data-driven discovery at the Illinois Institute of Technology (Illinois Tech). Before joining Illinois Tech, he worked at DoE Ames National Laboratory, at ICASE, NASA Langley Research Center, at Louisiana State University, Baton Rouge, and was an ASEE fellow at Navy Research Laboratories. Dr. Sun is an IEEE fellow and is known for his memory-bounded speedup model, also called Sun-Ni’s Law, for scalable computing. His research interests include high-performance data processing, memory and I/O systems, and performance evaluation and optimization. He has over 350 publications and 7 patents in these areas and is currently leading multiple large software development projects in HPC I/O systems. Dr. Sun is the Editor-in-Chief of the IEEE Transactions on Parallel and Distributed Systems, and a former department chair of the Computer Science Department at Illinois Tech. He received the Golden Core award from IEEE CS society in 2017, the ACM Karsten Schwan Best Paper Award from ACM HPDC in 2019, the Ron Hocksprung Endowed Chair from Illinois Tech in 2020, and the first prize best paper award from ACM/IEEE CCGrid in 2021. More information about Dr. Sun can be found at his web site www.cs.iit.edu/~sun/.