Hpc

TL;DR: Slingshot Interconnect An In-Depth Analysis of the Slingshot Interconnect describes SLINGSHOT, an interconnection network for large scale computing systems, including its architecture and experiments on congestion control and QoS. In this post I share my digests of this paper. Introduction HPL and HPCG are two commonly used benchmarks to assess supercomputing systems. HPCG is typically characterized by ~50x lower performance compared to HPL, partly due to the higher communication intensity of HPCG. ...

Building a Lustre Filesystem on a Mini PC Introduction Lustre is a high-performance parallel filesystem used in many of the world’s largest supercomputers, but you don’t need a million-dollar HPC cluster to learn how it works. In this post, I’ll walk through setting up a functional Lustre filesystem using nothing more than a mini PC running Proxmox VE in my homelab. While this setup won’t handle production workloads, it’s perfect for understanding Lustre’s architecture and getting hands-on experience with its components. ...

TL;DR: Lustre Unveiled (3): Architecture Details and Comparative Study Lustre Unveiled: Evolution, Design, Advancements, and Current Trends provides a comprehensive journey of Lustre, including its history and evolution, detailed archtiecture and design elements, comparison with other prominent storage technologies, case study of Lustre on a real-world supercomputer and the future development of Lustre. In this post I share my digests of this journal’s section about design drinciples and key features. ...

TL;DR: Lustre Unveiled (2): Design Principles and Key Features Lustre Unveiled: Evolution, Design, Advancements, and Current Trends provides a comprehensive journey of Lustre, including its history and evolution, detailed archtiecture and design elements, comparison with other prominent storage technologies, case study of Lustre on a real-world supercomputer and the future development of Lustre. In this post I share my digests of this journal’s section about design drinciples and key features. ...

TL;DR: Lustre Unveiled (1): The Lustre File System Lustre Unveiled: Evolution, Design, Advancements, and Current Trends provides a comprehensive journey of Lustre, including its history and evolution, detailed archtiecture and design elements, comparison with other prominent storage technologies, case study of Lustre on a real-world supercomputer and the future development of Lustre. In this post I share my digests of this journal’s section about Lustre filesystem introduction. Introduction The name “Lustre” is a fusion of “Linux” and “cluster”, signifying its development as a storage architecture tailored for cluster environment. ...