Backend
Collecting Infrastructure-Level Measures for Energy Analysis in Modern Computing Infrastructures
arXiv cs.DC0 views
arXiv:2611.22160v1 Announce Type: new Abstract: Modern HPC facilities are complex environments in which all components are tightly coupled; consequently, precisely modeling and accounting for energy consumption requires approaches that go beyond instrumenting individual compute nodes. Aiming for a cluster-wide vision, we designed a scalable data collection pipeline that aggregates fine-grained measurements from multiple subsystems-spanning component loads, software and hardware counters, sensors and energy-ensuring consistent sampling frequencies and synchronized data acquisition across the infrastructure. We present a dataset of comprehensive metrics collected at 1 Hz over one month from a production research data center supporting heterogeneous workloads, including HPC, Kubernetes services, and distributed storage. To illustrate what this approach makes possible in practice, we analyze two case studies-distributed I/O and large-language-model inference-showing how cluster-wide measurement reveals system-level dynamics missed by localized instrumentation. The proposed dataset and collection methodology provide a foundation for future work on predictive modeling, energy-aware resource management, and more efficient computing infrastructures.
Source:https://arxiv.org/abs/2611.22160PreviousWho Says What: Symbolic Trimodal Binding Mechanisms in Audio-Visual LLMsNextTAILROLL: Tail-Aware Rollout Acceleration for RL-Based LLM Post-Training
Related posts
glasp v0.5.3 Released: config init / Safer File Sync / Signature Verification on Install
0dev.to GitHub
Public Claude Code Settings Files With Secrets, One Week After Apiiro's Report
0dev.to GitHub

Two SARIMA models, one clear winner: picking with AIC value
0dev.to Challenge

Kling Image 4.0 Review: 8K Photos, Long Text and Image Sets, Tested
0dev.to Design
Running Out of Room? 7 Smart Home Improvements That Create More Living Space Without Moving
0dev.to Design
5 California App Development Companies and the Technical Questions to As
0dev.to Discuss