John Carmack (@ID_AA_Carmack) “Without getting all the way down to performance counters, GPU power from nvidia-” — TopicDigg
John Carmack
@ID_AA_Carmack
AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo Aerospace
加入 August 2010
285 正在关注 1.6M 粉丝
Without getting all the way down to performance counters, GPU power from nvidia-smi is a better indicator of true utilization than job scheduling or “gpu busy”. I would love to see animated “heat maps” of the big data centers, with each pixel being an individual GPU’s power draw.
I am confident that inference and frontier training at the big labs is highly efficient, but I wonder how many GPUs would be dark due to scheduling and inefficient research code.
With a little calibration for base load and peak, just the power bill for the datacenter would be a pretty good first order indicator of utilization.
显示更多
