Cooperative Distributed GPU Power Capping for Deep Learning Clusters

Cited 1 time in webofscience Cited 0 time in scopus
  • Hit : 95
  • Download : 0
network (DNN) models, and high computational complexity. Thus, the traditional power capping methods for CPU-based clusters or small-scale GPU devices do not apply to the GPU-based clusters handling DL tasks. This paper develops a cooperative distributed GPU power capping (CD-GPC) system for GPU-based clusters, aiming to minimize the training completion time of invoked DL tasks without exceeding the limited power budget. Specifically, we first design the frequency scaling (FS) approach using the online model estimation based on the recursive least square (RLS) method. This approach achieves the accurate tuning for DL task training time and power usage of GPU devices without needing offline profiling. Then, we formulate the proposed FS problem as a Lagrangian dual decomposition-based economic model predictive control (EMPC) problem for large-scale heterogeneous GPU clusters. We conduct both the NVIDIA GPU-based lab-scale real experiments and real job trace-based simulation experiments for performance evaluation. Experimental results validate that the proposed system improves the power capping accuracy to have a mean absolute error <1%, and reduces the deadline violation ratio of invoked DL tasks by 21.5% compared with other recent counterparts.
Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Issue Date
2022-07
Language
English
Citation

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, v.69, no.7, pp.7244 - 7254

ISSN
1557-9948
DOI
10.1109/TIE.2021.3095790
URI
http://hdl.handle.net/10203/292394
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 1 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0