Performance optimization of machine learning inference under latency and server power constraints
G Chen, X Wang - 2022 IEEE 42nd International Conference on …, 2022 - ieeexplore.ieee.org
Power capping is an important technique for high-density servers to safely oversubscribe the
power infrastructure in a data center. However, power capping is commonly accomplished …
power infrastructure in a data center. However, power capping is commonly accomplished …
OptimML: Joint Control of Inference Latency and Server Power Consumption for ML Performance Optimization
G Chen, X Wang - ACM Transactions on Autonomous and Adaptive …, 2024 - dl.acm.org
Power capping is an important technique for high-density servers to safely oversubscribe the
power infrastructure in a data center. However, power capping is commonly accomplished …
power infrastructure in a data center. However, power capping is commonly accomplished …
A reinforcement learning approach for performance-aware reduction in power consumption of data center compute nodes
As Exascale computing becomes a reality, the energy needs of compute nodes in cloud data
centers will continue to grow. A common approach to reducing this energy demand is to limit …
centers will continue to grow. A common approach to reducing this energy demand is to limit …
ALPACA: Application performance aware server power capping
Server power capping limits the power consumption of a server to not exceed a specific
power budget. This allows data center operators to reduce the peak power consumption at …
power budget. This allows data center operators to reduce the peak power consumption at …
Pack & cap: adaptive dvfs and thread packing under power caps
The ability to cap peak power consumption is a desirable feature in modern data centers for
energy budgeting, cost management, and efficient power delivery. Dynamic voltage and …
energy budgeting, cost management, and efficient power delivery. Dynamic voltage and …
A scalable priority-aware approach to managing data center server power
Y Li, CR Lefurgy, K Rajamani… - … Symposium on High …, 2019 - ieeexplore.ieee.org
Power management is a key component of modern data center design. Power managers
must (1) ensure the costand energy-efficient utilization of the data center infrastructure,(2) …
must (1) ensure the costand energy-efficient utilization of the data center infrastructure,(2) …
Network packet processing mode-aware power management for data center servers
In data center servers, power management (PM) exploiting Dynamic Voltage and Frequency
Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However …
Scaling (DVFS) for processors can play a crucial role to improve energy efficiency. However …
Nmap: Power management based on network packet processing mode transition for latency-critical workloads
Processor power management exploiting Dynamic Voltage and Frequency Scaling (DVFS)
plays a crucial role in improving the data-center's energy efficiency. However, we observe …
plays a crucial role in improving the data-center's energy efficiency. However, we observe …
DeepPower: Deep Reinforcement Learning based Power Management for Latency Critical Applications in Multi-core Systems
Latency-critical (LC) applications are widely deployed in modern datacenters. Effective
power management for LC applications can yield significant cost savings. However, it poses …
power management for LC applications can yield significant cost savings. However, it poses …
Adaptive power management through thermal aware workload balancing in internet data centers
J Yao, H Guan, J Luo, L Rao… - IEEE Transactions on …, 2014 - ieeexplore.ieee.org
The past decade witnessed the tremendous growth of online services and applications.
Together with the increase of cloud computing, more and more computation are hosted by …
Together with the increase of cloud computing, more and more computation are hosted by …