Autothrottle: Satisfying Network Performance Requirements for Containers

Kyungwoon Lee, Kwanhoon Lee, Hyunchan Park, Jaehyun Hwang, Chuck Yoo

Research output: Contribution to journalArticlepeer-review

Abstract

This paper investigates how to satisfy network performance requirements that are crucial in achieving the service level objectives (SLOs) in clouds. Traditional techniques for network performance management have a limited ability to satisfy the network SLOs. Our in-depth analysis reveals that the fundamental reason comes from decoupling of the CPU scheduler and the network traffic controller as the current CPU scheduler is not aware of such network requirements but only provides a fair-share amount of CPU to all containers. Thus, the container cannot perform the amount of network processing as needed to satisfy its SLO when the CPU allocation is insufficient. In this paper, we propose Autothrottle that dynamically adjusts the CPU allocation for the containers to satisfy their network SLOs. The key element of Autothrottle is a throttle algorithm that autonomously determines the amount of CPU for each container needed to satisfy the requirement. We implement Autothrottle in the Linux kernel and evaluate it with massive real-world workloads such as Apache Kafka. Our evaluation results show that Autothrottle successfully satisfies the given network SLO only with a 2% gap while the existing scheme achieves 20% less than the SLO. We further observe that Autothrottle also reduces the CPU overhead in network processing by 19%, improving the network throughput by 27% compared to the existing scheme.

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Cloud Computing
DOIs
Publication statusAccepted/In press - 2022

Keywords

  • Bandwidth
  • Bridges
  • Cloud computing
  • Cloud computing
  • containers
  • Containers
  • Linux
  • network performance
  • Resource management
  • service level objectives
  • Throughput

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Science Applications
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Autothrottle: Satisfying Network Performance Requirements for Containers'. Together they form a unique fingerprint.

Cite this