Get the latest tech news
Load is not what you should balance: Introducing Prequal
Bartek Wydrowski, Google Research; Robert Kleinberg, Google Research and Cornell; Stephen M. Rumble, Google (YouTube); Aaron Archer, Google Research We present PReQuaL (Probing to Reduce Queuing and Latency), a load balancer for distributed multi-tenant systems.
@inproceedings {295611, author = {Bartek Wydrowski and Robert Kleinberg and Stephen M. Rumble and Aaron Archer}, title = {Load is not what you should balance: Introducing Prequal}, booktitle = {21st USENIX Symposium on Networked Systems Design and Implementation (NSDI 24)}, year = {2024}, isbn = {978-1-939133-39-7}, address = {Santa Clara, CA}, pages = {1285--1299}, url = {https://www.usenix.org/conference/nsdi24/presentation/wydrowski}, publisher = {USENIX Association}, month = apr } PReQuaL is designed to minimize real-time request latency in the presence of heterogeneous server capacities and non-uniform, time-varying antagonist load. PReQuaL has dramatically decreased tail latency, error rates, and resource use, enabling YouTube and other production systems at Google to run at much higher utilization.
Or read this on Hacker News
