Chopin: Combining distributed and centralized schedulers for self-adjusting datacenter networks

Neta Rozen-Schiff, Klaus-Tycho Foerster, Stefan Schmid, David Hay
26th International Conference on Principles of Distributed Systems (OPODIS 2022),
2022
Conferences & Workshops
Cloud, Distributed Computing

Abstract

The performance of distributed and data-centric applications often critically depends on the interconnecting network. Emerging reconfigurable datacenter networks (RDCNs) are a particularly innovative approach to improve datacenter throughput. Relying on a dynamic optical topology which can be adjusted towards the workload in a demand-aware manner, RDCNs allow to exploit temporal and spatial locality in the communication pattern, and to provide topological shortcuts for frequently communicating racks. The key challenge, however, concerns how to realize demand-awareness in RDCNs in a scalable fashion.

@InProceedings{rozenschiff_et_al:LIPIcs.OPODIS.2022.25,
  author ={Rozen-Schiff, Neta and Foerster, Klaus-Tycho and Schmid, Stefan and Hay, David},
  title ={{Chopin: Combining Distributed and Centralized Schedulers for Self-Adjusting Datacenter Networks}},
  booktitle ={26th International Conference on Principles of Distributed Systems (OPODIS 2022)},
  pages ={25:1--25:23},
  series ={Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN ={978-3-95977-265-5},
  ISSN ={1868-8969},
  year ={2023},
  volume ={253},
  editor ={Hillel, Eshcar and Palmieri, Roberto and Rivi\`{e}re, Etienne},
  publisher ={Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address ={Dagstuhl, Germany},
  URL ={https://drops.dagstuhl.de/opus/volltexte/2023/17645},
  URN ={urn:nbn:de:0030-drops-176457},
  doi ={10.4230/LIPIcs.OPODIS.2022.25},
  annote ={Keywords: reconfigurable optical networks, centralized scheduler, distributed scheduler}
}