Data Centre Optimisation – Scalable Infrastructure for Big Data

In data centres, efficient initial task placement, and continuous monitoring and migration, is key to maximising resource utilisation, and to minimise task response time.



Task placement and migration must consider both machine resources and application dependencies in order to be efficient. This project develops  architectures and mechanisms for providing data-center scalability as a below-layer-4 service. Our tools span from developing multi-objective linear programming models for optimizing task migration, to innovative use of Segment Routing for network-level load balancing.

2023

Cordero, Juan Antonio

On the Dynamics of Single-Orbit Requester-Provider Systems Conference

Proc. 26th ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM'2023), ACM, 2023.

Abstract | Links | BibTeX

2022

Yao, Zhiyuan; Desmouceaux, Yoann; Cordero, Juan Antonio; Townsley, Mark; Clausen, Thomas Heide

Aquarius-Enable Fast, Scalable, Data-Driven Service Management in the Cloud Journal Article

In: IEEE Transactions on Network and Service Management, 2022, ISSN: 1932-4537.

Abstract | Links | BibTeX

Yao, Zhiyuan; Ding, Zihan

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potentia Game Proceedings Article

In: 36th Conference on Neural Information Processing Systems (NeurIPS 2022), 2022.

Abstract | Links | BibTeX

Yao, Zhiyuan; Desmouceaux, Yoann; Cordero, Juan Antonio; Townsley, Mark; Clausen, Thomas Heide

Efficient Data-Driven Network Functions Proceedings Article

In: 30th International Symposium on the Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2022), 2022.

Abstract | Links | BibTeX

Yao, Zhiyuan; Ding, Zihan; Clausen, Thomas Heide

Multi-agent reinforcement learning for network load balancing in data center Proceedings Article

In: 31st ACM International Conference on Information and Knowledge Management (CIKM'22), 2022.

Abstract | Links | BibTeX

Yao, Zhiyuan; Desmouceaux, Yoann; Cordero, Juan Antonio; Clausen, Thomas Heide

HLB: Towards Load-Aware Load-Balancing Journal Article

In: IEEE/ACM Transactions on Networking, 2022, ISSN: 1558-2566.

Abstract | Links | BibTeX

2021

Yao, Zhiyuan; Ding, Zihan; Clausen, Thomas Heide

Reinforced Workload Distribution Fairness Proceedings Article

In: Machine Learning for Systems at 35th Conference on Neural Information Processing Systems (NeurIPS 2021), 2021.

Abstract | Links | BibTeX

Yao, Zhiyuan; Desmouceaux, Yoann; Townsley, Mark; Clausen, Thomas Heide

Towards Intelligent Load Balancing in Data Centers Proceedings Article

In: Machine Learning for Systems at 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Dec 2021, Sydney, Australia, 2021.

Abstract | Links | BibTeX

Rizzi, Carmine; Yao, Zhiyuan; Desmouceaux, Yoann; Townsley, Mark; Clausen, Thomas Heide

Charon: Load-Aware Load-Balancing in P4 Proceedings Article

In: 1st Joint International Workshop on Network Programmability & Automation (NetPA) at 17th International Conference on Network and Service Management (CNSM 2021),, 2021.

Abstract | Links | BibTeX

Hawari, Mohammed; Clausen, Thomas

OP4T: Bringing Advanced Network Packet Timestamping into the Field Proceedings Article

In: 2021 International Conference on Information Networking (ICOIN), pp. 137-142, 2021.

Abstract | Links | BibTeX

2020

Hawari, Mohammed; Cordero, Juan Antonio; Clausen, Thomas

High-Accuracy Packet Pacing on Commodity Servers for Constant-Rate Flows Journal Article

In: IEEE/ACM Transactions on Networking, pp. 1-15, 2020, ISSN: 1558-2566.

Abstract | Links | BibTeX

2018

Desmouceaux, Yoann; Toubaline, Sonia; Clausen, Thomas

Flow-Aware Workload Migration in Data Centers Journal Article

In: Springer - Journal of Network and Systems Management (JONS), 2018.

Abstract | Links | BibTeX

Desmouceaux, Yoann; Pfister, Pierre; Tollet, Jérôme; Townsley, W. Mark; Clausen, Thomas

6LB: Scalable and Application-Aware Load Balancing with Segment Routing Journal Article

In: IEEE/ACM Transactions on Networking, vol. 26, no. 2, pp. 819-834, 2018, ISSN: 1063-6692.

Abstract | Links | BibTeX

2017

Desmouceaux, Yoann; Pfister, Pierre; Tollet, Jerome; Townsley, W. Mark; Clausen, Thomas

SRLB: The Power of Choices in Load Balancing with Segment Routing Proceedings Article

In: In Proceedings of the 37th IEEE International Conference on Distributed Computing Systems (ICDCS), 2017.

Abstract | Links | BibTeX