ADAPT: Attention-Driven Domain Adaptation for Inter-cluster Workload Forecasting in Cloud Data Centers

Nosin Ibna Mahbub, Afsana Kabir Sinthia, Mincheol Jeon, Junyoung Park, Eui Nam Huh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Cloud computing has recently gained popularity due to its cost-effective and high-quality services. Cloud-native systems are expected to host more than 95% of digital workloads. Cloud service providers face two significant challenges: real-time workload predictions and effective resource management. Furthermore, allocating resources over time may result in a suboptimal execution environment due to considerable increases and decreases in workload that follow time-dependent patterns. Recent breakthroughs in deep learning have garnered widespread favor for predicting extremely nonlinear cloud workloads; nevertheless, they have been unable to generalize inter cluster workload forecasting due to inadequate workload data at the beginning of each cluster. Furthermore, the distribution disparity across distinct cluster workloads is caused by a variety of elements, making it difficult to reuse current data or models directly. To overcome these challenges, we propose ADAPT, which relies on Attention-Driven Domain Adaptation. First, we use LSTM architecture as the backbone of our model. Moreover, we construct a strategically shared attention module to transmit relevant knowledge from the source domain to the target domain by inducing domain-invariant latent features and retraining domain-specific features. Lastly, adversarial training is used to increase the model’s resilience and predictive accuracy. Comprehensive experimental evaluations indicate that our proposed approach significantly outperforms existing baselines.

Original languageEnglish
Title of host publicationCLOUD Computing – CLOUD 2024 - 17th International Conference, Held as Part of the Services Conference Federation, SCF 2024, Proceedings
EditorsYang Wang, Liang-Jie Zhang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages56-68
Number of pages13
ISBN (Print)9783031771521
DOIs
Publication statusPublished - 2025
Event17th International Conference on Cloud Computing, CLOUD 2024, Held as Part of the Services Conference Federation, SCF 2024 - Bangkok, Thailand
Duration: 16 Nov 202419 Nov 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume15423 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference17th International Conference on Cloud Computing, CLOUD 2024, Held as Part of the Services Conference Federation, SCF 2024
Country/TerritoryThailand
CityBangkok
Period16/11/2419/11/24

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

Keywords

  • Cloud computing
  • Domain adaption
  • Workload prediction

Fingerprint

Dive into the research topics of 'ADAPT: Attention-Driven Domain Adaptation for Inter-cluster Workload Forecasting in Cloud Data Centers'. Together they form a unique fingerprint.

Cite this