Why Transformers? A Comprehensive Overview of Transformers in Artificial Intelligence for IT Operations

AIOps (Artificial Intelligence for IT Operations) has emerged as a key strategy for operating large-scale systems. Meanwhile, the Transformer architecture, renowned for its strong performance and potential, is driving advances in AIOps. However, prior reviews leave gaps in explaining why Transformers trigger a major shift in academia and industry, with limited coverage of multimodal data (logs, metrics, events), insufficient analysis of structural and methodological connections between Transformers and AIOps, fragmented views of capabilities, and a lack of consolidated evaluation strategies. To bridge these gaps, our work decomposes “Why Transformers” into three questions. First, we review what roles Transformers assume in AIOps across 70 representative papers, using a structured taxonomy that proceeds sequentially from data to targets, principles, and approaches, which present an evolutionary trajectory of role changes. Then, to explain why Transformers excel, we introduce a capability framework comprising two basic and four advanced capabilities. As for how to evaluate Transformers in AIOps, we consolidate evaluation resources and strategies, including offline datasets, standardized questions, and real-time simulations. Furthermore, probable best practices are distilled, offering actionable guidance for real-world adoption. These explorations aim to clarify the internal rationale and unlock the practical value of Transformers in AIOps.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Software Engineering and Methodology
Published
2026-08-31
DOI
https://doi.org/10.1145/3840387
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Why Transformers? A Comprehensive Overview of Transformers in Artificial Intelligence for IT Operations

Wenwei Gu, Yongqian Sun, Dan Pei, Shenglin Zhang et al.
ACM Transactions on Software Engineering and Methodology
Software System Performance and Reliability
article

Why Transformers? A Comprehensive Overview of Transformers in Artificial Intelligence for IT Operations

Wenwei Gu, Yongqian Sun, Dan Pei, Shenglin Zhang, Bowen Hao, Jingya Wang, Minyi Shao, Binpeng Shi, Sibo Xia, Y. Zhao, Yu Luo
article en

Abstract

AIOps (Artificial Intelligence for IT Operations) has emerged as a key strategy for operating large-scale systems. Meanwhile, the Transformer architecture, renowned for its strong performance and potential, is driving advances in AIOps. However, prior reviews leave gaps in explaining why Transformers trigger a major shift in academia and industry, with limited coverage of multimodal data (logs, metrics, events), insufficient analysis of structural and methodological connections between Transformers and AIOps, fragmented views of capabilities, and a lack of consolidated evaluation strategies. To bridge these gaps, our work decomposes “Why Transformers” into three questions. First, we review what roles Transformers assume in AIOps across 70 representative papers, using a structured taxonomy that proceeds sequentially from data to targets, principles, and approaches, which present an evolutionary trajectory of role changes. Then, to explain why Transformers excel, we introduce a capability framework comprising two basic and four advanced capabilities. As for how to evaluate Transformers in AIOps, we consolidate evaluation resources and strategies, including offline datasets, standardized questions, and real-time simulations. Furthermore, probable best practices are distilled, offering actionable guidance for real-world adoption. These explorations aim to clarify the internal rationale and unlock the practical value of Transformers in AIOps.

ACM Transactions on Software Engineering and Methodology
Nankai University (CN), Tsinghua University (CN)
Industry, innovation and infrastructure
Openalex Percentile: Top 8%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.