Excited to share that we will be presenting at the ICPE 2026 Workshop (WEPPE) on May 4th in Florence, Italy.
Our talk, "Detecting past and future change points in performance data for education and practice", focuses on practical approaches to identifying performance anomalies and change points—both retrospectively and predictively.The presentation will also cover the core principles behind the Perfomalist app (www.perfomalist.com), demonstrating how these methods can be applied in real-world IT capacity management and performance analysis scenarios.
Looking forward to engaging discussions with researchers and practitioners in performance engineering!
ABSTRACT:
Typical tasks in performance engineering education and
practice include anomaly detection, outlier detection, change
point detection, and trend analysis, with the goal of anticipating
future threshold breaches and capacity risks. This paper
presents Statistical Exception and Trend Detection (SETDS), a
method for detecting both past and future change points in
performance time series and discusses its use as both an
analytical technique and a teaching tool.
The paper provides an intuitive yet rigorous description of the
SETDS method and demonstrates its practical application
through Perfomalist, a free web-based tool that implements the
approach. Perfomalist enables students and practitioners to
visualize anomalies, trends, and change points using IT Control
Charts and Exception Values, making advanced concepts in
performance analysis more accessible. Perfomalist was also
used as a baseline tool in a CMG.org Hackathon, where
participants were tasked with identifying change points and
anomalies in time-stamped performance data to reveal distinct
phases and patterns. Finally, the method and tool have been
successfully used in an online course on Performance Anomaly
Detection offered through CMG.org, illustrating how real-world
performance data and tooling can be effectively integrated into
performance engineering education.
No comments:
Post a Comment