Perfomalist

Perfomalist (www.Perfomalist.com) is a web based anomaly and change point detection tool. The method used by the tool is SETDS - Statistical Exception and Trend Detection System, which is a variation of the Statistical Process Control method applied to time series data. The key idea of the method is EV (Exception Value) which indicates the severity of anomalies calculated as a difference between control limits and actual anomalous data points. Any change that occurs first would appear as an anomaly and then may become a normality (new norm), so collecting overtime and analyzing the severity of all anomalies opens the possibility to find phases in the data history with different patterns. To detect change points between phases one just needs to find all the roots of the following equation:  EV(t)=0 , where t is time. [1]. Using this method the Perfomalist API call returns all change points found in the input CSV data.

[1] - Igor Trubin, "Exception Based Modeling and Forecasting" , 34th International Computer Measurement Group Conference, December 7-12, 2008, Las Vegas, Nevada, USA, Proceedings

Interesting case of Perfomalist usage

 

Dynamics of Anomalies or Phases in a Dynamic Object Life

The Change Points Detection Perfomalist API beta version is released. Everybody is welcome to test!

Link to tool: www.Perfomalist.com

Control Points API

POST https://api.perfomalist.com/api/controlpoints.py

'Accept: text/plain'
'Content-Type: text/csv'

Input

Post body should be input data in CSV format. First three lines are parameters also in CSV format.

• sValue - Statistical band in %, where 100 is UCL=MAX, 0 is UCL=LCL=mean).
• eValue - Exception Value (EV) threshold in % of actual historical average.
• BaseLineLength - The time period to compare current value against.

For example:

sValue, 99
eValue, 5
BaseLineLength , 7

These may be omitted in which case default values will be used.

Parameters are followed by data as shown in example input which could downloaded from www.Perfomalist.com. 

Date, Hour, Value 

7/2/2011,0,236274 

7/2/2011,1,215359 

7/2/2011,2,170011

....

Input data should be provided as a body of the API call.

Output

Output is JSON style data:

{
    "Change Point": {            #full list of values for respective dates, populated by zeroes if no change point detected to aid with graphing
         "Date": value
    },
    "Change Points Only": {      #only dates of change points with respective values
        "Change Point": {
            "Date": value
        }
    },
    "Ev": {                      #exeption values for respective dates
        "Date": value
    },
    "LCL": {                     #lower control limit value for respective dates
        "Date": value
    },
    "Moving Average": {          #moving average value for respective dates
        "Date": value
    },
    "UCL": {                     #upper control limit value for respective dates
        "Date": value
    },
    "Value": {                   #user input value for respective dates
        "Date": value
    }
}

EXAMPLE 1 is applied against the sample data from www.Performalist.com by
using Postman tool:

After copying data to a spreadsheet, the control points could be validated visually:



EXAMLE 2: With a a some step jump event to detect:

Original Change Point Detection method explained here:
http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html

The next step is to build Perfomalist CPD UI.

Peformalist tool demo: uncover patterns and anomalies in the hourly stamped data using #controlChart

Visit our free tool here: https://www.Perfomalist.com/

 

CPD - Change Points Detection is planed to be implemented in the free web tool Perfomalist. UPDATE: API is developed!

update : 11/21/21 The Perfomalist CPD API is released.

https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html 

_____________

See details: http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html

The "Exercise 5. Build your weekly IT-Control Chart by Perfomalist tool" was added to my on-line CMG class "Perfomaly Detection"

As more trainees keep enrolling to my CMG on-line class, 

I have started updating the content.

So far I have added an additional exercise to use recently developed free performance profiler web tool "https://www.perfomalist.com/". So the trainees can build the weekly IT-Control Chart with the provided sample data and with their own data.

The exercise is open for every one here:

 https://www.cmg.org/2020/06/performance-anomaly-detection/

Perfomalist tool users activity report

From Google Analytics

#AnomalyDetection Free Web App "PERFOMALIST" (v1.0) is online and ready for beta testing

Welcome to PERFOMALIST v1.0 - date-time-stamped data on-line analyser  https://www.perfomalist.com/

Functionality: 

1. VISUALIZATION. Weekly (Monthly in v2+) data profiling to visualize patterns, anomalies and short term seasonality via IT-Control Charts. (v1.0)

2. ANALYSIS. Anomalies and Change Points Detection in date-time stamped data. (v2+)

Method: SPC/MASF based Statistical Exception and Trend Detection (SETDS).

INPUT: CSV file with timestamp data (time series observations of a dynamic object). 

Sample input data can be downloaded from from the Download Input Data Sample (https://www.perfomalist.com/sample-upload.csv)

which should look like:

Data granularity: hourly (v1.0); minutely, daily (v2+)

OUTPUT:

- IT-Control Chart (see example below)  (v1.0)

- Data cube with  summarized data (168 rows/weekhours - v1.0)

- List of anomalies and change points (v2+)

Requirement: 

Input data should consist of at least 3 weeks of history as the method requires comparing the last 7 days of data (actual) with at least 2 weeks long learning/reference data set (baseline). 

The size of the history is limited by about 5 years. Unlimited size of input data will be implemented in v.2.

Additional resources:

- How to read IT-Control Chart (on-line article)

- On-line class "Performance Anomaly Detection"

Project contributors:
- Anfisa Trubina 

My "Performance #AnomalyDetection" Online Course is Launched at CMG.org (#CMGnews)

• Link to the course is on CMG.org site 
• $99 for CMG Members; $149 for Non-Members. 

What is covered:

• Machine learning based Anomaly Detection technique
• Classical (SPC) and MASF (For system performance data) Control Chartirting
• Where is the Control Chart Used?
• What are the types of Control Charts?
• Reading, building, and interpreting Control Charts
• Typical cases of real world issues captured by anomaly detection system (VMs, Mainframes, Middleware, E2E response and more)
• How to build free AWS cloud server with R and build there control charts
• Performance anomaly (Perfomaly) detection system R implementation example (SEDS-lite - open source based tool)

See more:

Performance #AnomalyDetection Online Course is Launched

My YT "iTrubin" generates more than $1 a day having ~ 2K views a day and ~1.2K subs. SUBSCRIBE!

testing earn.com....

Earn.com for businesses If you’re a sender and want to learn more about how you can use Earn.com to increase your response rates and get more actionable user and customer feedback, contact us: sales@earn.com