tag:blogger.com,1999:blog-45571331804382055062024-02-06T22:14:43.304-08:00TruTech Development, LLCTruTech Development, LLCIgor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.comBlogger41125tag:blogger.com,1999:blog-4557133180438205506.post-81483065673445865952023-01-11T08:04:00.005-08:002023-01-11T08:06:26.899-08:00Perfomalist team is presenting at www.CMGimpact.com international conference in Orlando. <p></p><div class="separator" style="clear: both; text-align: center;"><span style="background-color: white; color: #64686d; font-family: OpenSansRegular; font-size: 14px; text-align: left;">PRODUCT:</span><a href="http://www.Perfomalist.com" style="font-family: OpenSansRegular; font-size: 14px; text-align: left;" target="_blank"> www.Perfomalist.com</a></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEgN5HZwabXzGU-NFcTpg0rLXYwgDB_xdvm4g7xoW5Bw2HJ2oo9yVpXKkyIx-AQFfouCj9F9ABhNRU3rzrvpZ3MGsdU7Yp7gVHMxnF56V46WYuO_k_gPIniWYTgsiqfVc8ZcKHacWTBRqDTgIRxC_0OeRQ2JTU_77bXv7bYx7qX7TkMvxq3SMB1PNCA1hA" style="margin-left: 1em; margin-right: 1em;"><img alt="" data-original-height="720" data-original-width="1280" height="225" src="https://blogger.googleusercontent.com/img/a/AVvXsEgN5HZwabXzGU-NFcTpg0rLXYwgDB_xdvm4g7xoW5Bw2HJ2oo9yVpXKkyIx-AQFfouCj9F9ABhNRU3rzrvpZ3MGsdU7Yp7gVHMxnF56V46WYuO_k_gPIniWYTgsiqfVc8ZcKHacWTBRqDTgIRxC_0OeRQ2JTU_77bXv7bYx7qX7TkMvxq3SMB1PNCA1hA=w400-h225" width="400" /></a></div><br /><a class="app-aware-link" data-test-app-aware-link="" href="http://www.CMGimpact.com" style="background-color: white; border: var(--artdeco-reset-link-border-zero); box-sizing: inherit; font-family: -apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif; font-size: 16px; font-weight: var(--font-weight-bold); line-height: inherit; margin: var(--artdeco-reset-base-margin-zero); padding: var(--artdeco-reset-base-padding-zero); touch-action: manipulation; vertical-align: var(--artdeco-reset-base-vertical-align-baseline);">www.CMGimpact.com</a><p></p><p><a class="app-aware-link" data-test-app-aware-link="" href="https://www.linkedin.com/events/7018611358225047553/" style="background-color: white; border: var(--artdeco-reset-link-border-zero); box-sizing: inherit; font-family: -apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif; font-size: 16px; font-weight: var(--font-weight-bold); line-height: inherit; margin: var(--artdeco-reset-base-margin-zero); padding: var(--artdeco-reset-base-padding-zero); text-decoration: var(--artdeco-reset-link-text-decoration-underline); touch-action: manipulation; vertical-align: var(--artdeco-reset-base-vertical-align-baseline);">LinkedIn Post</a></p><p style="background-color: white; box-sizing: border-box; color: #64686d; font-family: OpenSansRegular; font-size: 14px; margin: 0px; overflow-wrap: break-word;">ABSTRACT: The MASF/SETDS method of detecting changes and anomalies in performance data, its recent implementation and the way to use and interpret the results will be presented with real examples against MangoDB testing data.</p><p style="background-color: white; box-sizing: border-box; color: #64686d; font-family: OpenSansRegular; font-size: 14px; margin: 0px; overflow-wrap: break-word;"> </p><p style="background-color: white; box-sizing: border-box; color: #64686d; font-family: OpenSansRegular; font-size: 14px; margin: 0px; overflow-wrap: break-word;">Since 1995, a time when the CMG conference published a very influential paper about the MASF method of anomaly detection, this topic has been increasingly more popular in the area of Capacity and Performance management. The modification of the MASF – SETDS method – was introduced in the 2002 CMG best paper and then got implemented in several companies and applications. This included the CMG online class “Perfomalies (Performance Anomaly) Detection”. Most recently this method has been turned into the cloud based serverless API microservice which is available for free via “Perfomalist” web app. The Perfomalist change points detection API was used against MongoDB’s testing data and got acceptable results which were published in the SPEC.org 2022 conference. This paper included an additional post-processing algorithm (XGBoost) to eliminate false positives which is planned to be added to Perfomalist service.</p><p style="background-color: white; box-sizing: border-box; color: #64686d; font-family: OpenSansRegular; font-size: 14px; margin: 0px; overflow-wrap: break-word;"><br /></p>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-9930260742462394952022-11-06T19:56:00.002-08:002022-11-06T20:18:39.309-08:00The paper about using #Perfomalist "Change Point Detection for #MongoDB Time Series Performance Regression" was cited...<p><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-size: 14px;">The paper about using </span><a data-attribute-index="0" href="http://www.perfomalist.com" style="background-color: white; border: var(--artdeco-reset-link-border-zero); box-sizing: inherit; font-family: -apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif; font-size: 14px; font-weight: var(--font-weight-bold); line-height: inherit; margin: var(--artdeco-reset-base-margin-zero); overflow-wrap: normal; padding: var(--artdeco-reset-base-padding-zero); position: relative; text-decoration: var(--artdeco-reset-link-text-decoration-none); touch-action: manipulation; vertical-align: var(--artdeco-reset-base-vertical-align-baseline); word-break: normal;" target="_blank">#Perfomalist</a><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-size: 14px;"> "<a href="Change Point Detection for MongoDB Time Series Performance Regression">Change Point Detection for </a></span><span face="-apple-system, system-ui, BlinkMacSystemFont, Segoe UI, Roboto, Helvetica Neue, Fira Sans, Ubuntu, Oxygen, Oxygen Sans, Cantarell, Droid Sans, Apple Color Emoji, Segoe UI Emoji, Segoe UI Emoji, Segoe UI Symbol, Lucida Grande, Helvetica, Arial, sans-serif"><span style="background-color: white; border: var(--artdeco-reset-link-border-zero); box-sizing: inherit; font-size: 14px; font-weight: var(--font-weight-bold); line-height: inherit; margin: var(--artdeco-reset-base-margin-zero); overflow-wrap: normal; padding: var(--artdeco-reset-base-padding-zero); position: relative; touch-action: manipulation; vertical-align: var(--artdeco-reset-base-vertical-align-baseline);"><a href="Change Point Detection for MongoDB Time Series Performance Regression">#MongoDB</a></span></span><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-size: 14px;"><a href="Change Point Detection for MongoDB Time Series Performance Regression"> Time Series Performance Regression</a>" was cited in the following paper: "<a href="https://www.semanticscholar.org/paper/Estimating-Breakpoints-in-Piecewise-Linear-Using-Onder-De%C4%9Firmenci/f25c24020c8329100e658d885ed9e3072fa17d4e">Estimating Breakpoints in Piecewise Linear Regression Using </a></span><span face="-apple-system, system-ui, BlinkMacSystemFont, Segoe UI, Roboto, Helvetica Neue, Fira Sans, Ubuntu, Oxygen, Oxygen Sans, Cantarell, Droid Sans, Apple Color Emoji, Segoe UI Emoji, Segoe UI Emoji, Segoe UI Symbol, Lucida Grande, Helvetica, Arial, sans-serif"><span style="background-color: white; border: var(--artdeco-reset-link-border-zero); box-sizing: inherit; font-size: 14px; font-weight: var(--font-weight-bold); line-height: inherit; margin: var(--artdeco-reset-base-margin-zero); overflow-wrap: normal; padding: var(--artdeco-reset-base-padding-zero); position: relative; touch-action: manipulation; vertical-align: var(--artdeco-reset-base-vertical-align-baseline);"><a href="https://www.semanticscholar.org/paper/Estimating-Breakpoints-in-Piecewise-Linear-Using-Onder-De%C4%9Firmenci/f25c24020c8329100e658d885ed9e3072fa17d4e">#MachineLearning</a></span></span><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-size: 14px;"><a href="https://www.semanticscholar.org/paper/Estimating-Breakpoints-in-Piecewise-Linear-Using-Onder-De%C4%9Firmenci/f25c24020c8329100e658d885ed9e3072fa17d4e"> Methods</a>", where our method was mentioned as " … offer a hybrid change point detection system..." </span></p><p><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-size: 14px;"></span></p><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEhDBuxxAHObPYW0uT9IvZlkpHf9H0lHoIJsdYyxVkagPGwfHeg2EjNLHIf_6KazEDRplXs62oGSfH1viL4vO-5rRmz6UP-ND_d6nR55RPrpl5rSdbQZpgFADjxHU0M9K3O8O6S9hv4RGLIalPs_dTe_5I6SSxcc7AkVH1hZH7qJq9LI1cbl5PPhsZNmqw" style="margin-left: 1em; margin-right: 1em;"><img alt="" data-original-height="862" data-original-width="832" height="640" src="https://blogger.googleusercontent.com/img/a/AVvXsEhDBuxxAHObPYW0uT9IvZlkpHf9H0lHoIJsdYyxVkagPGwfHeg2EjNLHIf_6KazEDRplXs62oGSfH1viL4vO-5rRmz6UP-ND_d6nR55RPrpl5rSdbQZpgFADjxHU0M9K3O8O6S9hv4RGLIalPs_dTe_5I6SSxcc7AkVH1hZH7qJq9LI1cbl5PPhsZNmqw=w619-h640" width="619" /></a></div><br /><br /><p></p>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-42970972224345957652022-04-12T20:52:00.003-07:002022-04-12T20:55:09.664-07:00#ChangeDetection for #MongoDB Time Series Performance Regression (#Perfomalist API usage example)<iframe width="560" height="315" src="https://www.youtube.com/embed/PO1xIkOHv7M" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-18025857864041479342022-03-04T08:23:00.004-08:002022-03-04T08:24:58.759-08:00Perfomalist #ChangeDetection API was used against #MongoDB #perfomanceTesting dataset<p style="text-align: justify;"><span style="font-family: inherit;">We are participating in the data challenge for <a href="https://icpe2022.spec.org/tracks-and-submissions/data-challenge-track/">icpe2022.spec.org</a> conference.</span></p><p><span style="font-family: inherit;"><span style="background-color: white; text-align: justify;">The </span><a href="https://doi.org/10.5281/zenodo.5138516" style="background-color: #1e6289; color: white; text-align: justify; text-decoration-line: none;">challenge dataset</a><span style="background-color: white; text-align: justify;"> is provided by MongoDB.</span></span></p><p style="text-align: justify;"><span style="font-family: inherit;"><span style="text-align: left;">Initially</span><span style="background-color: white;"> some small part of the data was used to prove that <a href="http://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html" target="_blank"><b>Perfomalist CPD </b>API</a> can be used. </span></span></p><p style="text-align: justify;"><span style="font-family: inherit;"><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">Data looks like a big data cube with numerous dimensional variables and two factual ones (datetime and value). I took one case with a particular slice of this cube and processed that (datetime-value) by calling the </span><a class="c-link" data-remove-tab-index="true" data-sk="tooltip_parent" data-stringify-link="https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html" delay="150" href="https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html" rel="noopener noreferrer" style="background-color: #f8f8f8; box-sizing: inherit; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left; text-decoration-line: none;" tabindex="-1" target="_blank"><b>Perfomalist API</b></a><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">. The result I have plotted using Excel and can be seen in the following picture.</span></span><span face="Slack-Lato, Slack-Fractions, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"> </span></p><p style="text-align: justify;"><span face="Slack-Lato, Slack-Fractions, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"><br /></span></p><p style="text-align: justify;"></p><div style="text-align: left;"><span face="Slack-Lato, Slack-Fractions, appleLogo, sans-serif" style="color: #1d1c1d;"><span style="font-size: 15px; font-variant-ligatures: common-ligatures;"><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEimG6eJwqXO1QWaDn3aLwFsWDOd0cKttRW3mlMDyIhZFDM7lxvs2CWqRULwK5do5HiTMO3zzyA-Eseaks72q-W7jLkv2BWwoR-RzKK1wRhYiYfi6fI8uFUN63RZ32EWsdsMNAQyrd9o7IT-8eXCvyLmHssux5fDLYQeiwy-ftE-g-WOMyRpJQcck2KAQQ" style="margin-left: 1em; margin-right: 1em;"><img alt="" data-original-height="661" data-original-width="1320" height="320" src="https://blogger.googleusercontent.com/img/a/AVvXsEimG6eJwqXO1QWaDn3aLwFsWDOd0cKttRW3mlMDyIhZFDM7lxvs2CWqRULwK5do5HiTMO3zzyA-Eseaks72q-W7jLkv2BWwoR-RzKK1wRhYiYfi6fI8uFUN63RZ32EWsdsMNAQyrd9o7IT-8eXCvyLmHssux5fDLYQeiwy-ftE-g-WOMyRpJQcck2KAQQ=w640-h320" width="640" /></a></div><br /><br /></span></span></div><span class="c-mrkdwn__br" data-stringify-type="paragraph-break" face="Slack-Lato, Slack-Fractions, appleLogo, sans-serif" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; display: block; font-size: 15px; font-variant-ligatures: common-ligatures; height: 8px; text-align: left;"></span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"><span style="font-family: inherit;">IDEA: Potentially some program could be developed to call the CPD API (i.e., <b><a href="http://www.perfomalist.com" target="_blank">Perfomalist</a></b>) for every data cube slice and to collect change points in a separate table like in the 2nd picture below:</span></span><p></p><p style="text-align: justify;"><span style="font-family: inherit;"><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"></span></span></p><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEj8-tcGsW_GiSjOSmjRrtSRiV56sty1b_ziozBbQK7eooN-IyQEznxf5m3sJ6gQqevGOwMR2JY7T2wozGmQNQU6NcziSVAg9H69-DRZ3ZkYIJKQrv4SAquHatE36OHAy4Jy66QRhecXAOesMFSuVX0aH2WBshh9gEqWPBkSFUlOr-8Cm1xIP6yhevSjww" style="margin-left: 1em; margin-right: 1em;"><span style="font-family: inherit;"><img alt="" data-original-height="367" data-original-width="646" height="182" src="https://blogger.googleusercontent.com/img/a/AVvXsEj8-tcGsW_GiSjOSmjRrtSRiV56sty1b_ziozBbQK7eooN-IyQEznxf5m3sJ6gQqevGOwMR2JY7T2wozGmQNQU6NcziSVAg9H69-DRZ3ZkYIJKQrv4SAquHatE36OHAy4Jy66QRhecXAOesMFSuVX0aH2WBshh9gEqWPBkSFUlOr-8Cm1xIP6yhevSjww" width="320" /></span></a></div><span style="font-family: inherit;"><br /></span><p style="text-align: justify;"><span style="font-family: inherit;"><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">That (meta-) data then should be correlated with events happening (or not happening) around any change dates detected, e.g., feature flag tuned on/off (that data is hidden from us so far). The result should help to explain each change. Additionally, to measure the magnitude of the change I would suggest calculating the entropy based imbalance of the data between changes (</span><a class="c-link" data-remove-tab-index="true" data-sk="tooltip_parent" data-stringify-link="https://www.researchgate.net/publication/353584064_Performance_Anomaly_and_Change_Point_Detection_For_Large-Scale_System_Management_for_WorldS4_2021" delay="150" href="https://www.researchgate.net/publication/353584064_Performance_Anomaly_and_Change_Point_Detection_For_Large-Scale_System_Management_for_WorldS4_2021" rel="noopener noreferrer" style="background-color: #f8f8f8; box-sizing: inherit; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left; text-decoration-line: none;" tabindex="-1" target="_blank">see my last paper how to do that</a><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">). For example, that could tell how stable or not stable performance had become after particular change. </span></span></p><p style="text-align: justify;"><span style="font-family: inherit;"><span style="background-color: #f8f8f8; text-align: left;"><span style="color: #1d1c1d;"><span style="font-size: 15px; font-variant-ligatures: common-ligatures;">After my 1st initial </span><b style="font-size: 15px; font-variant-ligatures: common-ligatures;">Peorfomalist </b><span style="font-size: 15px; font-variant-ligatures: common-ligatures;">usage, more rigorous usage was done against </span></span></span><span style="font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"><span style="color: #1d1c1d;">MongoDB dataset</span></span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">, based on which the following paper was </span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">written</span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;"> and accepted for data challenge track of the </span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">conference</span><span style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures; text-align: left;">:</span></span></p><h3 class="post-title entry-title" itemprop="name" style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; font-weight: normal; line-height: normal; margin: 0px; position: relative;"><a href="https://www.trub.in/2022/02/change-point-detection-changedetection.html" target="_blank">"Change Point Detection for MongoDB Time Series Performance Regression" paper for ACM/SPEC ICPE 2022 Data Challenge Track</a></h3><p style="text-align: justify;"><span style="background-color: #f8f8f8; text-align: left;"><span face="Slack-Lato, Slack-Fractions, appleLogo, sans-serif" style="color: #1d1c1d;"><span style="font-size: 15px; font-variant-ligatures: common-ligatures;"><br /></span></span></span></p>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-29324486241882519842022-02-28T13:25:00.000-08:002022-02-28T13:25:00.039-08:00The paper about Perfomalist #ChangeDetection API is accepted for ACM/SPEC ICPE 2022 Data Challenge Track<p><span style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px;"><a href="https://www.trub.in/2022/02/change-point-detection-changedetection.html ">"Change Point Detection (#ChangeDetection) for MongoDB Time Series Performance Regression" paper for ACM/SPEC ICPE 2022 Data Challenge Track</a></span></p><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/a/AVvXsEjClbJ3uJnhmXYHFG_aeAjnSNvORSuFWU-dmtxWfgr9RGHAz7joIdVNGEGPsdsPKFULRrn8CrnueJxzqE9aXe1GILidSE5DPwPMUvBeyWIhhSacueQWKUvm7JSms9X1RsMqdLKPFwdxB6FX7qeKXvrPGFt8_QW_5geCprekhCwyfRiHqArO-z4LSImM=s400" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="148" data-original-width="400" height="118" src="https://blogger.googleusercontent.com/img/a/AVvXsEjClbJ3uJnhmXYHFG_aeAjnSNvORSuFWU-dmtxWfgr9RGHAz7joIdVNGEGPsdsPKFULRrn8CrnueJxzqE9aXe1GILidSE5DPwPMUvBeyWIhhSacueQWKUvm7JSms9X1RsMqdLKPFwdxB6FX7qeKXvrPGFt8_QW_5geCprekhCwyfRiHqArO-z4LSImM=s320" width="320" /></a></div><br /><p><br /></p><p><br /></p><p><br /></p>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-6767377258037586952022-01-10T14:58:00.012-08:002022-06-30T10:37:48.872-07:00Perfomalist Release Notes<h3 style="text-align: left;"><b>- Perfomalist 1.1</b>. <span style="font-weight: normal;">has now the Change Point Detection API as described in the previous post:</span></h3><div><span style="font-weight: normal;"><br /></span></div><h3 class="post-title entry-title" itemprop="name" style="background-color: white; color: #444444; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; line-height: normal; margin: 0px; position: relative;"><span style="font-size: x-small;"><a href="https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html">The Change Points Detection Perfomalist API beta version is released. </a></span></h3><div><br /></div><div>Contributors: <span style="font-size: x-small;"> <b><a href="https://www.linkedin.com/in/arvid-trubin-15b2a060/">Arvid Trubin</a>, <span><h1 class="text-heading-xlarge inline t-24 v-align-middle break-words" style="--artdeco-reset-typography_getfontsize: 2.4rem; --artdeco-reset-typography_getlineheight: 1.33333; border: var(--artdeco-reset-base-border-zero); box-sizing: inherit; color: var(--color-text); display: inline; font-size: var(--font-size-xlarge); font-weight: var(--font-weight-bold); line-height: var(--line-height-default); margin: var(--artdeco-reset-base-margin-zero); outline: var(--artdeco-reset-base-outline-zero); overflow-wrap: break-word; padding: var(--artdeco-reset-base-padding-zero); vertical-align: middle; word-break: break-word;"><a href="https://www.linkedin.com/in/philip-trubin/">Filipp Trubin</a></h1> </span><span class="distance-badge t-black--light t-14 t-black--light pv-text-details__separator text-body-small v-align-middle" color="inherit" style="--artdeco-reset-typography_getfontsize: 1.4rem; --artdeco-reset-typography_getlineheight: 1.42857; border: var(--artdeco-reset-base-border-zero); box-sizing: inherit; font-weight: var(--font-weight-regular); line-height: var(--line-height-default); margin: var(--artdeco-reset-base-margin-zero); outline: var(--artdeco-reset-base-outline-zero); padding: var(--artdeco-reset-base-padding-zero); position: relative; vertical-align: middle;"><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white;"> </span></span></b></span></div><div><b><br /></b></div><h3 style="text-align: left;"><b>- Perfomalist 1.2.</b> <span style="font-size: small;"><span style="font-weight: normal;">has additional two columns in the table view of the weekly profile to </span><span style="font-weight: 400;">underline</span><span style="font-weight: normal;"> two types of anomalies the tool detects: </span></span></h3><div><span style="font-size: small;"><span style="font-weight: normal;"><br /></span></span></div><div><b> High Anomaly </b>- Unusual high data value for particular hour calculated as <i style="font-weight: bold;">Actual - UCL95 </i>(only positive values of the subtraction is populated and represents EV+ which is Exception Value/significance of the anomaly) </div><div><i><b><br /></b></i></div><div><b><span> </span>Low Anomaly </b>- Unusual low data value for particular hour calculated as <b style="font-style: italic;">UCL5 - Actual</b> (only positive values of the subtraction is populated and represents EV- which is Exception Value /significance of the anomaly) </div><div><br /></div><div>If the value of Low or/and High Anomaly is "0" the particular hour does not have any anomalies. </div><div>The number of anomalous week hours also counted and printed at the header of the columns in "()".</div><div><br /></div><div>Contributor: <span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-weight: 600;"><span style="font-size: x-small;"><a href="https://www.linkedin.com/in/michael-berdichevsky/">Michael Berdichevsky</a></span></span></div><div><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-weight: 600;"><br /></span></div><div><span color="rgba(0, 0, 0, 0.9)" face="-apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", "Fira Sans", Ubuntu, Oxygen, "Oxygen Sans", Cantarell, "Droid Sans", "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Emoji", "Segoe UI Symbol", "Lucida Grande", Helvetica, Arial, sans-serif" style="background-color: white; font-weight: 600;"><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEibSXpONcdNs1sby7cN5gy0QC-_MX4XZDjIoUBSjl8tdy4ozbROU4eqReHLqpQNesZKsfxspPWcGODtHbKpRQ_hkLC-8oodA0z6DU4DpKNUgogvu_XFHnjQd7VX8bnB9jZtXMM2E_HDsLCn/" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img alt="" data-original-height="826" data-original-width="1057" height="313" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEibSXpONcdNs1sby7cN5gy0QC-_MX4XZDjIoUBSjl8tdy4ozbROU4eqReHLqpQNesZKsfxspPWcGODtHbKpRQ_hkLC-8oodA0z6DU4DpKNUgogvu_XFHnjQd7VX8bnB9jZtXMM2E_HDsLCn/w400-h313/image.png" width="400" /></a></div><br /><br /></span></div>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-46411725690528199182022-01-06T08:16:00.001-08:002022-01-06T08:16:47.891-08:00Perfomalist is referenced in the following published at Springler paper:<p>LINK to paper: <a href="https://www.trub.in/2022/01/performance-anomaly-and-change-point.html" target="_blank">https://www.trub.in/2022/01/performance-anomaly-and-change-point.html </a></p><div class="separator" style="background-color: #fefdfa; clear: both; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 13px; text-align: center;"><a href="https://media.springernature.com/w306/springer-static/cover/book/978-981-16-6369-7.jpg" imageanchor="1" style="color: #d52a33; margin-left: 1em; margin-right: 1em; text-decoration-line: none;"><img border="0" data-original-height="464" data-original-width="306" height="464" src="https://media.springernature.com/w306/springer-static/cover/book/978-981-16-6369-7.jpg" style="background: rgb(255, 255, 255); border-radius: 5px; border: 1px solid rgb(204, 204, 204); box-shadow: rgba(0, 0, 0, 0.2) 0px 0px 20px; padding: 8px; position: relative;" width="306" /></a></div><p><br style="background-color: #fefdfa; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 13px;" /><span class="BookTitle" style="background-color: #fcfcfc; box-sizing: border-box; color: #333333; font-family: "Source Sans Pro", Helvetica, Arial, sans-serif; font-size: 1.4rem; letter-spacing: 0.017em;"><a data-track-action="Book title" data-track-label="" data-track="click" href="https://link.springer.com/book/10.1007/978-981-16-6369-7" style="background-color: initial; box-sizing: border-box; color: #004aa7; text-decoration-line: none;">Intelligent Sustainable Systems</a></span><span class="page-numbers-info" style="background-color: #fcfcfc; box-sizing: border-box; color: #333333; font-family: "Source Sans Pro", Helvetica, Arial, sans-serif; font-size: 1.4rem; letter-spacing: 0.017em;"> pp 403-407</span><span class="u-inline-block u-ml-4" style="background-color: #fcfcfc; box-sizing: border-box; color: #333333; display: inline-block; font-family: "Source Sans Pro", Helvetica, Arial, sans-serif; font-size: 1.4rem; letter-spacing: 0.017em; margin-left: 4px !important;">| <a data-track-action="Cite as link" data-track-label="Enumeration section" data-track="click" href="https://link.springer.com/chapter/10.1007%2F978-981-16-6369-7_36#citeas" style="background-color: initial; box-sizing: border-box; color: #004aa7; text-decoration-line: none;">Cite as</a></span></p><p style="background-color: #fefdfa; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 13px;"></p><div class="ArticleHeader main-context" style="background-color: #fcfcfc; box-sizing: border-box; color: #333333; font-family: "Source Sans Pro", Helvetica, Arial, sans-serif; font-size: 1.4rem; letter-spacing: 0.017em; line-height: 1.4; margin-bottom: 36px; zoom: 1;"><div class="MainTitleSection" style="box-sizing: border-box; font-family: Georgia, serif; margin: 0px 0px 24px; overflow-wrap: break-word; word-break: break-word;"><h1 class="ChapterTitle" lang="en" style="box-sizing: border-box; font-size: 2.8rem; font-weight: 400; letter-spacing: 0.008em; line-height: 1.3; margin: 0px 0px 8px; position: relative;">Performance Anomaly and Change Point Detection for Large-Scale System Management</h1></div></div>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-72551821222752783102021-12-22T21:04:00.003-08:002021-12-22T21:23:57.251-08:00Perfomalist<p><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;">Perfomalist (</span><a class="c-link" data-remove-tab-index="true" data-sk="tooltip_parent" data-stringify-link="http://www.Perfomalist.com" delay="150" href="http://www.perfomalist.com/" rel="noopener noreferrer" style="background-color: #f8f8f8; box-sizing: inherit; font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures; text-decoration-line: none;" tabindex="-1" target="_blank">www.Perfomalist.com</a><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;">) is a web based anomaly and change point detection tool. The method used by the tool is SETDS - Statistical Exception and Trend Detection System, which is a variation of the Statistical Process Control method applied to time series data. The key idea of the method is EV (Exception Value) which indicates the severity of anomalies calculated as a difference between control limits and actual anomalous data points. Any change that occurs first would appear as an anomaly and then may become a normality (new norm), so collecting overtime and analyzing the severity of all anomalies opens the possibility to find phases in the data history with different patterns. To detect change points between phases one just needs to find all the roots of the following equation: </span><b data-stringify-type="bold" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures;">EV(t)=0 </b><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;">, where </span><b data-stringify-type="bold" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures;">t</b><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;"> is time.</span><b data-stringify-type="bold" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures;"> </b><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;">[1]</span><b data-stringify-type="bold" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures;">. </b><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;">Using this method the Perfomalist API call returns all change points found in the input CSV data.</span></p><span class="c-mrkdwn__br" data-stringify-type="paragraph-break" face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; box-sizing: inherit; color: #1d1c1d; display: block; font-size: 15px; font-variant-ligatures: common-ligatures; height: 8px;"></span><span face="Slack-Lato, appleLogo, sans-serif" style="background-color: #f8f8f8; color: #1d1c1d; font-size: 15px; font-variant-ligatures: common-ligatures;"><a href="https://www.researchgate.net/publication/221447683_Exception_Based_Modeling_and_Forecasting">[1] - Igor Trubin, "Exception Based Modeling and Forecasting" , 34th International Computer Measurement Group Conference, December 7-12, 2008, Las Vegas, Nevada, USA, Proceedings</a></span><div><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://www.perfomalist.com/itchart.png" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="381" data-original-width="800" height="381" src="https://www.perfomalist.com/itchart.png" width="800" /></a></div><div><br /></div><br /><div><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVWsZTCISW9Hk_LDhosl-5x0FCGpTwu7qXcG5FAjF2Piblf4VYJA_h3TiKqTa5VmvKn-y2bWPRz2n5gjsFPA4kDwit_Q-Jc4QEJS_uijyZRoBFSvzc8dM1uWyRfRGX5KH7t0NzDA-hMDXG/s512/image.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="481" data-original-width="512" height="602" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVWsZTCISW9Hk_LDhosl-5x0FCGpTwu7qXcG5FAjF2Piblf4VYJA_h3TiKqTa5VmvKn-y2bWPRz2n5gjsFPA4kDwit_Q-Jc4QEJS_uijyZRoBFSvzc8dM1uWyRfRGX5KH7t0NzDA-hMDXG/w640-h602/image.png" width="640" /></a></div><br />Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-73309926147464245702021-12-02T10:56:00.001-08:002021-12-02T10:56:30.611-08:00Interesting case of Perfomalist usage<p> </p><h3 class="post-title entry-title" itemprop="name" style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; font-weight: normal; line-height: normal; margin: 0px; position: relative;"><a href="https://www.trub.in/2021/12/dynamics-of-anomalies-or-phases-of.html">Dynamics of Anomalies or Phases in a Dynamic Object Life</a></h3><div><br /></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjmkKGOEAQ-xiDQp5PVxbgEgf7d-HYvKyRdVEShz01q1ERTCsRGc01fzdvkrSrVE_GGBQmYIli_zy2i_8Fg3_a7ks_Bo9je8thrPSgcgGoZT2VVWcMcK9tPsPTQuz2-LexEyoSvYKxSEwU/s512/image.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="198" data-original-width="512" height="248" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjmkKGOEAQ-xiDQp5PVxbgEgf7d-HYvKyRdVEShz01q1ERTCsRGc01fzdvkrSrVE_GGBQmYIli_zy2i_8Fg3_a7ks_Bo9je8thrPSgcgGoZT2VVWcMcK9tPsPTQuz2-LexEyoSvYKxSEwU/w640-h248/image.png" width="640" /></a></div><br /><div><br /></div>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-60698776190934632332021-11-21T10:54:00.013-08:002022-02-07T08:45:40.952-08:00The Change Points Detection Perfomalist API beta version is released. Everybody is welcome to test!<p><span face="-apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"" style="color: #24292f; font-size: 1.25em;">Link to tool: <a href="http://www.Perfomalist.com">www.Perfomalist.com</a></span></p><p><b style="color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 1.25em;">Control Points API</b></p><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;"><code style="background-color: var(--color-neutral-muted); border-radius: 6px; box-sizing: border-box; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; margin: 0px; padding: 0.2em 0.4em;">POST</code> <b>https://api.perfomalist.com/<wbr></wbr>api/controlpoints.py<span face="Inter, OpenSans, Helvetica, Arial, sans-serif" style="color: #212121; font-size: 12px; white-space: pre-wrap;"> </span></b></p><div class="snippet-clipboard-content position-relative overflow-auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; overflow: auto; position: relative;"><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><code style="background: transparent; border-radius: 6px; border: 0px; box-sizing: border-box; display: inline; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;">'Accept: text/plain'
'Content-Type: text/csv'</code></pre><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><h3 dir="auto" style="box-sizing: border-box; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 1.25em; line-height: 1.25; margin-bottom: 16px; margin-top: 0px; white-space: normal;">Input</h3></pre></div><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;">Post body should be input data in CSV format. First three lines are parameters also in CSV format.</p><ul dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; margin-bottom: 16px; margin-top: 0px; padding-left: 2em;"><li style="box-sizing: border-box;"><b>sValue </b>- <span style="font-size: x-small;">Statistical band in %, where 100 is UCL=MAX, 0 is UCL=LCL=mean).</span></li><li style="box-sizing: border-box; margin-top: 0.25em;"><span><b>eValue </b></span><span style="font-size: 16px;">- </span><span style="font-size: x-small;">Exception Value (EV) threshold in % of actual historical average.</span></li><li style="box-sizing: border-box; margin-top: 0.25em;"><span style="font-size: 16px;"><b>BaseLineLength </b>- </span><span style="font-size: x-small;">The time period to compare current value against.</span></li></ul><div class="snippet-clipboard-content position-relative overflow-auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; overflow: auto; position: relative;"><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><code style="background: transparent; border-radius: 6px; border: 0px; box-sizing: border-box; display: inline; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;">For example:</code></pre><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><code style="background: transparent; border-radius: 6px; border: 0px; box-sizing: border-box; display: inline; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;">sValue, 99
eValue, 5
<span face="-apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"" style="font-size: 16px; white-space: normal;">BaseLineLength</span><b style="font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; white-space: normal;"> </b>, 7
</code></pre></div><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;">These may be omitted in which case default values will be used.</p><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;">Parameters are followed by data as shown in example input which could downloaded from <a href="http://www.Perfomalist.com">www.Perfomalist.com</a>. </p><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;"><br /></p><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;">Date, Hour, Value </div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;"><br />7/2/2011,0,236274 </div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;">7/2/2011,1,215359 </div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;">7/2/2011,2,170011</div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;">....</div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;"><br /></div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; overflow: auto; position: relative;">Input data should be provided as a <b>body of the API call.</b><br /><pre style="border-radius: 6px; box-sizing: border-box; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><h3 dir="auto" style="box-sizing: border-box; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 1.25em; line-height: 1.25; margin-bottom: 16px; margin-top: 0px; white-space: normal;">Output</h3></pre></div><p dir="auto" style="background-color: white; box-sizing: border-box; color: #24292f; font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 16px; margin-bottom: 16px; margin-top: 0px;">Output is JSON style data:</p><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; margin-bottom: 0px; overflow: auto; position: relative;"><pre style="background-color: white; border-radius: 6px; box-sizing: border-box; color: #24292f; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><code style="background: transparent; border-radius: 6px; border: 0px; box-sizing: border-box; display: inline; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;">{
"Change Point": { #full list of values for respective dates, populated by zeroes if no change point detected to aid with graphing
"Date": value
},
"Change Points Only": { #only dates of change points with respective values
"Change Point": {
"Date": value
}
},
"Ev": { #exeption values for respective dates
"Date": value
},
"LCL": { #lower control limit value for respective dates
"Date": value
},
"Moving Average": { #moving average value for respective dates
"Date": value
},
"UCL": { #upper control limit value for respective dates
"Date": value
},
"Value": { #user input value for respective dates
"Date": value
}
}</code></pre><b>EXAMPLE 1 is applied against the sample data from www.Performalist.com by <br />using Postman tool:</b><br /><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><div class="separator" style="background: transparent; border-radius: 6px; border: 0px; box-sizing: border-box; clear: both; color: #24292f; display: inline; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEikQ1-POiHrMWItCZPaYnhCatOFEdKfxVwbUOXE8e4u_j3atYrzLRmqP7T85lbmkniCCXtCezn_yhSaNpmAMwC1ZxFBMG0smHlw6QDB-0MBr_3fnZO5Rj1u2J9YWZDw_oG_KedpJ_V5MZZp/" style="margin-left: 1em; margin-right: 1em;"><img alt="" data-original-height="964" data-original-width="430" height="964" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEikQ1-POiHrMWItCZPaYnhCatOFEdKfxVwbUOXE8e4u_j3atYrzLRmqP7T85lbmkniCCXtCezn_yhSaNpmAMwC1ZxFBMG0smHlw6QDB-0MBr_3fnZO5Rj1u2J9YWZDw_oG_KedpJ_V5MZZp/w443-h964/image.png" width="443" /></a></div></pre><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><div class="separator" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border-radius: 6px; border: 0px; box-sizing: border-box; clear: both; display: inline; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; text-align: left; word-break: normal;"><div class="separator" style="clear: both;"><br /></div><div class="separator" style="clear: both;">After copying data to a spreadsheet, the control points could be validated visually:</div><div class="separator" style="clear: both;"><br /><code><div class="separator" style="background-color: transparent; clear: both; color: #24292f; font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; font-weight: bold; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh8YiJUXjafHrpZaZ_EPfsLlm1zq6REukvEiPZZrcn4AP5hA-23yn0Ju3SjtgGk7DvdeRol10uEWwQDFtqei-d3CgZijxt7faZkRpHYbs8rxJjDpzvsveCnNwlsbNr6hbC3PK1yQXucvGcj/" style="margin-left: 1em; margin-right: 1em;"><img alt="" data-original-height="731" data-original-width="846" height="553" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh8YiJUXjafHrpZaZ_EPfsLlm1zq6REukvEiPZZrcn4AP5hA-23yn0Ju3SjtgGk7DvdeRol10uEWwQDFtqei-d3CgZijxt7faZkRpHYbs8rxJjDpzvsveCnNwlsbNr6hbC3PK1yQXucvGcj/w640-h553/image.png" width="640" /></a></div><span face="ui-monospace, SFMono-Regular, SF Mono, Menlo, Consolas, Liberation Mono, monospace" style="color: #24292f;"><span style="font-size: 13.6px;"><b><br /><br /></b></span></span></code></div></div><div class="separator" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border-radius: 6px; border: 0px; box-sizing: border-box; clear: both; display: inline; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; text-align: left; word-break: normal;"><pre style="background-color: var(--color-canvas-subtle); border-radius: 6px; box-sizing: border-box; line-height: 1.45; margin-bottom: 16px; margin-top: 0px; overflow-wrap: normal; overflow: auto; padding: 16px;"><div class="separator" style="background-attachment: initial; background-clip: initial; background-image: initial; background-origin: initial; background-position: initial; background-repeat: initial; background-size: initial; border-radius: 6px; border: 0px; box-sizing: border-box; clear: both; display: inline; line-height: inherit; margin: 0px; overflow-wrap: normal; overflow: visible; padding: 0px; word-break: normal;"><b>EXAMLE 2: With a a some step jump event to detect:</b></div></pre><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVWsZTCISW9Hk_LDhosl-5x0FCGpTwu7qXcG5FAjF2Piblf4VYJA_h3TiKqTa5VmvKn-y2bWPRz2n5gjsFPA4kDwit_Q-Jc4QEJS_uijyZRoBFSvzc8dM1uWyRfRGX5KH7t0NzDA-hMDXG/" style="font-family: ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 13.6px; font-weight: bold; margin-left: 1em; margin-right: 1em; text-align: center;"><img alt="" data-original-height="612" data-original-width="651" height="587" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjVWsZTCISW9Hk_LDhosl-5x0FCGpTwu7qXcG5FAjF2Piblf4VYJA_h3TiKqTa5VmvKn-y2bWPRz2n5gjsFPA4kDwit_Q-Jc4QEJS_uijyZRoBFSvzc8dM1uWyRfRGX5KH7t0NzDA-hMDXG/w624-h587/image.png" width="624" /></a></div></pre>Original Change Point Detection method explained here: <br /><a href="http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html">http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html</a></div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; margin-bottom: 0px; overflow: auto; position: relative;"><br /></div><div class="snippet-clipboard-content position-relative overflow-auto" style="box-sizing: border-box; margin-bottom: 0px; overflow: auto; position: relative;">The next step is to build Perfomalist CPD UI.</div>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-44682832173603966882021-04-03T17:21:00.007-07:002021-08-09T13:51:10.667-07:00Peformalist tool demo: uncover patterns and anomalies in the hourly stamped data using #controlChart<span style="font-size: large;"><b><a href="https://www.perfomalist.com/">Visit our free tool here:</a></b> <a href="https://www.Perfomalist.com/" target="_blank"> https://www.<b>Perfomalist</b>.com/</a></span><a href="https://www.Perfomalist.com/" target="_blank">
</a><p> </p><iframe allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen="" frameborder="0" height="315" src="https://www.youtube.com/embed/Xu-xgfORllA" title="YouTube video player" width="560"></iframe>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-9620543245484318512020-08-22T18:11:00.004-07:002021-11-21T11:36:52.836-08:00CPD - Change Points Detection is planed to be implemented in the free web tool Perfomalist. UPDATE: API is developed!<p><b>update : 11/21/21 The Perfomalist CPD API is released.</b></p><p><a href="https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html">https://www.trutechdev.com/2021/11/the-change-points-detection-perfomalapi.html </a></p><p>_____________</p><p>See details: <a href="http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html">http://www.trub.in/2020/08/cpd-change-points-detection-is-planed.html</a></p><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhuveMw3VFzcQ_ek1NLlDU_mh7qzG4hgedUX9AGU1rcJmGm-oP9SPuy97OKOnizRHMH58T9rfbLAELnAiHQq2zUuveTLyHaVeKGUIS8oMTcqlKXCxjho-fgG9rnroMi2gAE_7Cscg-f9Oy9/s1337/CPDpyTEST.PNG" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1018" data-original-width="1337" height="390" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhuveMw3VFzcQ_ek1NLlDU_mh7qzG4hgedUX9AGU1rcJmGm-oP9SPuy97OKOnizRHMH58T9rfbLAELnAiHQq2zUuveTLyHaVeKGUIS8oMTcqlKXCxjho-fgG9rnroMi2gAE_7Cscg-f9Oy9/w512-h390/CPDpyTEST.PNG" width="512" /></a></div><p><br /></p>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-75597913423358409062020-06-08T10:41:00.002-07:002021-06-30T15:34:03.056-07:00The "Exercise 5. Build your weekly IT-Control Chart by Perfomalist tool" was added to my on-line CMG class "Perfomaly Detection"<h3 class="post-title entry-title" itemprop="name" style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; font-weight: normal; line-height: normal; margin: 0px; position: relative;"><span face="Arial, Tahoma, Helvetica, FreeSans, sans-serif" style="color: #333333; font-size: 13px;">As more trainees keep enrolling to my CMG on-line class, </span></h3><h3 class="post-title entry-title" itemprop="name" style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; font-weight: normal; line-height: normal; margin: 0px; position: relative;"><span face="Arial, Tahoma, Helvetica, FreeSans, sans-serif" style="color: #333333; font-size: 13px;">I have started updating the content.</span></h3><div class="post-body entry-content" id="post-body-3924997982476911923" itemprop="description articleBody" style="background-color: #fefdfa; color: #333333; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; line-height: 1.4; position: relative; width: 586px;"><div style="font-size: 13px;"><br /></div><div style="font-size: 13px;">So far I have added an additional exercise to use recently developed free performance profiler web tool "<a href="https://www.perfomalist.com/" style="background: 0px 0px rgb(255, 255, 255); box-sizing: inherit; color: #09a522; font-family: SourceSansPro; font-size: 17px; text-decoration-line: none;" target="_blank">https://www.perfomalist.com/</a>". So the trainees can build the weekly IT-Control Chart with the provided sample data and with their own data.</div><div style="font-size: 13px;"><br /></div><div><span style="font-size: 13px;">The exercise is open for every one </span><a href="https://cmg1.teachable.com/courses/perfomaly_detection/lectures/17731726" style="color: #7d181e; font-size: 13px; text-decoration-line: none;" target="_blank">here:</a></div><div><a href="https://cmg1.teachable.com/courses/perfomaly_detection/lectures/17731726" style="color: #7d181e; font-size: 13px; text-decoration-line: none;" target="_blank"> </a><a data-saferedirecturl="https://www.google.com/url?q=https://www.cmg.org/2020/06/performance-anomaly-detection/&source=gmail&ust=1625178372722000&usg=AFQjCNFZCbV9iULCZrjkp_LMMh4ZMnKmuw" href="https://www.cmg.org/2020/06/performance-anomaly-detection/" style="color: #1155cc; font-family: Arial, Helvetica, sans-serif;" target="_blank"><span style="font-size: x-small;">https://www.cmg.org/2020/06</span><b><span style="font-size: medium;">/<wbr></wbr>performance-anomaly-detection</span></b><span style="font-size: x-small;">/</span></a></div><div class="separator" style="clear: both; text-align: center;"><a href="https://www.cmg.org/wp-content/uploads/2020/06/perfmoly-480x360.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="360" data-original-width="480" src="https://www.cmg.org/wp-content/uploads/2020/06/perfmoly-480x360.png" /></a></div><br /><div style="font-size: 13px;"><br /></div></div>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-34499070926182359102020-04-14T13:17:00.002-07:002020-04-14T13:18:15.665-07:00Perfomalist tool users activity report<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEir4vVyqMWZ0Uxg02GefgjyZZMOpbY2lGYMPW5LUshmGJOMSaMke7Z6oxmvPpIrPvREhMfN2G3MdzZw9cm5rBMpT6cFf1oKrVSbkpk2WNOn-vDHSAlphgw95r-noYFgv3hEqZ-3nYuI0bhl/s1600/Perfomalist+activity.PNG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="370" data-original-width="632" height="233" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEir4vVyqMWZ0Uxg02GefgjyZZMOpbY2lGYMPW5LUshmGJOMSaMke7Z6oxmvPpIrPvREhMfN2G3MdzZw9cm5rBMpT6cFf1oKrVSbkpk2WNOn-vDHSAlphgw95r-noYFgv3hEqZ-3nYuI0bhl/s400/Perfomalist+activity.PNG" width="400" /></a></div>
From Google Analytics</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-25268637490389942692020-02-03T21:46:00.003-08:002020-06-06T12:00:17.860-07:00#AnomalyDetection Free Web App "PERFOMALIST" (v1.0) is online and ready for beta testing<div dir="ltr" style="text-align: left;" trbidi="on">
<br />
<span style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: x-small;">Welcome to </span><b style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;"><a href="https://perfomalist.com/">PERFOMALIST v1.0</a> </b><span style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: x-small;">-</span><b style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;"> </b><span style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: x-small;">date-time-stamped data on-line analyser </span><a href="https://www.perfomalist.com/">https://www.perfomalist.com/</a><br />
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<b><br /></b>
<br />
<div>
<b><u>Functionality</u>: </b></div>
<div>
1. VISUALIZATION. Weekly (Monthly in <b>v2+</b>) data profiling to visualize patterns, anomalies and short term seasonality via <b>IT-Control Charts</b>. (<b>v1.0</b>)</div>
<div>
2. ANALYSIS. Anomalies and Change Points Detection in date-time stamped data. (<b>v2+</b>)</div>
<div>
<br />
<b><u>Method</u>:</b> <a href="http://www.trub.in/2012/11/setds-methodology-cmg12-speech.html" style="color: #1155cc;" target="_blank">SPC/MASF based Statistical Exception and Trend Detection (SETDS)</a>.<br />
<br /></div>
</div>
<div style="color: #222222;">
<div style="background-color: white; font-family: arial, helvetica, sans-serif; font-size: small;">
<b><u>INPUT</u>: </b>CSV file with timestamp data (<span style="color: #52565a; font-family: roboto, arial, sans-serif; font-size: 14px;">time</span><span style="color: #3c4043; font-family: roboto, arial, sans-serif; font-size: 14px;"><b> </b>series observations of a dynamic object). </span></div>
<div style="background-color: white; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif; font-size: 14px;"><br /></span></div>
<span style="background-color: white; color: #3c4043; font-family: roboto, arial, sans-serif; font-size: 14px;"><b><u>Sample input data</u></b> can be downloaded from </span><span style="background-color: #fefdfa; color: #3c4043; font-family: georgia, utopia, "palatino linotype", palatino, serif;">from the </span><a href="https://www.perfomalist.com/sample-upload.csv" style="font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Oxygen, Ubuntu, Cantarell, "Fira Sans", "Droid Sans", "Helvetica Neue", sans-serif;" target="_blank">Download Input Data Sample</a> (https://www.perfomalist.com/sample-upload.csv)</div><div style="color: #222222;"><br /></div><div style="color: #222222;">which should look like:</div><div style="color: #222222;"><br /></div><div style="color: #222222;"><img alt="example" src="https://www.perfomalist.com/input.PNG" /><br />
<br /></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;"><b><u>Data granularity</u></b>: </span></span>hourly<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;"> (<b>v1.0</b>); minutely, daily (<b>v2+</b>)</span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif; font-size: 14px;"><br /></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;"><b><u>OUTPUT</u>:</b></span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;">- IT-Control Chart (see example below) (<b>v1.0)</b></span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;">- Data cube with summarized data (168 rows/weekhours - </span><b style="font-size: 14px;">v1.0</b><span style="font-size: 14px;">)</span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;">- List of anomalies and change points (<b>v2+</b>)</span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;"><br /></span></span></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;"><b><u>Requirement</u>:</b> </span></span></div>
<div style="background-color: white; font-family: arial, helvetica, sans-serif; font-size: small;">
<div style="color: #222222;">
<span style="color: #3c4043; font-family: roboto, arial, sans-serif;"><span style="font-size: 14px;">Input data should consist of at least </span></span>3 weeks of history as the method requires comparing the last 7 days of data (actual) with at least 2 weeks long learning/reference data set (baseline). </div>
<span style="color: #222222;">The size of the history is limited by about 5 years. </span><span style="color: #cccccc;">Unlimited size of input data will be implemented in v.2.</span></div>
<div style="background-color: white; font-family: arial, helvetica, sans-serif; font-size: small;">
<br /></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<b><u>Additional resources</u>:</b></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
- <a href="http://www.trub.in/2013/12/review-of-it-control-chart-my-new-paper.html" style="color: #1155cc;" target="_blank">How to read IT-Control Chart</a> (on-line article)</div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
- On-line class "<b><a href="http://www.trub.in/2018/04/performance-anomalydetection-online.html" style="color: #1155cc;" target="_blank">Performance Anomaly Detection</a></b>"<br />
<br />
<b><u>Project contributors:</u></b><br />
- <a href="https://www.linkedin.com/in/anfisa-trubina-8474735/">Anfisa Trubina</a><b> </b><br />
<br /></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<br /></div>
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg07ix2jZ1IZkORTh9lqmwj4LaqGMe5nS9z1p29Zy0_TwdFveRz1Z0ceosZfkDPllZ6I-lF41B3ZKBi6K-7j_5dBi6ya4jxuG17-scnW5M6Mk4CRowcNwRJRsZumSQxhbQ5q-xghXtzkBau/s1600/Capture.PNG" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="1258" data-original-width="924" height="640" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg07ix2jZ1IZkORTh9lqmwj4LaqGMe5nS9z1p29Zy0_TwdFveRz1Z0ceosZfkDPllZ6I-lF41B3ZKBi6K-7j_5dBi6ya4jxuG17-scnW5M6Mk4CRowcNwRJRsZumSQxhbQ5q-xghXtzkBau/s640/Capture.PNG" width="470" /></a></div>
<div style="background-color: white; color: #222222; font-family: arial, helvetica, sans-serif; font-size: small;">
<br /></div>
</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-43014405019089141482018-04-19T19:53:00.000-07:002018-04-19T19:56:02.162-07:00My "Performance #AnomalyDetection" Online Course is Launched at CMG.org (#CMGnews)<div dir="ltr" style="text-align: left;" trbidi="on">
<ul style="background: 0px 0px rgb(255, 255, 255); border: 0px; box-sizing: border-box; color: #666666; font-family: "open sans", helvetica, arial, lucida, sans-serif; font-size: 16px; line-height: 26px; margin: 0px; outline: 0px; padding: 0px 0px 1em 1em; vertical-align: baseline;">
<li style="background: 0px 0px; border: 0px; box-sizing: border-box; margin: 0px; outline: 0px; padding: 0px; text-size-adjust: 100%; vertical-align: baseline;"><span style="background: 0px 0px; border: 0px; box-sizing: border-box; font-weight: 700; margin: 0px; outline: 0px; padding: 0px; text-size-adjust: 100%; vertical-align: baseline;">Link to the course is on<a href="https://www.cmg.org/professional-development/"> CMG.org site </a></span></li>
<li style="background: 0px 0px; border: 0px; box-sizing: border-box; margin: 0px; outline: 0px; padding: 0px; text-size-adjust: 100%; vertical-align: baseline;"><span style="background: 0px 0px; border: 0px; box-sizing: border-box; font-weight: 700; margin: 0px; outline: 0px; padding: 0px; text-size-adjust: 100%; vertical-align: baseline;">$99 for CMG Members; $149 for Non-Members. </span></li>
</ul>
<div>
<br />
What is covered:<br />
<br />
<ul style="background-color: white; box-sizing: border-box; color: #2b3636; font-family: proxima; font-size: 18px; margin-bottom: 25px; margin-top: 0px;">
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Machine learning based Anomaly Detection technique</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Classical (SPC) and MASF (For system performance data) Control Chartirting</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Where is the Control Chart Used?</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">What are the types of Control Charts?</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Reading, building, and interpreting Control Charts</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Typical cases of real world issues captured by anomaly detection system (VMs, Mainframes, Middleware, E2E response and more)</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">How to build free AWS cloud server with R and build there control charts</span></li>
<li style="box-sizing: border-box;"><span style="box-sizing: border-box; font-weight: 700;">Performance anomaly (Perfomaly) detection system R implementation example (</span><a href="https://youtu.be/A0GFLnG5vAM" style="background: 0px 0px; box-sizing: border-box; color: #09a522;">SEDS-lite</a><span style="box-sizing: border-box; font-weight: 700;"> - open source based tool)</span></li>
</ul>
<div>
<span style="color: #2b3636; font-family: "proxima";"><span style="font-size: 18px;"><b>See more:</b></span></span></div>
</div>
<div>
<h3 class="post-title entry-title" itemprop="name" style="background-color: #fefdfa; color: #d52a33; font-family: Georgia, Utopia, "Palatino Linotype", Palatino, serif; font-size: 22px; font-stretch: normal; font-variant-east-asian: normal; font-variant-numeric: normal; font-weight: normal; line-height: normal; margin: 0px; position: relative;">
<a href="http://www.trub.in/2018/04/performance-anomalydetection-online.html">Performance #AnomalyDetection Online Course is Launched</a></h3>
</div>
</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-92222970310954666862017-12-26T08:35:00.001-08:002017-12-26T08:36:18.196-08:00My YT "iTrubin" generates more than $1 a day having ~ 2K views a day and ~1.2K subs. SUBSCRIBE!<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjgHKnaTzD0lxwZeQkMCzrAXt6EAukPK0QRGaR8TSzJ6do13iqbFAaFC1A4r3MlreEbUHnFzyPEUa6bpC_V3w1h9ufBcKAliCgxwFY2zsKlVhcylp7MwI3cW5wVv4ZJxLi2zL6fv40RVZo/s400/YoutubeStatslast30In2017.PNG" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="248" data-original-width="400" height="395" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjgHKnaTzD0lxwZeQkMCzrAXt6EAukPK0QRGaR8TSzJ6do13iqbFAaFC1A4r3MlreEbUHnFzyPEUa6bpC_V3w1h9ufBcKAliCgxwFY2zsKlVhcylp7MwI3cW5wVv4ZJxLi2zL6fv40RVZo/s640/YoutubeStatslast30In2017.PNG" width="640" /></a></div>
<br /></div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-24839721725384471852017-11-04T15:09:00.001-07:002017-11-04T15:09:14.568-07:00testing earn.com....Earn.com for businesses
If you’re a sender and want to learn more about how you can use Earn.com to increase your response rates and get more actionable user and customer feedback, contact us: sales@earn.comIgor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com2tag:blogger.com,1999:blog-4557133180438205506.post-34903128695754464982017-10-09T09:46:00.001-07:002017-10-09T17:45:11.728-07:00Keybase?<div dir="ltr" style="text-align: left;" trbidi="on">
<a href="https://keybase.io/images/blog/teams/teams-splash-announcement.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" data-original-height="569" data-original-width="800" height="227" src="https://keybase.io/images/blog/teams/teams-splash-announcement.png" width="320" /></a><a href="https://keybase.io/" style="font-family: "open sans", "helvetica neue", helvetica, arial, sans-serif; font-size: 13px;">Keybase is a new and free security app for mobile phones and computers. For the geeks among us: it's open source and powered by public-key cryptography....</a></div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com1tag:blogger.com,1999:blog-4557133180438205506.post-89706178692953932772017-10-09T09:26:00.000-07:002017-10-09T09:26:05.817-07:00Windows Phone is dead<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://cdn.vox-cdn.com/thumbor/X5m44HQCVOyXD-9NHHkfB3V1Z-E=/116x0:639x349/920x613/filters:focal(116x0:639x349):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/48673083/iphonecelebrationhearst.0.0.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="533" data-original-width="800" height="426" src="https://cdn.vox-cdn.com/thumbor/X5m44HQCVOyXD-9NHHkfB3V1Z-E=/116x0:639x349/920x613/filters:focal(116x0:639x349):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/48673083/iphonecelebrationhearst.0.0.jpg" width="640" /></a></div>
https://www.theverge.com/2016/1/28/10864034/windows-phone-is-dead<br />
<br />
<div class="separator" style="clear: both; text-align: center;">
<a href="https://pbs.twimg.com/media/CZ1tSgkVIAAOU7F.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" data-original-height="483" data-original-width="754" height="204" src="https://pbs.twimg.com/media/CZ1tSgkVIAAOU7F.png" width="320" /></a></div>
<br /></div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-69721094909180542792017-10-09T09:21:00.003-07:002017-10-09T09:21:48.278-07:00Microsoft признал смерть Windows Phone. Билл Гейтс уже перешел на Android<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<span style="margin-left: 1em; margin-right: 1em;"><a href="https://meduza.io/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo"><img border="0" data-original-height="458" data-original-width="800" height="366" src="https://meduza.io/image/attachments/images/002/542/812/large/g3h9nTpZssZPVZr5mg64mw.jpg" width="640" /></a></span></div>
<h1 class="MediaMaterialHeader-title" data-reactid=".9iwzapx9mo.8.$/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo.3.1.2.1.0" style="background: rgb(255, 255, 255); border: 0px; box-sizing: border-box; font-size: 16px; margin: 0px; outline: 0px; padding: 0px; vertical-align: baseline;">
<a href="https://meduza.io/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo"><span class="MediaMaterialHeader-first" data-reactid=".9iwzapx9mo.8.$/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo.3.1.2.1.0.0" style="background: transparent; border: 0px; box-sizing: border-box; font-family: "Proxima Nova", Arial, "Helvetica Neue", sans-serif; font-size: 36px; line-height: 38px; margin: 0px; outline: 0px; padding: 0px; transition: color 0.25s ease-out; vertical-align: baseline;">Мы платили разработчикам и писали приложения за них. Не помогло</span><span class="MediaMaterialHeader-separator" data-reactid=".9iwzapx9mo.8.$/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo.3.1.2.1.0.1" style="background: transparent; border: 0px; box-sizing: border-box; font-family: "Proxima Nova", Arial, "Helvetica Neue", sans-serif; font-size: 36px; margin: 0px; outline: 0px; padding: 0px; transition: color 0.25s ease-out; vertical-align: baseline;"> </span><span class="MediaMaterialHeader-second" data-reactid=".9iwzapx9mo.8.$/feature/2017/10/09/my-platili-razrabotchikam-i-pisali-prilozheniya-za-nih-ne-pomoglo.3.1.2.1.0.2" style="background: transparent; border: 0px; box-sizing: border-box; font-family: PFRegal, Georgia, serif; font-size: 37px; font-weight: normal; line-height: 38px; margin: 0px; outline: 0px; padding: 0px; vertical-align: baseline;">Топ-менеджер Microsoft признал смерть Windows Phone. Билл Гейтс уже перешел на Android</span></a></h1>
</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-86954978625057444332016-11-03T06:11:00.001-07:002016-11-03T06:11:45.168-07:00$550 FOLDABLE 4K NOTEBOOK DRONE<iframe allowfullscreen="" frameborder="0" height="270" src="https://www.youtube.com/embed/PzDLVx-5HSM" width="480"></iframe>Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com1tag:blogger.com,1999:blog-4557133180438205506.post-26845098515244546182016-11-01T20:31:00.001-07:002016-11-01T20:31:33.742-07:00 My YouTube channel iTrubin reached 1 million views! Subscribe!<div dir="ltr" style="text-align: left;" trbidi="on">
<div class="separator" style="clear: both; text-align: center;">
<a href="https://www.youtube.com/iTrubin"><img border="0" height="80" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjk3f2qiAkuZzOJ5DzmqoCuXKqN-VFnLhcGaduffli209Tj1Er3VK8CbiVISiCuLcCWaxyhWHnbmCDWvDQQ6rOR4b_eUSs6d51xhcFF_FuXzbGka13hZmKTrd75wArU0mi-cAdz2uRcIX4B/s640/1m.PNG" width="640" /></a></div>
<div style="text-align: left;">
<a href="https://www.youtube.com/user/itrubin" style="background-color: #1c1c1c; color: #dd7700; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; text-align: center; text-decoration: none;">https://www.<span style="font-size: medium;">YouTube.</span>com/<span style="font-size: medium;">iTrubin </span></a><span style="background-color: #1c1c1c; color: #cccccc; font-family: Arial, Tahoma, Helvetica, FreeSans, sans-serif; font-size: 14.85px; text-align: center;"> - SUBSCRIBE!</span></div>
</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-74415454080191341622016-08-04T18:06:00.002-07:002016-08-04T18:06:53.051-07:00Learn how you can help your dog be healthier, and avoid costly health problems<div dir="ltr" style="text-align: left;" trbidi="on">
<span style="background-color: white; color: #1d2129; font-family: helvetica, arial, sans-serif; font-size: 14px; line-height: 19.32px;">Are you looking to save time and money on your dog's care? Check out the link to Collabrodor site below to sign up and learn more!</span><br style="background-color: white; color: #1d2129; font-family: helvetica, arial, sans-serif; font-size: 14px; line-height: 19.32px;" /><a href="http://dog.collabrodor.com/" rel="nofollow" style="background-color: white; color: #365899; cursor: pointer; font-family: helvetica, arial, sans-serif; font-size: 14px; line-height: 19.32px; text-decoration: none;" target="_blank">http://dog.collabrodor.com</a></div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0tag:blogger.com,1999:blog-4557133180438205506.post-7794917802060908562016-06-08T21:48:00.001-07:002016-06-08T21:48:27.865-07:00the Collabrodor blog<div dir="ltr" style="text-align: left;" trbidi="on">
<br />
<div class="_6ks" style="font-family: inherit; line-height: 0; position: relative; z-index: 1;">
<a href="http://www.collabrodor.com/blog/" rel="nofollow" style="color: #365899; cursor: pointer; font-family: inherit; text-decoration: none;" tabindex="-1" target="_blank"><div class="_6l- __c_" style="font-family: inherit; position: relative;">
<div class="uiScaledImageContainer _6m5 fbStoryAttachmentImage" style="background-position: 50% 50%; background-repeat: no-repeat; font-family: inherit; height: 255px; overflow: hidden; position: relative; width: 487px;">
<img alt="" class="scaledImageFitWidth img" height="255" src="https://external-iad3-1.xx.fbcdn.net/safe_image.php?d=AQDKsucjpMFmtfUq&w=487&h=255&url=http%3A%2F%2Fstatic1.squarespace.com%2Fstatic%2F569477b1841aba721e2fe556%2Ft%2F569478890e4c11c98e2d7bc1%2F1465245831259%2F%3Fformat%3D1000w&cfs=1&upscale=1" style="border: 0px; height: auto; min-height: 100%; position: relative; vertical-align: bottom; width: 487px;" width="487" /></div>
</div>
</a></div>
<div class="_3ekx _29_4" style="font-family: inherit;">
<div class="_6m3" style="background-color: white; color: #1d2129; font-family: helvetica, arial, sans-serif; font-size: 12px; height: auto; line-height: 16.08px; margin: 10px 12px; max-height: 100px; position: relative;">
<div class="mbs _6m6 _2cnj _5s6c" style="font-family: Georgia, serif; font-size: 18px; line-height: 22px; margin-bottom: 5px; max-height: 110px; overflow: hidden; transition: color 0.1s ease-in-out; word-wrap: break-word;">
<a href="http://l.facebook.com/l.php?u=http%3A%2F%2Fwww.collabrodor.com%2Fblog%2F&h=dAQFkU6ps&enc=AZMXR1JaMh5NF1tQ3n-4qpe8AKHjbuM2ZRoZlB0fur9LUMHMgBY54EkS7rQ2rCaImwk5tId0hbBnRo1rIuKXZN0F6TtGfGr1XWxb8lbtrhK_pSroNooF1bcYKoZMxfoUgbTcnqkuH3inDrXb_TrNSD3Y1SlfJIf28_7r5In-yu0BLgDaZOCSLq_WX7Svc9eNDUQ&s=1" rel="nofollow" style="color: #1d2129; cursor: pointer; font-family: inherit; text-decoration: none; transition: color 0.1s ease-in-out;" target="_blank">Blog</a></div>
<div class="_6m7 _3bt9" style="font-family: inherit; line-height: 16px; max-height: 80px; overflow: hidden;">
Comment Welcome to Collabrodor! June 7, 2016 Welcome Pet Parents to the <a href="http://www.collabrodor.com/blog/">Collabrodor blog</a>! As dedicated pet parents ourselves, we hope to share with you pet related musings, information, and content. Please take a look at out site and check…</div>
<div class="_59tj" style="font-family: inherit; padding-top: 9px; position: relative;">
<div style="font-family: inherit;">
<div class="_6lz _6mb ellipsis" style="color: #90949c; font-family: inherit; font-size: 11px; line-height: 11px; overflow: hidden; text-overflow: ellipsis; text-transform: uppercase; white-space: nowrap;">
WWW.COLLABRODOR.COM</div>
<div>
<br /></div>
<div class="_5tc6" style="color: #90949c; font-family: inherit; margin-top: 5px;">
</div>
</div>
</div>
</div>
</div>
</div>
Igor Trubinhttp://www.blogger.com/profile/17758940374397545163noreply@blogger.com0