{"id":13746,"date":"2020-11-11T16:47:52","date_gmt":"2020-11-11T16:47:52","guid":{"rendered":"http:\/\/abstracta.us\/blog\/?p=13746"},"modified":"2025-05-05T21:25:52","modified_gmt":"2025-05-05T21:25:52","slug":"julio-de-lima-machine-learning-performance-testing","status":"publish","type":"post","link":"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/","title":{"rendered":"Quality Sense Podcast: Julio de Lima &#8211; Machine Learning to Understand Performance Testing Results"},"content":{"rendered":"\n<h1 class=\"wp-block-heading\">J\u00falio explains a machine learning algorithm to reduce the scope of load testing and get meaningful analysis from your data faster<\/h1>\n\n\n\n<p>In this <a rel=\"noreferrer noopener\" aria-label=\"Quality Sense (opens in a new tab)\" href=\"https:\/\/abstracta.us\/software-testing-podcast\" target=\"_blank\">Quality Sense<\/a> episode, Fede has a chat with <a rel=\"noreferrer noopener\" aria-label=\"J\u00falio de Lima (opens in a new tab)\" href=\"https:\/\/www.linkedin.com\/in\/juliodelimas\/\" target=\"_blank\">J\u00falio de Lima<\/a>, an engineer at Capco, who recently completed his master\u2019s degree in Electrical Engineering and Computing (Artificial Intelligence) and also co-founded <a href=\"https:\/\/www.meetup.com\/garoaqa\/\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"GaroaQA (opens in a new tab)\">GaroaQA<\/a>, a meetup group with four locations across Brazil and over 2,000 members. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Episode_Highlights\"><\/span>Episode Highlights<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ul><li>The complexity of analyzing the huge amounts of data that software performance tests provide<\/li><li>Using machine learning to solve data issues by giving meaningful insights about what happened during test execution<\/li><li>How he used K-means clustering, a machine learning algorithm, to reduce almost 300,000 records to fewer than 1,000 and still get good insights into load testing results<\/li><\/ul>\n\n\n\n<p><strong>Relevant Links:<\/strong><\/p>\n\n\n\n<ul><li>STAREAST 2020 Talk: <a rel=\"noreferrer noopener\" aria-label=\"Reducing the Scope of Load Test Analysis (opens in a new tab)\" href=\"https:\/\/vimeo.com\/415978068\/a37aa0a1a8\" target=\"_blank\">Reducing the Scope of Load Test Analysis<\/a> and <a rel=\"noreferrer noopener\" aria-label=\"accompanying files (opens in a new tab)\" href=\"https:\/\/bit.ly\/starEast2020Julio\" target=\"_blank\">accompanying files<\/a><\/li><li>J\u00falio&#8217;s website: <a href=\"https:\/\/about.me\/Juliodelimas\">about.me\/Juliodelimas<\/a><\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Listen_Here\"><\/span>Listen Here:<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<iframe width=\"100%\" height=\"300\" scrolling=\"no\" frameborder=\"no\" allow=\"autoplay\" src=\"https:\/\/w.soundcloud.com\/player\/?url=https%3A\/\/api.soundcloud.com\/tracks\/927358264&amp;color=%23ff5500&amp;auto_play=false&amp;hide_related=false&amp;show_comments=true&amp;show_user=true&amp;show_reposts=false&amp;show_teaser=true&amp;visual=true\"><\/iframe><div style=\"font-size: 10px; color: #cccccc;line-break: anywhere;word-break: normal;overflow: hidden;white-space: nowrap;text-overflow: ellipsis; font-family: Interstate,Lucida Grande,Lucida Sans Unicode,Lucida Sans,Garuda,Verdana,Tahoma,sans-serif;font-weight: 100;\"><a href=\"https:\/\/soundcloud.com\/qualitysensepodcast\" title=\"Quality Sense, a Software Testing Podcast\" target=\"_blank\" style=\"color: #cccccc; text-decoration: none;\" rel=\"noopener noreferrer\">Quality Sense, a Software Testing Podcast<\/a> \u00b7 <a href=\"https:\/\/soundcloud.com\/qualitysensepodcast\/s2e4-julio-de-limas-machine-learning-to-understand-performance-testing-results\" title=\"S2E4 - Julio De Limas - Machine learning to understand performance testing results\" target=\"_blank\" style=\"color: #cccccc; text-decoration: none;\" rel=\"noopener noreferrer\">S2E4 &#8211; Julio De Limas &#8211; Machine learning to understand performance testing results<\/a><\/div>\n\n\n\n<div style=\"height:25px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<ul><li>Listen on&nbsp;<a rel=\"noreferrer noopener\" aria-label=\" (opens in a new tab)\" href=\"https:\/\/soundcloud.com\/qualitysensepodcast\/s2e3-lisi-hocke-personal-challenges-thoughts-on-the-article-im-white\" target=\"_blank\">Soundcloud<\/a><\/li><li>Listen on&nbsp;<a href=\"https:\/\/open.spotify.com\/show\/52OQnkNvXo2BdbwecYvT1d?si=8e6Tk6ySSnqtSBemkXd03Q\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\" (opens in a new tab)\">Spotify<\/a><\/li><li>Listen on&nbsp;<a href=\"https:\/\/podcasts.apple.com\/us\/podcast\/quality-sense-podcast\/id1510263025#episodeGuid=tag%3Asoundcloud%2C2010%3Atracks%2F927358264\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\" (opens in a new tab)\">Apple Podcasts<\/a><\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Episode_Transcript\"><\/span>Episode Transcript:<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>(Lightly edited for clarity.)<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Hello, J\u00falio. It is so nice to have you here on the show. How are you doing today?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>I&#8217;m very fine, and it&#8217;s a pleasure to be here, and thank you for having me here.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-2\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>It&#8217;s my pleasure as well, and also to share this space with more Latin American friends. This is one of the biggest motivations I have for doing this podcast is sharing things between different parts of the world. Having great leaders in software testing from here, from the states, or countries around here, but also having the possibility to share experiences also with my brothers from the South.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-2\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Awesome.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-3\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Julio, one of the main topics we want to address today is related to performance testing. But before that, I would like to know how you ended up working in software testing, and specifically what&#8217;s your background around performance.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-3\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Okay, that&#8217;s good. So I started my career playing the role of a developer. So I started developing PHP. I used to be a good programmer, actually. And some day I heard some director that was working for the same company that I was at at that time, and she said that they were going to start to invest more effort on testing. And I said, &#8220;Testing, how?&#8221;<\/p>\n\n\n\n<p>Yeah, someone is paid to just click buttons. And I said, &#8220;That&#8217;s a lie.&#8221; And then I started to search about it and they found a lot of stuff on testing. I said, &#8220;Oh, that seems good.&#8221; And at that time I was working with 39 other programmers. So it&#8217;s very difficult to raise your career in an environment like this. So I said, I believe that it&#8217;s an opportunity for me. I started to study a lot, read a lot of books. I met, how they say, in the books, a lot of people that are very well known even today, like James Bach, Janet Gregory, who you also interviewed, right? It was a good conversation.<br><\/p>\n\n\n\n<p>And then I started there. I invested a lot of time. So 12 years so far just dedicated to testing. And I saw the profession has evolved a lot from the people that were more concerned should the user experience, using the application, to someone that is very deep on the architecture, engineering, and even understanding the user expectations, using more skills regarding the engineering itself. Yeah, it&#8217;s a huge evolution. And during this time, the first contact that I have with, how they say, testing tools were regarding the load testing. And since the beginning, I started to use who&#8217;s this. I remember the first two that I used was Apache JMeter. The scenario at that time was that we used to have desktop applications and we were going to web. So we needed to exercise the performance of this application.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-4\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>A typical scenario for performance testing because you are migrating the architecture and there are many risks associated with that.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-4\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yes. So I remember at that time, one of the difficulties that we had was that no one knew what exactly should be the environment to support those applications. And no one knows about the common paths that the user will do on the application, since we didn&#8217;t have that kind of data. And yes, that was the first contact with performance. I&#8217;m talking about 2009 to 2010. Yeah, that&#8217;s it.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-5\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Okay, cool. So your story is like the opposite from some companies where they say, okay, first we give the people the possibility to work as a tester, then we promote them to developers. So you went in the other direction. That&#8217;s really good. I also know some other people who had started in programming and then moved to testing, and I think those movements are really, really good. If you&#8217;re a tester and you have a background in programming, and not only a background like you started in programming, but you worked as a programmer. I think you understand some problems, some typical problems from another perspective and you can contribute better to their problems, right?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-5\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah, yeah, exactly. And also you have more, how they say, empathy, because it&#8217;s all about that, right? Communications and exchanged knowledge to help these people to overcome that wall that usually companies create between the tester and the developer. And then when we overcome these walls, we can anticipate problems, right?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-6\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah, totally. Julio, recently you published a paper and also you presented your results in <a href=\"https:\/\/vimeo.com\/415978068\/a37aa0a1a8\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"STAREAST (opens in a new tab)\">STAREAST<\/a>, right?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-6\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yes.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-7\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Would you like to share with the audience a little bit more about what your findings in this research? Maybe a good way to start will be by understanding better the problem you&#8217;re trying to tackle with your research. Can you tell us a little bit more about that?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-7\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>So to help the audience to understand better what I&#8217;m calling as a load test, okay? I have one scenario. This scenario had two steps, okay? It&#8217;s a very simple scenario. And I was running load tests where I have hundreds of users, okay, 50 simultaneously, running this scenario during one hour, 60 minutes. So this is what I&#8217;m calling load testing, okay?&nbsp;<br><\/p>\n\n\n\n<p>When running the scenarios, I had a lot of metrics being collected, but all of these metrics are from the user\u2019s perspective. What I mean is how much time the response takes to come back to my browser, for example. And for sure, there are a lot of other metrics, the connection time, the latency in other measures. But after we ran this test, what I had was a table with more than 300,000 lines to read.<br><\/p>\n\n\n\n<p>For me as a QA specialist, I can read those lines, but it&#8217;s very difficult, right? Reading that hundred thousand lines is very difficult. So I tried another approach. Let&#8217;s try to plot this information in a graph. And I have another problem because the amount of lines is so, so, so huge that I can&#8217;t read the graph with efficiency, right? It&#8217;s very dense.&nbsp;<br><\/p>\n\n\n\n<p>So I started to think, what are my possibilities here? Because my problem is I can&#8217;t read the information in an easier way, right? So I tried to divide the results and tried to get more information. It wasn\u2019t a good approach either, the better approach as well, since I don&#8217;t have the correlation between the variables. So that is the problem statement. It&#8217;s difficult, very difficult to read the information, even being a QA specialist.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-8\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah. I think this problem happens for performance testing for so many things. Now we have a lot of tools giving you tons and tons of lines, right? You have a lot of the data, but the problem is how to analyze this data and in an efficient way. Because probably what is really important here is to provide an analysis in the current time, right? You have to be fast analyzing this data. So how can we solve that? What&#8217;s your proposal?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-8\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Great, great. So before going to the proposal, let&#8217;s understand something, okay? In the machine learning field, and I know that probably there are a lot of people in the audience that is, oh, machine learning testing, that&#8217;s not the approach that I am looking for, but please be patient and listen about that.&nbsp;<br><\/p>\n\n\n\n<p>In machine learning, we have a lot of algorithms, right? And we have two approaches. There are two well-known approaches; the supervised and not supervised one, okay? In the supervised, you have the classification for everything. You know exactly what should be the answer for that question for each data that you have in your data set. On the unsupervised learning, you don&#8217;t know what is the classification. So this is the basic principle, okay? Both can read a lot of lines and then take decisions, make guesses about it.<br><\/p>\n\n\n\n<p>So on the unsupervised, this is the one case where I have 300,000 lines, but I don&#8217;t know what is the classification for each line. There I can just filter for the classification that I consider as flaw and success, right? But I don&#8217;t know the classification, I need to analyze each line to understand that. So for sure it&#8217;s not a problem to supervised learning, right? So why go with the unsupervised one? What do I mean? I will use an algorithm that will find the similarities between lines. So with this maybe you already discovered what I did. So I use one algorithm to find out what the similarities are. And after finding out the similarities, I create groups. In this case, we call these groups as clusters of information, similar information. And then I started to understand, to investigate the cluster itself instead of investigate the 300,000 lines.<br><\/p>\n\n\n\n<p>When you use an algorithm like this that creates clusters, you have a specific number of clusters. And there are also some techniques that you can use to define what is the optimal number of clusters based on the data sets. Okay?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-9\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Okay.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-9\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>So, we can base it on the data set that I have, those 300,000 lines. I discovered that six clusters are enough. Oh sorry, nine clusters are enough, okay? And when I did it, the algorithm classified the data and created those nine clusters. And I saw one cluster that was very small, something like 861 lines. So it called my attention, right? I thought, whoa, we have a lot of clusters that have more than thousands of lines. So why is this one so small? And then so far my solution could divide the clusters to meet with intelligence because they are not just looking for the elapsed time, as people generally do, right? They were looking for all the variables. And I&#8217;m talking about elapsed time, latency, connection time, idle time, bytes received and bytes sent. So all of these similarities create that group, and that group is small. And when I looked at that group, at that cluster, I saw there were a lot of errors regarding server connection refused. And that was the first finding that I obtained.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-10\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Okay. At the beginning, you mentioned that we should be patient when it comes to applying machine learning. And now I understand because the first thing people tend to think about using machine learning for testing is replacing the testers with some artificial intelligence or something like this. But you are actually helping the tester to do a better job. And I think this is a completely different approach, and it&#8217;s taking the best out of the tools we can build for improving our work, abilities of analyzing tons of data. So that&#8217;s cool. And you are, as I understood, you&#8217;re analyzing all of the metrics that probably JMeter is giving you, right?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-10\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yes, you&#8217;re right.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-11\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>So can you also combine this with some metrics from an APM or some monitoring tool so you can also correlate those possible anomalies with some other behavior in the infrastructure? Is that possible?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-11\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>It is possible. I haven&#8217;t had enough time to produce that kind of result, but this is my future work. We also need to get the metrics from the server in order to get more efficient feedback, efficient insights, because as a QA specialist that has knowledge in performance testing, I know that just the user view doesn&#8217;t reflect what is happening under the application, right? We have a server that may not perform as expected, that may be overloaded, a lot of other measures that can be used and then combine all of this in the group again in order to understand better what happened.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-12\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Another thing that I&#8217;m thinking about right now is that when I did my PhD in Spain, what I realized is there is a disconnect between academia and the industry in our field. So we should be doing more things like this, collaborating and learning from each other related to that. Is there a way that anyone here can try to replicate your findings or use the tool that you prepared for this, or something like that?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-12\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yes, there are. So, as you said before, I presented these results at STAREAST this year in May, 2020. So you also can find out the video and also understand step-by-step how to do this. But it&#8217;s reproducible, and yes, you can use this in your company.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-13\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Oh, perfect.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-13\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Awesome.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-14\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Julio, one of my last questions is related to habits because I really believe that by improving those little things in our lives that we do every day, we can improve the way we try to achieve our goals. I am curious if you have any habit that you can inspire others to form or to adopt.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-14\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>For sure, for sure. Yes. One thing I always share with my students, I don&#8217;t know if I told you, but now I have more than 5,000 students in my online courses.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-15\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Whoa.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-15\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah. I am very glad. And probably some of these students will listen to this podcast. Something that I always say to them is that we are not just tool operators.&nbsp;<br><\/p>\n\n\n\n<figure class=\"wp-block-pullquote\"><blockquote><p><strong>Testing is more than just tools. Testing is&nbsp; critical thinking, testing is collaboration, testing is looking for risks. Testing is more.<\/strong>&nbsp;<br><\/p><cite>J\u00daLIO DE LIMA<\/cite><\/blockquote><\/figure>\n\n\n\n<p>In that we need to always strive to discover more. Being curious, right? But maybe it&#8217;s cliche, but what I&#8217;m talking about is to understand what the people that are in your team are doing. That is something that I learned from my career.&nbsp;<br><\/p>\n\n\n\n<p>Every time that I try to understand more about the architecture of the APIs, about the code, the way they do unit tests, the way that they think about testing, the way that they understand what is my activity, I could understand more about what I&#8217;m doing. So be curious and be communicative in order to grow your skills.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-16\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah, I&#8217;m 100% with you. I really believe this is really important to do a better job and also to improve the results, not only from you, but also from your team. So thanks for that. And one last question is, I don&#8217;t know if you like to read, if you have any book recommendation to make.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-16\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yeah. So I would like to refer two researchers: <a href=\"https:\/\/www.researchgate.net\/publication\/282551435_A_Survey_on_Load_Testing_of_Large-Scale_Software_Systems\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"Zhen Ming Jiang and Ahmed E. Hassan (opens in a new tab)\">Zhen Ming Jiang and Ahmed E. Hassan<\/a>. They are striving to learn more about software testing, actually in the load testing area. And they are both people that I studied to create this experiment that I shared with you today.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-17\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Julio, one last question, do you have anything you would like to invite the audience to do or to join one of the multiple channels where you share content?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-17\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Yes. So I am on YouTube, Spotify, Instagram, Telegram, Medium. So it&#8217;s pretty difficult to share all of these social networks, so I invite you to access <a href=\"https:\/\/about.me\/Juliodelimas\">about.me\/Juliodelimas<\/a>.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-18\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Perfect.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-18\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Thank you.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-19\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Thank you, Julio. It was really a pleasure to finally get to talk to you and share all this knowledge and experience working in performance testing, but also from academia. This is something that I was really interested in also because it&#8217;s like what academia is doing regarding those topics that we are working every day in our field. So thanks again for sharing that. And I hope you enjoy the rest of the week.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-19\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Excellent. As I said before, we actually started this conversation, for me, it&#8217;s a pleasure to have a friend like you that builds your company from zero, from scratch, and make a huge contribution to Uruguay and the community, and now for the whole world, right? So it&#8217;s a pleasure finally to meet you and to talk to you, and thank you for having me here and for inviting me to this podcast that I love to listen to.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Federico-20\"><\/span><strong>Federico:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Thank you very much. See you.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Julio-20\"><\/span><strong>J\u00falio:<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>See you.<br><\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Did_you_enjoy_this_episode_of_Quality_Sense_Explore_similar_episodes_here\"><\/span>Did you enjoy this episode of Quality Sense? Explore similar episodes&nbsp;<a href=\"https:\/\/abstracta.us\/blog\/podcast\/\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\" (opens in a new tab)\">here<\/a>!<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Recommended_for_You\"><\/span>Recommended for You<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p><a rel=\"noreferrer noopener\" aria-label=\"Quality Sense Podcast: Refael Botb\u00f3l - Optimizing Performance Testing Costs (opens in a new tab)\" href=\"https:\/\/abstracta.us\/blog\/podcast\/quality-sense-podcast-optimizing-performance-testing-costs\/\" target=\"_blank\">Quality Sense Podcast: Refael Botb\u00f3l &#8211; Optimizing Performance Testing Costs<\/a><br><a href=\"https:\/\/abstracta.us\/blog\/performance-testing\/3-key-performance-testing-metrics-every-tester-should-know\/\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"3 Key Performance Testing Metrics Every Tester Should Know (opens in a new tab)\">3 Key Performance Testing Metrics Every Tester Should Know<\/a><\/p>\n\n\n\n<!-- Go to www.addthis.com\/dashboard to customize your tools --><script src=\"\/\/s7.addthis.com\/js\/300\/addthis_widget.js#pubid=ra-58d80a50fc4f926d\" type=\"text\/javascript\"><\/script>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>J\u00falio explains a machine learning algorithm to reduce the scope of load testing and get meaningful analysis from your data faster In this Quality Sense episode, Fede has a chat with J\u00falio de Lima, an engineer at Capco, who recently completed his master\u2019s degree in&#8230;<\/p>\n","protected":false},"author":55,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32],"tags":[50,37],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v14.0.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Quality Sense Podcast: J\u00falio de Lima - ML &amp; Load Testing | Abstracta<\/title>\n<meta name=\"description\" content=\"In this episode, Fede chats with J\u00falio de Lima, a software quality engineer from Brazil about using machine learning to interpret performance testing results.\" \/>\n<meta name=\"robots\" content=\"index, follow\" \/>\n<meta name=\"googlebot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta name=\"bingbot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Quality Sense Podcast: J\u00falio de Lima - ML &amp; Load Testing | Abstracta\" \/>\n<meta property=\"og:description\" content=\"In this episode, Fede chats with J\u00falio de Lima, a software quality engineer from Brazil about using machine learning to interpret performance testing results.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AbstractaQA\/\" \/>\n<meta property=\"article:published_time\" content=\"2020-11-11T16:47:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T21:25:52+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/abstracta.us\/wp-content\/uploads\/2020\/11\/Julio-de-Lima-Federico-Toledo-min.png\" \/>\n\t<meta property=\"og:image:width\" content=\"560\" \/>\n\t<meta property=\"og:image:height\" content=\"315\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@AbstractaUS\" \/>\n<meta name=\"twitter:site\" content=\"@AbstractaUS\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abstracta.us\/blog\/#website\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\",\"description\":\"AI-powered quality engineering\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/abstracta.us\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/#webpage\",\"url\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\",\"name\":\"Quality Sense Podcast: J\\u00falio de Lima - ML & Load Testing | Abstracta\",\"isPartOf\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#website\"},\"datePublished\":\"2020-11-11T16:47:52+00:00\",\"dateModified\":\"2025-05-05T21:25:52+00:00\",\"author\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/3cc530c545cab16fae6829f65fe4419e\"},\"description\":\"In this episode, Fede chats with J\\u00falio de Lima, a software quality engineer from Brazil about using machine learning to interpret performance testing results.\",\"breadcrumb\":{\"@id\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/performance-testing\/\",\"url\":\"https:\/\/abstracta.us\/blog\/performance-testing\/\",\"name\":\"Performance Testing\"}},{\"@type\":\"ListItem\",\"position\":3,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\",\"url\":\"https:\/\/abstracta.us\/blog\/performance-testing\/julio-de-lima-machine-learning-performance-testing\/\",\"name\":\"Quality Sense Podcast: Julio de Lima &#8211; Machine Learning to Understand Performance Testing Results\"}}]},{\"@type\":[\"Person\"],\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/3cc530c545cab16fae6829f65fe4419e\",\"name\":\"Abstracta Team\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/abstracta.us\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6cab9c9f3dec946bd8867fdb2abbd10a?s=96&d=blank&r=g\",\"caption\":\"Abstracta Team\"},\"description\":\"We are a technology solutions company specializing in software testing, custom software development, and AI-driven software solutions. We provide top-notch, holistic solutions to enable continuous delivery of high-quality software. Our purpose is to co-create first class software, generating opportunities for development in our communities to improve people's quality of life. Organizations such as BBVA Financial Group, CA Technologies and Shutterfly turn to us for comprehensive quality solutions, from rigorous testing to innovative AI copilots and bespoke software development. Sharing our learnings with the community is rooted in our values. That is why we believe in collaborating with the IT community by sharing quality content, courses, and promoting thought leadership events. Recognized with several awards, we are committed to quality, innovation, and customer satisfaction. Our experienced team, dedicated to continuous learning and improvement, has earned the trust of numerous clients worldwide, from startups to Fortune 500 companies. We are a fast-growing company, and we are looking for proactive and talented people, who can assume responsibilities, bring new ideas, and who are as excited as we are about our mission of building high-quality software. If you are interested in joining the team, apply here https:\/\/abstracta.us\/why-us\/careers.\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/13746"}],"collection":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/users\/55"}],"replies":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/comments?post=13746"}],"version-history":[{"count":9,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/13746\/revisions"}],"predecessor-version":[{"id":13756,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/13746\/revisions\/13756"}],"wp:attachment":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/media?parent=13746"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/categories?post=13746"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/tags?post=13746"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}