{"id":15582,"date":"2023-02-01T15:41:55","date_gmt":"2023-02-01T15:41:55","guid":{"rendered":"http:\/\/abstracta.us\/blog\/?p=15582"},"modified":"2025-05-05T21:19:33","modified_gmt":"2025-05-05T21:19:33","slug":"how-to-make-testing-progress-visible","status":"publish","type":"post","link":"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/","title":{"rendered":"How to Make Testing Progress Visible"},"content":{"rendered":"\n<p>Testing efforts can easily go under the radar or be hard to grasp. It&#8217;s important to remember that software testing is not only about running tests: it involves multiple crucial facets that contribute to creating better and better software. In this article, we share with you all what we do in order to help the team and the different stakeholders to be informed of the testing progress.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/abstracta.us\/wp-content\/uploads\/2023\/02\/planification-1024x576.jpg\" alt=\"\" class=\"wp-image-15583\"\/><\/figure>\n\n\n\n<p><strong><em>By Federico Toledo<\/em><\/strong><\/p>\n\n\n\n<p><strong>Testing is aimed to provide information about the quality of our system and the risks that might affect the user experience and our business<\/strong> so that better decisions can be taken. All this in order to mitigate those risks and improve the quality and the experience of our users.<br><\/p>\n\n\n\n<p><strong>We are a quality partner.<\/strong> We know that effective communication is essential to optimize our work and achieve our goals. That&#8217;s why we focus on building relationships with our clients, through <strong>transparent processes that make testing progress visible<\/strong> on a daily basis. Find out how we do it in this article!<br><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Making_Goals_and_Setting_Expectations\"><\/span><strong>Making Goals and Setting Expectations<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p><strong>Testing must be aligned with the business goals. <\/strong>This is a common pitfall that many testers and testing providers make. The challenge with testing is not only how to test, how to design test cases, or how to test a particular feature. One of the most challenging things in software testing is deciding what not to test. <br><br>We must understand the business goals and risks in order to be thoughtful and mindful of prioritizing. With that context in mind, we design the best testing strategy aligned to the business needs, and this will set the expectation with the team for the progress they will want to see from us.&nbsp;<\/p>\n\n\n\n<p><strong>The creation of quality software is crucial for society\u2019s development and the improvement of its quality of life.<\/strong> We live in a globalized and almost wholly interconnected world, in which permanent digital transformation is a fact and good quality technology makes a real difference in people\u2019s daily lives.<\/p>\n\n\n\n<p> <strong>Our greatest impact lies in what the technology we create enables<\/strong>, and that this technology is of good quality,\u201d recently said my friend and Abstracta&#8217;s CEO Matias Reina. <\/p>\n\n\n\n<p>\u201cWe empower technologies that are enabling software to be made faster and with quality, we help create more accessible technology, and more people have access to communications infrastructures. When we analyze what we do in each project and with each client, we don\u2019t just think about the products themselves but about what they make possible, how their technology extends and improves the quality of life of many people,\u201d he continued.<\/p>\n\n\n\n<p><strong>All in all, as testers, the first step to give visibility on our work and progress is to understand and align our test strategy to the one from the business.\u00a0<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Communication_Strategy\"><\/span><strong>Communication Strategy <\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Once we are clear with the goals, we start with the testing activities. As the rest of the team members are typically busy with their different responsibilities, the challenge on the day-to-day is to keep everyone informed. That doesn\u2019t mean that we must tell everyone about every little detail, about every test, or every result we get after each test we do. Different people have different needs for different levels of detail, which is crucial for an effective communication strategy.&nbsp;<\/p>\n\n\n\n<p><strong>We are convinced that communication is essential for a smooth, effective workflow. So, we pay great attention to communication with our customers and seek to deeply understand their needs.<\/strong><\/p>\n\n\n\n<p>Our experience of almost 15 years in testing reconfirms every day that testing isn\u2019t only about designing tests! It\u2019s giving our best so that we can better the experience of the user. And, of course, it\u2019s also about enjoying the path together collaborating with the rest of the team.<\/p>\n\n\n\n<p><strong>We have different levels of communication pre-established to keep stakeholders on the same page. Let\u2019s explore some of them.&nbsp;<\/strong><\/p>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Day-to-Day Communication<\/strong><\/h4>\n\n\n\n<p><strong>The testers are embedded as much as our customers allow us to be. The most common scenario is that the testers become part of the development team<\/strong>, so they participate in all the ceremonies, meetings, slack channels, etc. That way there\u2019s almost no difference between the communication with testers (in this case, Abstracta\u2019s team members), and other team members, whether they are from the client\u2019s team, other providers, etc. <\/p>\n\n\n\n<p>In order to make communication more effective and reduce the chance of having blind spots, <strong>all our testers are guided and mentored by technical experts that support them, so there\u2019s always someone with more experience reviewing their work<\/strong>, helping them brainstorm, design tests, plan, communicate results, etc.<\/p>\n\n\n\n<p><strong>There\u2019s one extra layer of communication which is the customer success team<\/strong>, that helps with the business perspective, and they are a good escalation point if anything needs to be adjusted, to scale up the team, etc. At this level of communication, we try to gather the information that might impact our testing strategy, such as business decisions, changes in the global strategy, etc. This way we can align and strategize with the technical team, making the required adjustments, and making sure that our progress is in the right direction.&nbsp;<\/p>\n\n\n\n<p><strong>There are different things to share at each level, with different frequencies, and with different people. Just to give you some ideas:<\/strong><\/p>\n\n\n\n<ul><li><strong>On a daily basis, you could discuss the weekly goals or the sprint goals<\/strong>, and how you are focusing, prioritizing, and progressing so that you and the team can reprioritize if needed.<br><\/li><li><strong>On a monthly basis you could discuss the test strategy<\/strong>, how the different risks are covered with your current testing strategy, or how the different quality factors are being prioritized (you could be delaying your performance tests to face them after you finish solving your security issues.)<br><\/li><li><strong>On a quarterly basis, you could do a recap <\/strong>of what you have been doing and analyze how your work is aligned with the business strategy if your team is getting better, or how you are going to step up the game.<\/li><\/ul>\n\n\n\n<p>Of course, the frequency and content will be different for each team according to their context. It is important to point out that these are just examples; there is no such thing as one size fits all.<strong> We make everything very specific to what is most useful for each client.<\/strong><\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_about_Metrics\"><\/span><strong>What about Metrics?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p><strong>A good way to give visibility on our testing is by managing and sharing key metrics, intelligently selected to be useful in our goal of aligning the team. <\/strong>Testing always looks to provide more information to have less uncertainty and better control over risk, but that information must be analyzed carefully<strong>.&nbsp;<\/strong><\/p>\n\n\n\n<p><strong>We typically insist on this last idea because metrics can promote unwanted behaviors<\/strong>, so we have <strong>to be very careful when choosing them. <\/strong>For instance, if we merely measure the number of bugs, then we could be motivating our team to focus on the areas where they can find more bugs easily, instead of focusing on the most important parts of the system. We don\u2019t want to focus either on the number of test cases, because it doesn\u2019t tell you anything about the effectiveness of your testing.&nbsp;<\/p>\n\n\n\n<p><strong>Our focus is always on the metrics that are important for the business<\/strong>, something that if improved, would lead to a real improvement for the business. It\u2019s also important to note that one metric only tells part of the story and<strong> what\u2019s fundamentally important is the team&#8217;s commitment to quality and not only metrics.<\/strong><\/p>\n\n\n\n<p>We are usually the ones that push to provide metrics. For us, it is very important that everyone understands the impact of the activity of testing.<strong> This way, we can help improve the quality, velocity, agility, performance, or whatever reason motivated them to hire us.&nbsp;<\/strong><\/p>\n\n\n\n<p>In order to have useful metrics, it\u2019s important to be clear about the goals that we are pursuing, and then, select the metrics that will help us to see if we are getting closer to success or not to that goal.&nbsp;<\/p>\n\n\n\n<p><strong>Let\u2019s see a couple of examples:<\/strong><\/p>\n\n\n\n<p>&#8211;&nbsp; If we want to improve the quality of our product, let\u2019s focus on the bugs we find and solve before releasing the software, not only the plain number (to avoid the bad behavior we mentioned before) but along with their severity. We should also measure the bugs or complaints reported by users, and measure user satisfaction with our products. <\/p>\n\n\n\n<p>&#8211; If we are automating test cases, in order to have an efficient way to support the regression testing efforts, it does make sense to measure progress with the number of test cases. We have a goal of automating all the smoke tests, or all the regression suites, and that number will help us to measure progress over time, if we are delivering it according to the plan or not.&nbsp;<\/p>\n\n\n\n<p>&#8211; If we talk about other quality factors such as performance, it\u2019s really important to have an eye on the response times of the most important features, as well as on the required resources to be able to respond to the current load at a proper time. This way we will ensure quality and control costs.&nbsp;<\/p>\n\n\n\n<p><strong>In sum, testing always looks to provide more information to have less uncertainty and better control over risk. It&#8217;s important to choose metrics that align with business goals and not to rely solely on metrics, as a team&#8217;s commitment to quality is crucial. Furthermore, at Abstracta we like to talk about metrics but also about milestones that the team achieved together.<\/strong><br><\/p>\n\n\n\n<p>Learn more about this topic in <a href=\"https:\/\/www.stickyminds.com\/article\/choosing-right-testing-metrics\">this article<\/a><strong>.<br><\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Reporting\"><\/span><strong>Reporting<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>We test software in order to gather information about the quality and risks, the product, its users, and the conditions of its use. <strong>This information helps our clients to make empirically informed decisions about the product, project, or business. One way of giving visibility to our test results is to share them through test reports.&nbsp;<\/strong><\/p>\n\n\n\n<p>Of course, the purpose of our work is not on documenting, but on delivering working software as the <a href=\"https:\/\/agilemanifesto.org\/\">Agile Manifesto<\/a> says, we want to get the most out of our time spent in reporting. <\/p>\n\n\n\n<p>We are aware that it is not enough to plan a testing strategy and to carry out performance, exploratory, manual, or automated tests carefully; sharing all this with our customers is a must for our team. So we (Abstracta and its customer, as a team, as a collaboration between partners) can be informed and act accordingly.&nbsp;<\/p>\n\n\n\n<p>In this path, <strong>we typically agree on different types of reports according to what\u2019s best for the collaboration between the different parts involved<\/strong>, which could be weekly, quarterly, or with different frequencies and different levels of detail.<\/p>\n\n\n\n<p>We see a test report as an opportunity to stop to reflect, recap on our achievements, celebrate them, and also learn about the process, and the difficulties we had to overcome, in order to continue improving day after day.&nbsp;<\/p>\n\n\n\n<p><strong>When preparing a report you gather more information, from a different perspective, by doing a retrospective analysis. That can lead you to find different opportunities for improvement and discuss them with the team. It\u2019s another opportunity to learn and share these learnings with the rest.&nbsp; <\/strong><br><br>Would you like to know how we create effective test reports? Find out more about this topic in <a href=\"https:\/\/abstracta.us\/blog\/software-testing\/create-effective-test-report\/\">this article<\/a>.<\/p>\n\n\n\n<p>At Abstracta, we provide first-class, holistic testing solutions to continuously deliver quality software. Above all, we know that extraordinary software improves performance, simplifies lives, and transforms communities. We understand the importance of making testing progress visible in order to build trust and long-term relationships with our customers and thus co-create better and better software each day.&nbsp;<br><\/p>\n\n\n\n<p><strong>Take a look at our <\/strong><a href=\"https:\/\/abstracta.us\/blog\/\"><strong>blog<\/strong><\/a><strong> for more content!<\/strong><\/p>\n\n\n\n<p><strong>What are the Responsibilities of a Software Tester? Figure it out in <\/strong><a href=\"https:\/\/abstracta.us\/blog\/software-testing\/what-are-the-responsibilities-of-a-software-tester\/\"><strong>this article<\/strong><\/a><strong>.<\/strong><\/p>\n\n\n\n<p><strong>Follow us on <\/strong><a href=\"https:\/\/www.linkedin.com\/company\/abstracta\/\"><strong>Linkedin<\/strong><\/a><strong> &amp; <\/strong><a href=\"https:\/\/twitter.com\/AbstractaUS\"><strong>Twitter<\/strong><\/a><strong> to be part of our community!<\/strong><br><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Testing efforts can easily go under the radar or be hard to grasp. It&#8217;s important to remember that software testing is not only about running tests: it involves multiple crucial facets that contribute to creating better and better software. In this article, we share with&#8230;<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[593,592,418],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v14.0.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Make Testing Progress Visible | Abstracta<\/title>\n<meta name=\"description\" content=\"Testing efforts can easily go under the radar or be hard to grasp. It&#039;s important to remember that software testing is not only about running tests\" \/>\n<meta name=\"robots\" content=\"index, follow\" \/>\n<meta name=\"googlebot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta name=\"bingbot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Make Testing Progress Visible | Abstracta\" \/>\n<meta property=\"og:description\" content=\"Testing efforts can easily go under the radar or be hard to grasp. It&#039;s important to remember that software testing is not only about running tests\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AbstractaQA\/\" \/>\n<meta property=\"article:published_time\" content=\"2023-02-01T15:41:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T21:19:33+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/abstracta.us\/wp-content\/uploads\/2023\/02\/How-to-Make-Testing-Progress-Visible.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"577\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@fltoledo\" \/>\n<meta name=\"twitter:site\" content=\"@AbstractaUS\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abstracta.us\/blog\/#website\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\",\"description\":\"AI-powered quality engineering\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/abstracta.us\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/abstracta.us\/wp-content\/uploads\/2023\/02\/planification-1024x576.jpg\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/#webpage\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\",\"name\":\"How to Make Testing Progress Visible | Abstracta\",\"isPartOf\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/#primaryimage\"},\"datePublished\":\"2023-02-01T15:41:55+00:00\",\"dateModified\":\"2025-05-05T21:19:33+00:00\",\"author\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/7421e539de0357d3adb0c69ed469a1c2\"},\"description\":\"Testing efforts can easily go under the radar or be hard to grasp. It's important to remember that software testing is not only about running tests\",\"breadcrumb\":{\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/\",\"name\":\"Software Testing\"}},{\"@type\":\"ListItem\",\"position\":3,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/how-to-make-testing-progress-visible\/\",\"name\":\"How to Make Testing Progress Visible\"}}]},{\"@type\":[\"Person\"],\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/7421e539de0357d3adb0c69ed469a1c2\",\"name\":\"Federico Toledo, Chief Quality Officer at Abstracta\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/abstracta.us\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6de7ec6536c4028b5c02ad4ec1b9af0d?s=96&d=blank&r=g\",\"caption\":\"Federico Toledo, Chief Quality Officer at Abstracta\"},\"description\":\"Co-founder and COO of Abstracta\",\"sameAs\":[\"https:\/\/twitter.com\/fltoledo\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/15582"}],"collection":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/comments?post=15582"}],"version-history":[{"count":8,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/15582\/revisions"}],"predecessor-version":[{"id":15657,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/15582\/revisions\/15657"}],"wp:attachment":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/media?parent=15582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/categories?post=15582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/tags?post=15582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}