{"id":14824,"date":"2022-03-09T16:45:19","date_gmt":"2022-03-09T16:45:19","guid":{"rendered":"http:\/\/abstracta.us\/blog\/?p=14824"},"modified":"2025-05-05T21:25:17","modified_gmt":"2025-05-05T21:25:17","slug":"keys-to-a-successful-continuous-testing-implementation","status":"publish","type":"post","link":"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/","title":{"rendered":"3 Keys to a Successful Continuous Testing Implementation"},"content":{"rendered":"\n<p>Unless you\u2019ve been hibernating for the past decade or two, I\u2019m sure you have already become well aware of the benefits of continuous testing: reduced cost of development, less waste, improved system reliability, reduced risk upon release, and so on. Of course, putting it into practice in the real world is not as simple as some vendors may have you believe. It\u2019s become clear that just having a continuous integration tool configured will not mean that a team successfully achieves continuous testing.&nbsp;<br><\/p>\n\n\n\n<p>Fortunately, we now have more resources than ever to overcome this organizational challenge such as the <a href=\"https:\/\/www.theactframework.com\/\">ACT Framework<\/a>. Not long ago, my team and I also released our <a href=\"https:\/\/abstracta.us\/insights\/guide-continuous-testing\/v\">Ultimate Guide to Continuous Testing<\/a> which is very much in line with the philosophy of the ACT framework. In this post, I\u2019m going to share some key considerations and tips from the guide in order to successfully implement continuous testing.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Assess_Your_Current_Team_Technology_and_Processes\"><\/span>Assess Your Current Team, Technology and Processes<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Any time you are looking to improve the results of software development, it\u2019s necessary to consider three fundamental pillars that are closely linked together: processes, tools and people. Teams can learn continuously and improve by bettering their processes, but the tools they use and the team members themselves must also adapt in order for the new and improved processes to be successful in the long run.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh4.googleusercontent.com\/UhOwnrLcN1e7O7l1nqx98OGaH9BmZKd8soP06p8LjjM46DuOYj8irZfiP-GB0j147f0KQqsb_tcRHN04rlw2zyVbhDQEwsVvx7RCW9K_8dLM73DySsZJ_H-4-8vG2bIixhZhTMXx\" alt=\"\"\/><\/figure>\n\n\n\n<p>A few of the questions to ask here:<\/p>\n\n\n\n<ul><li>Do we have a common understanding of our delivery pipeline? Don\u2019t think of the development pipeline only, but also about how you deliver value to your business&nbsp;<\/li><li>How much of it is automated? Do we have a CI\/CD engine in place?<\/li><li>Do our current testing tools and processes integrate with said pipeline?<\/li><li>Are we missing the expertise required to automate? Should we invest in training? If so, in what?&nbsp;<\/li><li>What are our biggest constraints: time, budget, resources? How can we offset any of these?<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Know_Which_Quality_Factors_Matter_Most\"><\/span>Know Which Quality Factors Matter Most<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>For every team, some quality factors will be more important than others, which is why it is not always necessary or smart to focus on continuous testing for every factor of software quality. For example, if you\u2019re working on a system for a very diverse user group, usability testing may take priority over performance testing. For example, a government system used by citizens to file taxes might require a higher degree of usability and security than performance.&nbsp;<br><\/p>\n\n\n\n<p>According to the <a href=\"https:\/\/abstracta.us\/blog\/software-testing\/software-testing-wheel\/\">ISO 25010 standards for software product quality<\/a>, there are eight software quality properties: functional suitability, performance efficiency, compatibility, usability, reliability, security, maintainability and portability. For each, you have the corresponding set of tests to assess its level of quality.&nbsp;<br><\/p>\n\n\n\n<p>Evaluate with your team which are the biggest areas of concern regarding software quality for users and stakeholders. What are the worst case scenarios in which, if something were to break, it would cause the greatest damage? These are the risks that must be addressed first. With a limited number of weeks, days or maybe even hours for testing between releases, <strong>following a risk-based approach will help to make it clear what is worth prioritizing.&nbsp;<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Map_Your_Route_to_Continuous_Testing\"><\/span>Map Your Route to Continuous Testing<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>There are several quality areas to focus on that will help you in your efforts to reach an efficient continuous testing program, encompassing shift-left and shift-right testing.&nbsp;<br><\/p>\n\n\n\n<p>In the chart below describing three testing maturity levels (basic, efficient, and continuous), you can see how the management of different quality aspects from the source code, environments, test automation, etc. need to be set up in order to pull off continuous testing. For example, before you have CI\/CD in place, you must first implement source code versioning.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh5.googleusercontent.com\/2beilmFt7jDofUYrc0Mv8uTXh011W2wZFlWEtfG6IIKgmF8Y-OVYOTqf6pqGQTL55GBd_BqGE69nTdcO4T82Q6lDbGUmR13wM3-keKgHhzckFdWAPzcmiEkm1XADpiYvqloD8ukD\" alt=\"\"\/><\/figure>\n\n\n\n<p>I encourage you to use this chart as a reference to review where your team stands in the nine different quality areas. Going across the rows from top to bottom, contemplate with your team members if you are handling each given area in a way that is characterized by basic, efficient, or continuous testing.&nbsp;<br><\/p>\n\n\n\n<p>From there, you can make a plan of action to progress upwards in these maturity levels, achieving continuous testing. Tackle which areas need to be improved first, the most critical ones that underpin the next steps toward continuous testing and also the properties of software quality that your team has determined to be most critical.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Planning_for_Success\"><\/span>Planning for Success<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>As the old saying goes, \u201cfailing to plan is planning to fail.\u201d Before going gung-ho with continuous testing, automating everything that is capable of being automated, it\u2019s wise to first have things clear about what success should look like, given your team\u2019s context and business goals. It\u2019s okay if your team makes some mistakes along the way, and it won\u2019t happen overnight that your continuous testing is a well-oiled machine!&nbsp;<br><\/p>\n\n\n\n<p>Remember to first understand your organization\u2019s goals as well as its people, process, and tools. Know the risks that are most important to mitigate with continuous testing and build a concrete, realistic plan of action from there.&nbsp;<\/p>\n\n\n\n<p><br>Follow us on <a href=\"https:\/\/www.linkedin.com\/company\/abstracta\/\"><strong>Linkedin<\/strong><\/a><strong>, <\/strong><a href=\"https:\/\/www.facebook.com\/AbstractaSoftwareTesting\"><strong>Facebook<\/strong><\/a><strong>, <\/strong><a href=\"https:\/\/twitter.com\/AbstractaUS\"><strong>Twitter<\/strong><\/a><strong>, and <\/strong><a href=\"https:\/\/www.instagram.com\/we_are_abstracta\/\"><strong>Instagram<\/strong><\/a><strong> to be part of our community!<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Unless you\u2019ve been hibernating for the past decade or two, I\u2019m sure you have already become well aware of the benefits of continuous testing: reduced cost of development, less waste, improved system reliability, reduced risk upon release, and so on. Of course, putting it into&#8230;<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[431,466,417,463],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v14.0.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>3 Keys to a Successful Continuous Testing Implementation | Abstracta<\/title>\n<meta name=\"description\" content=\"In this post, we&#039;ll be sharing some key considerations and tips from our guide in order to successfully implement continuous testing.\" \/>\n<meta name=\"robots\" content=\"index, follow\" \/>\n<meta name=\"googlebot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta name=\"bingbot\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"3 Keys to a Successful Continuous Testing Implementation | Abstracta\" \/>\n<meta property=\"og:description\" content=\"In this post, we&#039;ll be sharing some key considerations and tips from our guide in order to successfully implement continuous testing.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AbstractaQA\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-03-09T16:45:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T21:25:17+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/abstracta.us\/wp-content\/uploads\/2022\/03\/Abstracta_Blog_-_Portada_3_Keys_to_a_Successful_Continuous_Testing_Implementation__Feb_22.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"338\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@fltoledo\" \/>\n<meta name=\"twitter:site\" content=\"@AbstractaUS\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abstracta.us\/blog\/#website\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Blog about AI-powered quality engineering for teams building complex software | Abstracta\",\"description\":\"AI-powered quality engineering\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/abstracta.us\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/lh4.googleusercontent.com\/UhOwnrLcN1e7O7l1nqx98OGaH9BmZKd8soP06p8LjjM46DuOYj8irZfiP-GB0j147f0KQqsb_tcRHN04rlw2zyVbhDQEwsVvx7RCW9K_8dLM73DySsZJ_H-4-8vG2bIixhZhTMXx\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/#webpage\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\",\"name\":\"3 Keys to a Successful Continuous Testing Implementation | Abstracta\",\"isPartOf\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/#primaryimage\"},\"datePublished\":\"2022-03-09T16:45:19+00:00\",\"dateModified\":\"2025-05-05T21:25:17+00:00\",\"author\":{\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/7421e539de0357d3adb0c69ed469a1c2\"},\"description\":\"In this post, we'll be sharing some key considerations and tips from our guide in order to successfully implement continuous testing.\",\"breadcrumb\":{\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/\",\"url\":\"https:\/\/abstracta.us\/blog\/\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"position\":2,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/\",\"name\":\"Software Testing\"}},{\"@type\":\"ListItem\",\"position\":3,\"item\":{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\",\"url\":\"https:\/\/abstracta.us\/blog\/software-testing\/keys-to-a-successful-continuous-testing-implementation\/\",\"name\":\"3 Keys to a Successful Continuous Testing Implementation\"}}]},{\"@type\":[\"Person\"],\"@id\":\"https:\/\/abstracta.us\/blog\/#\/schema\/person\/7421e539de0357d3adb0c69ed469a1c2\",\"name\":\"Federico Toledo, Chief Quality Officer at Abstracta\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/abstracta.us\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6de7ec6536c4028b5c02ad4ec1b9af0d?s=96&d=blank&r=g\",\"caption\":\"Federico Toledo, Chief Quality Officer at Abstracta\"},\"description\":\"Co-founder and COO of Abstracta\",\"sameAs\":[\"https:\/\/twitter.com\/fltoledo\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/14824"}],"collection":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/comments?post=14824"}],"version-history":[{"count":2,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/14824\/revisions"}],"predecessor-version":[{"id":14847,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/posts\/14824\/revisions\/14847"}],"wp:attachment":[{"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/media?parent=14824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/categories?post=14824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abstracta.us\/blog\/wp-json\/wp\/v2\/tags?post=14824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}