Solutions and Activities
With the aim of facing this huge challenge successfully, we developed a holistic testing
strategy that encompassed multiple types of testing, from functional and usability
to
exploratory and performance.
Initiating our engagement, our team set up collaborative sessions with the bank's
electronic
channels, technology teams, and their software provider. These discussions were pivotal in
grasping the functionalities that required testing.
We crafted test cases in Microsoft Excel and employed Azure DevOps Server (formerly
Microsoft TFS) to manage incident reports. Our focus was on functional and usability
testing
across various browsers, operating systems, and devices, prioritizing areas most crucial to
users.
Operating in an independent testing environment, yet with access to production services, our
team fine-tuned user profiles through BackOffice and related applications. Post-completion
of all test cases, we engaged in exploratory testing, aiming to widen our test
coverage,
especially in business-critical areas.
Our performance testing phase involved simulating diverse user load scenarios. We
focused on
pre- and post-release environments, fine-tuning our approach to mitigate risk. Notably, our
load testing under peak user conditions offered valuable insights for enhancing the system's
performance.
Here we share some key insights from our load testing:
- The system’s capacity to handle up to 75% of the anticipated peak user load in an hour,
with an error rate under 14%.
- Identification of higher response times in critical functionalities, including login
steps.
- An observable increase in response times concurrent with user load spikes.
- Discovery and rectification of database deadlocks during the testing process.