No Pain, No Gain: Early Test Automation Is Worth The Effort

Starting test automation in parallel with code development is challenging, but the benefits make it worthwhile.

The topic of test automation always sparks discussion and debate. Developers love the idea, but when it comes time to implement, it rarely receives the attention it deserves. In this article we’re going to look at common challenges to overcome when you try to shift test automation upstream, and discuss the benefits that make it all worthwhile.

Change the mindset

There’s no doubt that earlier implementation of test automation in the development process can be time-consuming and fraught with complexity. It’s very important to secure the buy-in of development, operations, and QA. This cannot be the sole responsibility of testers. Everyone has to work together to build a solid foundation and establish realistic expectations.

Test automation will lessen the manual testing burden, and automated tests can be run unattended, but this isn’t just about functional and regression testing through the user interface. By introducing automation earlier, you can cover the low level and introduce unit tests, as well as integration, API, database, and services testing. Starting automated testing in parallel with development can help to reduce dependency on the UI.

For this to be successful, your processes will have to change to accommodate it. You may need to break down requirements further, introduce new coding practices, and tweak your design process. You’ll also need stable interfaces for both the back-end and the front-end to ensure minimal disruption to existing automated tests.

Build a robust test automation foundation

Traditionally, test automation has supported regression testing. Making it work in an agile environment requires a whole new set of tools and approaches. There’s no one-size-fits-all solution here. Don’t waste time seeking the perfect tool to cater for all of your needs, because there probably isn’t one. What you need to do is look at the best tool for each automation type and then work on building a solid framework that pulls them all together.

Even once you have the right tools in place, you still need your testers and developers to work closely together to construct a good framework and agree on the right processes. If you find that the majority of your tests have to be rewritten after each sprint, then you may need to reexamine your test automation foundation and improve on it.

Identify the right automation strategy

It’s not possible, or desirable, to automate every test. Finding the right balance of manual testing and test automation is one of the biggest challenges you face. Some tests will not be cost effective to automate, there may be conflicts with the tools you’re using or your framework.

Identifying suitable candidates for test automation is essential, and it requires a good understanding of the project, the tools at your disposal, and the test coverage expectations. It’s not a one-off job, either. Reviewing your automation suite to remove unnecessary tests and add new ones will be a regular ongoing task.

It’s a good idea to start small and scale up when everything is working well. Begin with a small investment and see what kind of effort is involved and what the outcome is before ramping up your automation plans. This also gives the team room and opportunity to try things, make mistakes, and design even better approaches.

Enjoy the benefits

The challenges can be daunting, but the conventional benefits of automation are obvious: tests can be run faster, consistently, and they can be repeated as many times as needed with minimal overhead. But there are some other, subtler benefits worth bearing in mind.

Improved velocity – As stress levels rise towards the end of development, automation can provide peace of mind about the code quality. It acts as a kind of safety net. And when developers are confident that code changes won’t introduce lots of errors, they’re free to really focus on each sprint goal.

Greater coverage – Early automation can save a great deal of time down the line and result in much more comprehensive test coverage. By shortening the feedback loop, test automation boosts your chances of finding serious defects earlier and fixing them before they become embedded. It also frees up experienced testers to explore new areas of functionality and focus where they can provide the most value.

Higher reliability – Today’s business environment demands high quality software. Early test automation is the most effective way to build confidence in the software being developed, and the more comprehensive the testing is, the greater the quality. Automation also drastically reduces the risk of human error, ensures that key business workflows are fully covered, and minimizes the risk of critical bugs reaching production.

It may not be easy to implement, but test automation can deliver tangible benefits, and represent an excellent return on investment for any organization.

Source:

KMS Technology Inc. blog at www.kms-technology.com/blog/

About the author:

Vu Pham is QA Manager at KMS Technology, a software development and testing services firm based in Atlanta, GA and Ho Chi Minh City, Vietnam. He has been among the creators of Katalon Studio, a powerful web and app automation tootset. Contact him at vupham@kms-technology.com.