S60 Smartphone Quality Assurance: A Guide for Mobile Engineers and Developers

Chapter 10: The Testing Environment

Smartphone testing involves quite extensive requirements, in terms of both money and competence, on the equipment and environment needed. In the earlier testing phases, such as module and integration testing, the requirements are mostly competence-related ones such as knowledge of module testing tools and scripts. The later the testing phase is, there is no question that more money needs to be invested in external tools and other elements. Figure 10-1 shows an example of the required elements in an average phone program as far as test equipment and competencies in each testing phase are concerned. For example, the minimum requirement to carry out good and extensive interoperability testing is that there is access to all needed servers and network elements. If the program has administrator access to these elements, so much the better. Owning such a network and servers is very expensive and not vital since all tests can be executed over a publicly available network. The question is how difficult troubleshooting will be without access to the network logs.

Figure 10-1. Phone program needs for equipment and competencies in different test phases.

The testing environment can be divided into two:

• External equipment. Over-the-air (OTA) testing is enabled with different servers. Different tools are required to help, for example, in test execution automation ...