New features have been added for the current release of a SUT.
Which action would NOT be appropriate for the TAE to perform when evaluating the impact on the TAS?
You are working on a TAS for standalone application. The automated tests are developed based on a automation framework that allows interaction with GUI elements using on object orientated API. The GUI elements include menus, buttons, radio buttons, text toolbars and their properties.
Whilst automating a test, you have discovered that the GUI elements of some third party components are not identifiable by the automated tool you are using.
Which of the following is the FIRST step that you take to investigate this issue?
You are testing a major enhancement to an air traffic control user interface. You have use of a sophisticated pre-production test environment, created specifically for large scale automated regression, performance and security testing. The window for regression testing is limited and
must successfully conclude, with no major regressions remaining, before the non-functional testing starts.
You have been using the same version of the TAS for the last few releases, each time completing the automated regression test suite in a single overnight run. However, due to the latest enhancements for the SUT, you believe there is a risk that the test suite may no longer complete
overnight and therefore delay performance and security testing.
Which option would be the BEST and MOST cost-efficient approach to mitigate this risk?
Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test case as either 'pass' or 'fail' and has excellent recovery capability built in.
For the third sprint, the TAS log reported several test cases with a status of 'fail'. You investigated each test case and found that most failures were due to a defect in one of the keyword scripts, rather than in the SUT. For those where the failure was in the SUT, defect reports were raised but several were returned by the developers asking for more information to enable them to reproduce the problem.
Which additional log items SHOULD you add to the TAS that would BEST improve failure analysis and defect reporting for future sprints?
a) Dynamic measurement information about the SUT.
b) A status of TAS error’, in additional to pass' and 'fail', for each test case.
c) Use of a colour coding scheme so that 'pass’ is in red and fail' is in green.
d) A counter to determine how many times each test case has been executed.
e) System configuration information including software/firmware and operating system versions.
f) A copy of the source code for all Keyword scripts executed.
You have executed an automated test suite for a product that was released into production. Although all the tests passed, there was a major failure in production in an area that was covered well by your automated tests.
You have run the automated tests again and one of the tests is now failing and this is directly related to the production defect that was raised. You decide to run the automated test suite again on the same version of the SUT and the test now passes.
What SHOULD you do now to verify the validity of the automated tests?
A regression test suite consist of 500 test cases which are all executed manually. The business case for a pilot project is based on the adoption of test automation using a commercial tool that will reduce the execution time by a factor of 90% for 100% of the tests in the regression test suite. The pilot project lasted one month ( as planned) and you are currently its results. At the end of the pilot project, 40% of the regression tests have been automated and their execution time has been reduce by 60%.
Which of the following statements is TRUE in this scenario?
The GUI of a Customer Relationship Management (CRM) application has been delivered through internet Explorer with proprietary Active X and Java controls. This implementation enables rich client capabilities, but specific commercial automation tools are necessary to automate test cases at GUI of functional test cases. This is to demonstrate whether a small set of the commercial are able to properly recognize actions taken by a tester when interacting with GUI of the CRM application.
Which of the following scripting techniques would be MOST suitable in this scenario?
Your organisation has successfully implemented a Test Automaton Solution (TAS) for a new project which has since been delivered into production via a number of sprints. A series of maintenance releases are now planned.
Some improvements were made to the Test Automation Architecture (TAA) as a result of feedback from the early sprints. The TAA improvements affected the TA, and the TAS was changed for the final sprint.
The new version of the TAS was generally well received but some performance and usability issues were encountered with the TAS which have yet to be addressed.
The test automation engineers supporting the maintenance releases must decide whether to use the enhanced TAS or the version that was used successfully for previous sprints.
What is the BEST action to take next?
A project consists of distributed teams working in a 24-hour environment, where activities happen at all hours of the day. This project adopts a CI (Continuous Integration) process when developer check-in code and consists of automated activities that include generating a build and deploying it to a test environment. Automated integration tests are run multiple times a day. The project have asked for a report containing the automation test results for every build, which must be available 24/7 to the project team.
Which of the following would be the BEST way to automatically provides this report?
A major component of your organisation's Test Automaton Solution (TAS) is a popular open-source third-party capture-replay tool for automated functional testing.
Which two of the following must the Test Automation Engineer (TAE) ensure happens for this TAS?
a) The third party tool is placed under configuration management control.
b) The annual support and maintenance costs are agreed with the tool's vendor.
c) It is Important to obtain information about updates and new versions of the tool so that the third party tool is kept up to date.
d) Ensure that the TAS test scripts are integrated into the tool's framework.
e) Ensure that no changes are made to the tool, because modifications are not allowed for third party products.
When if the BEST time for automation to consider legal and/or standard requirements for a SUT?
As a TAE you are evaluating a functional test automation tool that will be for several projects within your organization. The projects require that tool to work effectively and efficiently with SUT’s in distributed environments. The test automated tool also needs to interface with other existing test tools (test management tool and defect tracking tool.) The existing test tools subject to planned updates and their interface to the test automated tool may not work property after these updates.
Which of the following are the two LEAST important concerns related to the evaluation of the test automation in this scenario?
Does the test automation tool need to install specific libraries that could impact the SUT?
You are working as a TAE for a company who are re-designing their website. The new website provides information for customers and there are two minor features being developed:
1) Request a newsletter
2) Ability to contact the organisation with a question or comment
The website must be “mobile friendly" and available on all major web browsers.
You have been tasked to provide an automated solution for web browsers only and to concentrate on the two minor features.
What would be a KEY challenge with automation in this context?
Consider a TAS that is going to be deployed for the first time. The TAS requires share resources and run it its own test environment. The infrastructure for the TAS has been created along with maintenance procedures. It is very unlikely the TAS will be required to work in other target
Environments. There is a high-risk that when the TAS is deployed in its own test environment, a number of existing application will no longer work because of conflicts with the existing shared resources.
Which of the following activities would you expect to be MOST effective at mitigating the risk associated with the first deployment of the TAS?
You have been asked to automate a set of functional tests at system Test level via the CLI of the SUT for the first release of a software system. The automated tests will be delivered to the learn in change of maintenance testing, who will use them for part of the regression testing. They have the following requirements.
1. The automated tests must be as fast and cheap to maintain as possible
2. The cost of adding new automated tests must be as low as possible
3. The automated tests must have a high level of independence from the tool itself
Which of the following scripting techniques would be MOST suitable?
Which of the following statement about the implementation of automated regression testing is FALSE?
You have implemented a keyword-driven scripting framework, which uses a test execution tool to run the tests. This has been in use for the past year and all of the teams now use this framework as the standard approach for test execution.
The teams all work on different aspects of the SUT and they have all experienced significant benefits in the use of this scripting framework. However, on closer examination, you have discovered that there are numerous instances where the teams have the same functionality to test but are using different keywords.
One of your objectives for improvement is to create consistency among the teams.
What is the BEST way to handle this situation?
Your goal is to verify completeness, consistency and correct behavior of an automated test suite. The TAS has been proven to successfully install in the SUT environment. All the preliminary checks to verify the correct functioning of the automated test environment and test tool configuration, installation and setup have successfully completed.
Which of the following is NOT a relevant check for achieving your goal in this scenario?