How are user acceptance tests carried out

The Guide to Top Level User Acceptance Testing!

Finally, as mentioned earlier, your plan needs to define the most comprehensive, intuitive UAT applications available. Let's dive deeper into what these apps could be and how you can use them to make UAT testing successful!

UAT is not just a single thing. It's a series of uses that involve multiple steps and reference sizes.

Risk / requirements management

As you continue your journey to the land of the perfect UAT, you must have some way of knowing if you are heading in the right direction and if there are potholes, heavy traffic, or hazards along the way (as described in Chapter 2). You need a compass, a GPS, i.e. risk / requirements management. UAT applications help define requirements and risks essential to your UAT test trip and allow you to carefully navigate the test project over the bumpiest roads.

UAT applications such as TestMonitor make it easy to deal with large amounts of requirements and risks by organizing them into groups. The users classify the requirements based on different requirement types and can easily prioritize the risks with the classifications provided.

In addition, a Champion UAT tool makes it easy to assign one or more requirements or risks to test cases. The result? The relationships can be automatically adjusted and linked to test runs, test results and errors.

Along the way, you want to be able to filter and analyze test cases, test runs, test results and problems based on these defined requirements and risks. This allows you to focus on the test results that pose the greatest project risk. In addition, you then have an orderly view of the risks that can have the greatest influence on important project requirements.

Test case management

An important tool in your UAT kit is test case management (you can find out more about the details of test cases in the next chapter).

The best UAT applications associate test cases with reusable objects so that you can organize relationships of tests in a more intuitive way.

When planning your test case, ask: "What is the goal? What data and details do we want to find out as a result? And what are the expected results anyway?"

Some general goals for test cases are:

  • Identification of errors - is often seen as the main reason for testing.

  • Assessment of conformity - For example, whether the expected specifications are within acceptable parameters?

  • Discover - the early detection of the highest possible number of errors in order to avoid more serious problems later.

  • Limit of risks - for support managers (especially for "go / no-go" decisions).

Your UAT tool should provide a clear description of the test case purpose that simplifies the expected outcome of the activity. In addition, our tool enables users to define variables or relationships that can be linked to test cases based on criteria such as business process, risk, requirement or application.

Test runs

Test runs enable the user to use the right cases from a test portfolio while avoiding unnecessary tests. Your UAT toolkit optimizes milestones to mark important project events. Test run management tools give you a bird's eye view of all test runs across all timelines and consider regression tests in addition to other legacy test cases. Test runs must be scalable across all relevant devices, Windows, Mac, iOS and Android. Finally, test runs should be customizable so that a user can duplicate any run with a single click.

Results

As with any long journey, it is important to know if the journey was successful - did you get the right route in the right time? UAT applications provide a detailed overview of the test results for each test run. Test managers can focus on specific details within each test case and monitor the results over time for improvement, stability, or worsening.

With the right results-based UAT applications, you will be able to see the latest results per test case and test run. As mentioned earlier, TestMonitor gives you powerful filters that allow you to view the results by milestone, requirement or any other matrix.

An unstable, conflicting outcome can become a bigger concern and needs to be addressed. UAT applications convert critical results into errors (or link them to existing errors). This gives you control when it comes to fixing these errors and planning new tests for verification. We'll explain this topic further in Chapter 6.

error

As mentioned earlier, conflicting results can quickly develop into full-blown problems. However, you are on the safe side with UAT applications like TestMonitor. Such applications include a simple but powerful built-in bug tracking area with filters, prioritization, a full audit trail, attachment handling, comments, and task management. In short, everything you need to deal with bugs.

A powerful concern management tool enables errors to be resolved by breaking them down into manageable tasks for different users. In addition, the team is notified when tasks are completed or assigned. An added bonus is the inclusion of test result attachments related to bugs. With TestMonitor, attachments can also be uploaded using drag and drop.

A concern management solution would be incomplete without a comment function that notifies team members when a user comment appears.

"UAT applications like TestMonitor use built-in reports that provide output for the entire package - requirements, risks, test runs, test results, and problems."

Reports

UAT management applications must provide real-time insight into test status and progress. This includes tracking team-wide workloads with immediate status and progress reports for test runs, test cases and problems that arise.

When reviewing a potential test management application, ask the following questions: Can we view traceability, progress, and coverage reports? Can we view bug reports by status, impact, category, priority, or organization?

First-class reporting options provide important insights into the entire project: strengths, weaknesses and areas for improvement. Intelligent reporting provides real-time insights into test status and progress. In addition, management can track the entire team's workload with real-time status and progress reports for test runs, test cases and issues. UAT applications like TestMonitor use built-in reports that provide overall details about - requirements, risks, test runs, test results and problems. The reports also include the ability to view traceability, progress, and coverage reports. For more information on reports, see Chapter 6.