Systems & Software Talk 

http://club.drivenqa.com/forum/topic/show?id=751045%3ATopic%3A11785

For the purpose of review, in my opinion the standard reasons for UAT include and are not limited to:

1. A demonstration of the software for the end users to prove that it meets or exceeds their needs, per the last agreed to sets of requirements.
2. Provide a level of system and software confidence such that the end-user will signoff and accept the software.

How does one start? If you have any of specifications, requirements, system and business use cases you then have some key ingredients as a starting point. Beginning early in the project and then throughout the project you should meet with your customer to develop and/or refine the UAT plan. Remember that this is a demonstration. UAT assumes that the software and systems work as intended. All known defects have been corrected and validated as having been corrected or in some cases, acceptable workarounds are agreed to by the customer and/or workarounds are specified for those issues still being investigated.

What level of details should our scripts have?

The level of detail should be agreeable to the customer, and also have a degree of acceptable reproducibility. Test plan, test scenario, test case, and Pass/Fail criteria ambiguity can make it very difficult to settle disputes especially when issues do surface. Greater relevant detail reduces the probability of dispute especially if the UAT Plan and the trail weaving back through all upstream artifacts is robust and the deliverables upstream are contractually compliant.

Who should be involved in terms of Users?

If there are users who have been directly involved in the development life cycle, from a specification familiarity perspective they may be of great assistance in driving out the UAT plan within the confines of the contractual requirements. Any end-user is certainly capable of being helpful. I have seen Acceptance Tests conducted/witnessed by:

1. End-users,
2. System and/or black box testers, or
3. A mixture of the above, and
4. Possibly more.

Where should this be carried out (On or offsite)? It depends upon the customer’s desires as well as the practicability of the location(s) for the test or tests. If one is conducting operational and acceptance testing of aircraft carrier-borne aircraft landing systems, one would conduct this aboard the aircraft carrier in an area that does not inhibit flight and does not interfere with the surrounding environment. The key thing to consider is that the location faithfully represents the overall system architecture and configuration of the production system such that execution of the UAT plan is not compromised and the operation of the system and its applications is reasonalbe guaranteed. Does that mean the system should be identical to the actual production system? No not necessarily. The bottom line is that the location should not compromise the ability to conduct UAT. Other things to consider are costs and logistics. Which location makes the most sense after giving consideration to the latter? In some cases UAT can be conducted in multiple locations. If it makes sense to do that, then one should do that.

An important concept to consider here is the idea of Qualification Phase Testing or Phased Qualification testing. UAT does not necessarily need to be a big-bang one-shot operation. UAT can actually begin upstream in the development life cycle. How can that be? If there are components that are considered complete and the end-user can certify them as acceptable, why not get sign-off earlier?

What happens if some components require simulation such as credit checks or radar feeds? Assuming the simulations or stubs exist and are planned as part of UAT, the customer would need to approve their use.

The actual facility should facilitate execution of UAT and be free of distraction or other impediment to the process. The hot office gossip items such as Sally and Art’s budding office romance should be kept away. Put them on a hormone regulation treatment pan for the duration of the UAT, and - possibly beyond?? Roberta Rumormill should be required to take vacation during this phase so she can work on her Office Tell All novel. One would also need a couple rolls of Duct Tape for loud and otherwise obnoxious Boisterous Bob. Is there construction going on a the location? If so, Johnny Jackhammer, Davy Drywaller, Paul Painter, Randy Roofer, Willy Welder, Albert Asphalt, and Vince Low-Voltage should be given a few days off. Do people bring their pets to work? This is just not a good idea during UAT. While the sight of Paulina Parrot pooping on an end-user's shoulder, or - biting the main button from a blouse to cause a Janet Jackson wardrobe malfunction may be cute, these may not be part of the UAT plan. Leave the pets at home. One does not want an end-user locked in the grip of a pit bull. On the other hand if the software is on a mobile device that measures the force of a pit bull’s bite, then this would be a use case that should be executed by the customer; unless of course the Duct Tape is not having the desired effect on Boisterous Bob.

Other considerations are as follows. One does not want an end-user going into anaphylactic shock because of exposure to Project Manager Pedro's peanuts or Constance Cologne-overload. While the customer may be impressed with Earl Engineer’s big-air abilities on his skateboard, this may not be in the UAT plan. Skateboards land with tremendous force and can create a bone-crushing experience. Leave the skateboards, roller-blades and unicycles at home. Think about the hazards to safety in the UAT environment. In a automated wood furniture leg-making making shop you would not want Cassie Customer’s 4-foot pony tail to be spun in a lathe. How about what could happen in the paint cell on an automobile manufacturing line? You would not wish to transform your end-users into looking like those under this link (right-mouse opne in new window) - correct? Other hazards might include some self-made VIP walking in with fanfare muttering such nonsense as "Alright, let’s kick the tires on this thing." Call security and have this person escorted out the doors with the pit bull behind.

Ensure participants are bathed or showered and their anti-perspirant is certified up to 110 degrees Fahrenheit. Be professional but have fun!