B. Developing Ideas

• Testing Methods - How you will test the design specifications to ensure they are successful. 

• Success Criteria - What quantifiable measurement (number or percentage) would you consider needing to meet in order for your product to be successful? (i.e. 3 / 4 or 75%)

Note that when you test a product, you typically use one of the following methods: 

• Survey of people’s opinion’s - what questions would be asked, set up the form or template  (subjective)

• Timing how long an operation takes - what data would be collected and how to record it (objective)

• Checklist for Visually or aurally inspecting final product - Spreadsheet with list of what is to be observed etc (subjective)

• Observation of users to see how quickly they learn to use the new system, how often they need help or make errors (subjective)

• Stress-testing: Use the product or solution in ways that would be expected in real-life operation (objective or subjective)

• Inspection: Weigh it or measure it - Specification table with tolerances (objective)

• Comparison: Comparing the product with existing products in the marketplace noting strengths and weaknesses (objective or subjective)

Testing Methods / Focus Groups

How will you test if your specification was a success? Typical testing methods include:

• Survey of people’s opinion’s - what questions would be asked, set up the form or template  (subjective)

• Timing how long an operation takes - what data would be collected and how to record it (objective)

• Checklist for Visually or aurally inspecting final product - Spreadsheet with list of what is to be observed etc (subjective)

• Observation of users to see how quickly they learn to use the new system, how often they need help or make errors (subjective)

• Stress-testing: Use the product or solution in ways that would be expected in real-life operation (objective or subjective)

• Inspection: Weigh it or measure it - Specification table with tolerances (objective)

• Comparison: Comparing the product with existing products in the marketplace noting strengths and weaknesses (objective or subjective)

Survey with Design Specifications

This survey is a good example of how you could test your ideas or concept sketches with a sample group of your target audience. 

Typical testing methods include: