Experimental vs Design

A Comparison of the Scientific Method and the Design Process 

From http://cpsscifair.org/

Most projects will be experimental in nature using the scientific method and will fall into the experimental category. However, if the objective of your project is to invent a new device, procedure, computer program, or algorithm, then your project may fall into the design category. 

Scientific Method 

Design Process 

IDENTIFY AND WRITE A TESTABLE QUESTION 

Decide what question you want to answer or what problem you want to solve. A testable hypothesis is answered through observations or experiments that provide evidence. Be sure to have adequate technical and financial resources available to conduct your research. State your objective clearly in writing. 

DEFINE A NEED OR REAL WORLD PROBLEM

Instead of stating a question, state a need. Can you describe in detail a problem that your design will solve? Does your research relate to a real world need? 

PERFORM BACKGROUND RESEARCH 

Before you begin your project, you must become as knowledgeable as you can about your topic and about other research that has been done on that topic. You may use books, scientific literature, the Internet, or interviews with scientists or other knowledgeable people. This research not only helps you get ready to conduct your experiment, but will form the background for the Review of Literature required in your report. 


PERFORM BACKGROUND RESEARCH 

For a design project, the background research may include: 

You may use books, scientific literature, the Internet, or interviews with scientists or other knowledgeable people. This research not only helps you get ready to conduct your experiment, but will form the background for the Review of Literature required in your report.

FORMULATE A HYPOTHESIS AND IDENTIFY VARIABLES

Based on the background research, write a statement that predicts the outcome of the experiment. Many hypotheses are stated in an “If... then” statement where the “If” statement pertains to the independent variable, and the “then” statement pertains to the dependent variable. For example: ‘If plants are grown under various colors of light, then the plants grown under the blue and red lights will show the greatest increase in biomass.’   

ESTABLISH DESIGN CRITERIA  

Engineering Projects: Decide what features your design must have, for example: size, weight, cost, performance, power, etc. Perhaps include a table showing how each design criterion will be addressed by the features of the product being designed. 

Computer Science Projects: Creating or writing a new algorithm to solve a problem or improve on an existing algorithm. Discuss the criteria of the algorithm. 

Mathematics Projects: Proofs, development of a new model or explanation, concept formation or mathematical model design. 

DESIGN AN EXPERIMENT, ESTABLISH A PROCEDURE

 Decide what data you need to meet your research objective and how you will collect it. Be sure to consider possible hazards in your experimental approach and decide how you can conduct your research safely. In addition, there are special rules concerning the use of human and non-human vertebrates in your research. Be sure to consult these rules before finalizing your experimental design. 

In order to obtain valid experimental results, consider the following items when designing the experiment: 

Be sure to establish deadlines for completing the different phases of your research. These phases might include building equipment, collecting data, analyzing the results, writing the report and construction your display board. Remember to use metric measurements whenever possible. 

PREPARE A PRELIMINARY DESIGN 

Engineering projects should have a materials list, programming and mathematical projects do not need a materials list. Projects should include a block diagram, flowchart or sketch of the design that shows all of the parts or subsystems of the design. Describe how all of the parts of the design will work together. 


CONDUCT THE EXPERIMENT 

Follow your experimental design to collect data and make observations. Be sure to keep a log as you conduct the experiment to record your data, any problems you encounter, how you addressed them, and how these problems might have affected your data. This log will be used when you write your report. Keep these points in mind when conducting your experiment: 

BUILD AND TEST A PROTOTYPE 

(Programs, algorithms, and mathematical models may be considered prototypes) 

When others are conducting their experiment, investigators doing an engineering, computer programming, or mathematics project should be constructing and testing a prototype of their best design. For example, you may involve targeted users in your testing to get feedback on your design; or some projects may analyze data sets. 

ANALYZE THE RESULTS AND DRAW CONCLUSIONS 

Make sufficient calculations, comparisons and/or graphs to ensure the reliability and repeatability of your experiment. In what way does this analysis confirm or refute) your hypothesis. What conclusion(s) can you draw from this analysis? 


REDESIGN AND RETEST       

Evidence that changes in design were made to better meet the performance criteria established at the beginning of the project. Test results may be included in tables, if applicable. Data analysis/validation may also be a part of this step. 


REPORT THE RESULTS

Your report should provide all the information necessary for someone who is unfamiliar with your project to understand what you were trying to accomplish, how you did it, and whether you succeeded. It should be detailed enough to allow someone else to duplicate your experiment exactly. Be sure to include charts and graphs to summarize your data. The report should not only talk about your successful experimental attempts, but also the problems you encountered and how you solved them. Be sure to explain what new knowledge has been gained and how it leads to further questions.

REPORT THE RESULTS      

Your report should provide all the information necessary for someone who is unfamiliar with your project to understand what you were trying to accomplish, how you did it, and whether you succeeded. The report should not only talk about your successful design attempts, but also the problems you encountered and how you solved them. Be sure to explain what new knowledge has been gained and how it leads to further questions.