Experimental Design: for The notations used in representing a design are as follows.
- “X” represents exposure to treatment
- “O” represents Observation
- Time is represented by horizontal arrangement of Xs and Os. e.g. X O1 O2 represents a test unit is exposed to treatment and then observed at two different points in time
- Different time units are arranged vertically e.g.
- History(H): These are specific events external to the experiment, but occurring at the same time and may affect the criterion variable. Sometimes this effect may be subtle or hidden. e.g. In finding the effect of teaching in the class on the performance of student, the effect of any external coaching will cause a history effect.
- Seasonality (Se): Seasonal cycles my affect the criterion in either way. e.g. Increase in sales of fans due toe technical enhancements can be affected by seasonality like in summers the sales will anyways increase.
- Maturation(M): These are changes in test units which are not due to the experimental variable, but result from passage of time. e.e people get older, bored, tired, hungry or distracted.
- Testing: This is related to the fact that experiment itself may affect the responses. These are of two types
- Main testing effect (MT): This comes as a result of respondent’s desire to be consistent
- Interactive testing effect (IT): In this case a prior observation effects the perceptions of the experimental variable.
The results of two testing effects are different. Main testing effect comes when the process of measurement O1 affects O1 or later observation O2 .The interactive testing effect comes when the process of measurement O1 results in a change in the reaction to the experimental stimulus.
- Instrumentation(I): This refers to any or all changes in measuring instruments that might account for differences.
- Statistical Regression (SR): This refers to the tendency of “extreme” cases to move closer to the avaerage during the course of the experiment.
- Selection (S): This arises from the way in which tests units are selected and assigned in an experiment. The equivalence of various groups in an experiment can be established in two ways: Matching and Randomization. Matching isn’t perfect. It’s difficult to match test units on any but a few characteristics and that too on those which are important determinants of the response. Randomization doesn’t have these problems and is generally a preferred approach.
- Mortality (Mo): This refers to loss of test units during the duration of the experiment.
- The one shot case study: The design is denoted as X O i.e. a single group is exposed to experimental variable and the responses are observed. The group is arbitrarily selected and no random assignment. This type of design does not well establish the validity of the causal relationship as it is marred by little control on extraneous variables.
- One group pre-test post-test: The design is denoted as O1 X O2. It adds pretest to above design. The sampling is still convenience and the design fails to control for history, maturation, both the testing effects, statistical regression and mortality etc.
- Static group comparison: The design is denoted as
EG: X O1
(2) True Experimental Designs:
- Before after with control group design: The design is denoted as
EG: (R) O1 X O2
Two groups are used with random assignment (R signifies that). The difference O4 – O3 design reflects effects of extraneous variables. History effect is nullified since we have used two groups. If E represents the effect of experimental variable and and U is due to uncontrolled sources . we see that
O2 – O1 = E + U + IT
O4 – O3 = U
(O2 – O1) – (O4 -O3) = E + IT
So interactive testing effect is still a problem for this type of design.
- Four group six study design: This Solomon’s design is denoted as follows
EG#1: (R) O1 X O2
CG#2: (R) O6
O2 – O1 = E + U + IT
O4 – O3 = U
O5 – 1/2(O1 + O3) = E + U
O6 – 1/2(O1 + O3) = U
[O2 – O1]- [O5 – 1/2(O1 + O3)] = IT
This way the experimental effect and the interactive testing effect can be isolated.
- After only with control group: After all why are the two groups needed in the previous design. Anyways this is getting canceled out. We can straight away use the later two groups and calculate the experimental effect.
EG#2: (R) X O5
CG#2: (R) O6
(3) Quasi Experimental Designs: In these type of designs the stimuli can’t be scheduled appropriately or random assignment in to groups does not just become possible.
- Time Series experiment: This design is denoted as follows.