Equivalence Hypothesis Testing in Experimental Software Engineering

José Javier Dolado, Mari Carmen Otero and Mark Harman

 

 

  Crossover Repeated Measures
Trial1 trial1crossover.S0
trial1crossover.S1		 trial1repmeasureANOVA.S0
trial1repmeasureANOVA.S1
Trial1X trial1Xcrossover.S0
trial1Xcrossover.S1		 trial1XrepmeasureANOVA.S0
trial1XrepmeasureANOVA.S1
Trial2 trial2crossover.S0
trial2crossover.S1		 trial2repmeasureANOVA.S0
trial2repmeasureANOVA.S1
Trial2Scaled trial2crossoverScaled.S0
trial2crossoverScaled.S1		 trial2repmeasureANOVAScaled.S0
trial2repmeasureANOVAScaled.S1

 

 

  Dependent variable Cross-over T-test Repeated Measures ANOVA
  Equivalence α=0.05 (CI-90%) Equivalence α=0.1 (CI-80%) α=0.05 α=0.1
Trial1 TIME
SCORE		 TimeTrial1_0,05.rtf
ScoreTrial1_0,05.rtf		 TimeTrial1_0,1.rtf
ScoreTrial1_0,1.rtf		 ScoreTimeTrial1_0,05.rtf ScoreTimeTrial1_0,1.rtf
Trial1X TIME
SCORE		 TimeTrial1X_0,05.rtf
ScoreTrial1X_0,05.rtf		 TimeTrial1X_0,1.rtf
ScoreTrial1X_0,1.rtf		 ScoreTimeTrial1X_0,05.rtf ScoreTimeTrial1X_0,1.rtf
Trial2 TIME
SCORE		 TimeTrial2_0,05.rtf
ScoreTrial2_0,05.rtf		 TimeTrial2_0,1.rtf
ScoreTrial2_0,1.rtf		 ScoreTimeTrial2_0,05.rtf ScoreTimeTrial2_0,1.rtf
Trial2Scaled TIME
SCORE		   TimeTrial2_Scaled_0,1.rtf
ScoreTrial2_Scaled_0,1.rtf		   ScoreTimeTrial2_Scaled_0,1.rtf

 

 

  Dependent variable α=0.05 α=0.1
Trial1 TIME
SCORE		 NTimeTrial1_0,05.rtf
NScoreTrial1_0,05.rtf		 NTimeTrial1_0,1.rtf
NScoreTrial1_0,1.rtf
Trial1X TIME
SCORE		 NTimeTrial1X_0,05.rtf
NScoreTrial1X_0,05.rtf		 NTimeTrial1X_0,1rtf
NScoreTrial1X_0,1.rtf
Trial2 TIME
SCORE		 NTimeTrial2_0,05.rtf
NScoreTrial2_0,05.rtf		 NTimeTrial2_0,1.rtf
NScoreTrial2_0,1.rtf