I’m running some scores over 6 trials with each consecutive trial as its own matched-pair t-test i.e., the answers for test 1 and 2, test 2 and 3, test 3 and 4, test 4 and 5, and test 5 and 6.
I’m also running ANOVA to give a holistic view to the results and I’m also running Tukey as my post-hoc tests. But Tukey is showing that the significant scores from the t-tests are not significant.
I think that I have been very careful with the t-tests because I know when you run it on multiple trials you can easilly make a type I error, but by only looking at the scores from treatment to treatment e.g. the subject’s answers were significantly different between test 3 and 4, there should be some correlation between what the t-tests and Tukey tell me. What’s the difference and if the t-test show significance and Tukey doesn’t, what does that tell me?