Statistical significance and replicability - Response to Chow's and Falk's commentary

Journal/Book: Theor Psychol. 1998; 8: 2455 Teller Rd, Thousand Oaks, CA 91320. Sage Publications Inc. 331-334.

Abstract: Commentators agree with me that statistical significance does not betoken replicability, but not for the reasons I give. Chow (1998) defends the use of significance tests by arguing that they are useful for assessing the role of chance in findings. I dispute this by pointing out that the Type II error rate may be as high as 1 - alpha. Falk (1998) defends Bayesian inference, which was impugned by me. She also makes a case for the use of replications for the purpose of testing hypotheses. I complain that the supporters of Bayesian inference have not explained adequately what its purpose or role in science is, and for this reason it is an impediment to understanding in this area. I also dispute Falk's view of the role of replications in that I would require a successful replication to be one that produces an effect that is clearly discernible, meaning the effect is consistently noticeable with the aid of nothing more than descriptive statistics.

Note: Editorial Sohn D, Univ N Carolina, Dept Psychol, Charlotte,NC 28223 USA

Keyword(s): hypothesis testing; statistical significance

Zurück | Weiter