Random versus nonrandom assignment in controlled experiments: Do you get the same answer?

Author(s): Ragsdale, K.

Journal/Book: J Consult Clin Psychol. 1996; 64: 750 First St NE, Washington, DC 20002-4242. Amer Psychological Assoc. 1290-1305.

Abstract: Psychotherapy meta-analyses commonly combine results from controlled experiments that use random and nonrandom assignment without examining whether the 2 methods give the same answer. Results from this article call this practice into question. With the use of outcome studies of marital and family therapy; 64 experiments using random assignment yielded consistently higher mean posttest effects and less variable posttest effects than 36 studies using nonrandom assignment. This difference was reduced by about half by taking into account various covariates, especially pretest effect size levels and various characteristics of control groups. The importance of this finding depends on(a) whether one is discussing meta-analysis or primary experiments, (b) how precise an answer is desired. And (c) whether some adjustment to the data from studies using nonrandom assignment is possible. It is concluded that studies using nonrandom assignment may produce acceptable approximations to results from randomized experiments under some circumstances but that reliance on results from randomized experiments as the gold standard is still well founded.

Note: Review Shadish WR, Univ Memphis, Dept Psychol, Memphis,TN 38152 USA

Keyword(s): BEHAVIORAL MARITAL-THERAPY; META-ANALYSIS; UNIPOLAR DEPRESSION; COGNITIVE THERAPY; COUPLES THERAPY; FAMILY-THERAPY; METAANALYSIS; EFFICACY; PSYCHOTHERAPY; CHILDREN

Zurück | Weiter