A Methodological Bibliography


2015-07-15 15.53.02

Department of Psychology, University of Arizona

For both current and future researchers, it is important to keep abreast of the ever-changing research methodology literature. To help facilitate this endeavor, members of EGAD have formulated an initial bibliography containing a combination of journal articles and chapters pertaining to methodological concerns that we highly recommend for every methodologist’s library. In addition to the fifty articles, ten essential books are included.

This initial attempt to identity the most useful and pertinent pieces of methodological literature is certainly open to critique. Ultimately, our goal is to develop a revised list that more closely represents the recommendations of our readers and colleagues. As with any research, given the chance for error, it is likely that we have committed both Type I errors (omission) or Type fl errors (commission). Therefore, we invite our readers to submit references that they believe merit inclusion in the EGAD’s Top Fifty list. For each article recommended, though, we need a recommendation for the article (or book) to be dropped. We emphasize that the purpose is heuristic and to have a list of diverse, interesting articles with no implication that articles not on the list are inferior in any way. In addition, we welcome any comments regarding the usefulness of the readings for instructional and research purposes. Let us hear from you!



Chamberlin, T.C. (1965). The method of multiple working hypotheses. Science, 148, 754-759.

Chen, H.T., & Rossi, P.H. (1987). The theory-driven approach to validity. Evaluation and Program Planning, 10,95-103.

Einhorn, H.J., & Hogarth, R.M. (1986). Judging probable cause. Psychological Bulletin, 99, ~19.

Platt, J.R. (1964). Strong inference. Science, 146(3642), 347-352.



Cook, T.D., & Campbell, D.T. (1979). Quasiexperimentation: Design & analysis issues for field settings. Boston: Houghton-Mifflin.

Webb, E., Campbell, D.T., Schwartz, R.D., Sechrest, L., & Grove, J. (1981). Nonreactive measures in the socialsciences. Boston: Houghton Mifflin.




Kazdin, A.E. (1981). Drawing valid inferences from case studies. Journal of Counseling and clinical Psychology,49(2), 18~192.

Runyan, W.M. (1982). In defense of the case study method. American Journal of Psychiatry, 52(3), 440-446.



Campbell, D.T. (1969). Reforms as experiments. American Psychologist, 24,409-428.

Campbell, D.T., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitraltmultimethod matrix.Psychological Bulletin, 56, 81-105.

General Accounting Office (1987). Case study evaluation.

Program Evaluation and Methodology Division, Transfer Paper 9). Washington DC: United States General Accounting office, April.



Bateman, T.S., Karwan, K.R., & Kazee, T.A. (1983). Getting a fresh start: A natural quasi-experimental test of the performance effects of moving to a new job. Journal of Applied Psychology, 68(3), 517-524.

Guttman, L. (1977). What is not what in statistics. The Statistician, 26(2), 81-107.

Richards Jr., J.M. (1982). Standardized versus unstandardized regression weights. Applied Psychological Measurement, 6(2), 201-212.

Rodgers, J.L., & Nicewander, W.A. (1988). Thirteen ways to look at the correlation coefficient. The American Statistician, 42, 59-66.


Ferketich, S.L., Figueredo, AJ., & Knapp, T.R. (1991). The multitrait-multimethod approach to construct validity.Research in Nursing and Health, 14, 315-320.

Figueredo, AJ., Ferketich, S.K., & Knapp, T.R. (1991). More on MTMM: The role of confirmatory factor analysis.Research in Nursing and Health, 14,387-391.


Figueredo, A.J., Hetherington, J., & Sechrest, L. (1992). Water under the bridge: A response to Bingham, Heywood, and White. Evaluation Review, 16(1), 40-62.

Gottfredson, G.D. (1979). Models and muddles: An ecological examination of high school crime rates. Journal of Research in Crime and Delinquency, 16,307-331.

Hayes, R.D. Widaman, K.F. DiMatteo, M.R, & Stacy, A.W. (1987). Structural-equation models of current drug use: Are appropriate models so simple? Journal of Personality and Social Psychology, 52(1), 134-144.

Rogosa, D., Brandt, D., & Zimowski, M. (1982). A growth-curve approach to the measurement of change.Psychological Bulletin, 92, 72-748.

Sutcliffe, J.P. (1980). On the relationship of reliability to statistical power. Psychological Bulletin, 88(2),509-515.


Bentler, P.M. (1985). Theory and implementation of EQS: A structural equations program. Manual for ProgramVersion 2.0, with additions for Version 2.1. Los Angeles, CA: BMDP Statistical Software, Inc.

Gorsuch, R.L. (1983). Factor Analysis, (2nd ed). New Jersey: Lawrence Erlbaum Associates.

Hedges, L.V. & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.



Toedter, L.J., Lasker, J.N., & Campbell, D.T. (1990). The comparison group problem in bereavement studies and the retrospective pretest. Evaluation Review, 14, 75-90.


General Accounting Office (1992). Cross design synthesis.

Program Evaluation and Methodology Division, GAO/PEMD-92-18). Washington DC: United States General Accounting office, March.



Boruch, R.F. (1981). Evaluation reflections. Evidential problems in social program evaluation and their analogs from engineering and the physical sciences, medicine, and an assortment of other disciplines. Studies in Educational Evaluation, 7, 121-149.

Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.

Cook, T.D. (1985). Postpositivist critical multiplism. In L. Shotland & M.M. Mark eds.), Social science and socialpolicy. Beverly Hills, CA: Sage Publications.

Diamond, J. (1989). How cats survive falls from New York skyscrapers. Discover, No.8, 20-26.

Gusfield, J. (1976). The literary rhetoric of science: Comedy and pathos in drinking driver research.

American Sociological Review, (February), 1~34.

Houts, A.C., Cook, T.D., & Shadish Jr., W.R. (1986). The person-situation debate: A critical multiplist perspective.Journal of Personality, 54(1), 5~105.

Shadish, W.R., Jr. (1986). Planned critical multiplism:Some elaborations. Behavioral Assessment, 8, 75-103.

White, P.A. (1990). Ideas about causation in philosophy and psychology. Psychological Bulletin,108, ~18.


Campbell, D.T. (1987). Guidelines for monitoring the scientific competence of preventive intervention research centers. Knowledge: Creation, Diffusion, Utilization, 8(3), 389A30.

Cook, T.D. (1988). The generalization of causal connections: Relevant theories and practices. In L. Sechrest, J. Bunker, & E. Perrin (Eds.), Improving methods in nonexperimental research. Sage Publications.

Goodman, S.N., & Royall, R. (1988). Evidence and scientific research. American Journal of Public Health, 78, 1568-1574.

Holland, P.W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81(396), 945-970.

Lipsey, M.W. (1990). Theory as method: Small theories of treatments. In L. Sechrest, E. Perrin, & J. Bunker eds.),Research methodology: Strengthening causal interpretations of nonexperimental data (pp. 33-50). Washington, D.C.: Dept. of Health and Human Services.

Meehl, P.M. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, Monograph Supplement 1,66, 195-244.

Sechrest, L. (1985). Social science and social policy: Will our numbers ever be good enough? In L. Shotland, & M. Mark (Eds.), Social science and social policy (pp.6~95). Beverly Hills: Sage Publications.

Sechrest, L., & Yeaton, W.E. (1981). Assessing the effectiveness of social programs: Methodological and conceptual issues. New Directions for Program Evaluation, 9, 41-56.

Temoshok, L. (1989). On cause, prediction, and related conundrums: Logical and methodological musings. In L. Sechrest, H. Freeman, & A. Mulley eds.), Health services research methods: a focus on AIDS. Rockille, MD: National Center for Health Services Research and Technology Assessment.



Hughes, S.L., Cordray, D.S., & Spiker, V.A. (1984). Evaluation of a long-term home care program, Medical Care,22(5), 460A75.

McNeil, B.J., Weichselbaum, R., & Pauker, S.G. (1981). Speech and survival: Tradeoffs between quality and quantity of life in laryngeal cancer. The New England Journal of Medicine, October, 982-987.

Sechrest, L., West, S.G., Phillips, M.A., Redner, R., & Yeaton, W.E. (1979). Some neglected problems in evaluation research: Strength and integrity of treatments. In L. Sechrest et al. (Eds.), Evaluation studies review annual, Vol. IV,(pp.15-35). Beverly Hills: Sage Publications.


Tharp, R.G., & Gallimore, R. (1979). The ecology of program research and evaluation: a model of evaluation succession. In L. Sechrest, S.G. West, M. MIller, R. Redner, & W.H. Yeaton eds.), Evaluation studies review annual,Vol.4, (pp. 39-60). Beverly Hills: Sage Publications.



Freedman, D.A. (1991). Statistical models and shoe leather. In P. Marsden ~d.), Sociological Methodology (pp.291-312). Oxford: Basil Blackwell, Ltd.



Porter, A.C. & Chibucos, T.R. (1974). Selecting analysis strategies. In G.D. Borich (Ed.), Evaluating educational programs and products (pp.415464). Englewood Cliffs, N.J.: Educational Technology.


Kaplan, R.M., Bush, J.W., & Berry, C.C. (1976). Health status: Types of validity and the index of wellbeing. Health Services Research, 11(4), 478-507.

Sechrest, L., West, S.G., Phillips, M.A., Redner, R., & Yeaton, W.E. (1979). (see EVALUATION section)

Shadish, W.R., Cook, T.D., & Houts, A.C. (1986). Quasi-experimentation in a critical multiplist mode. In W.M.K. Trochim (Ed.), Advances in quasi-experimental design and analysis (pp.2946). San Frandsco: Jossey-Bass.

Shadish, W.R. (1989). Critical multiplism: A research strategy and its attendant tactics. In L. Sechrest, H. Freeman, & A. Mulley eds.), Health services research methodology: A focus on Aids (pp.5-28) (DHHS Publication No. (PHS) 89-3439). Rockville, Maryland: National Center for Health Services Research and Health Care Technology Assessment, Public Health Service, U.S. Department of Health and Human Services.

Trochim, W.M.K. (1990). The regression discontinuity design. In L. Sechrest, E. Perrin, & J. Bunker (Eds.), Research Methodology: Strengthening Causal Interpretations of Nonexperimental Data (pp. 199-140). Rockville, MD: Agency for Health Care Policy and Research, Public Health Service.


Cooper, H.M. (1989). Integrating research: A guide for literature reviews (2nd Ed.). Newbury Park, CA:

Sage Publications.

Fink, A., & Kosecoff, J. (1985). How to conduct surveys:

A step-by-step guide. Newbury Park, CA: Sage Publications.

Jones, R. A. (1985). Research methods in the social and behavioral sciences. Sunderland, Massachusetts: Sinauer Associates, Inc.



Dinitto, D. (1983). Time series analysis: An application to social welfare policy. The Journal of Applied Behavioral Science, 19(4), 507-518.

Gillings, D., Makuc, D., & Siegel, E. (1981). Analysis of interrupted time series mortality trends: An example to evaluate regionalized perinatal care, AIPH, 71(1), 3846.

Marsh, J.C., & Shibano, M. (1982). Visual and statistical analysis of clinical time series data. New Directions for program evaluation: Application of time series analysis to evaluation, 16, 3348.

If it’s important to you, it’s significant to us