Psychopathy and the Rorschach: A Response to Wood et al. (2010)
Abstract
PSYCHOPATHY AND THE RORSCHACH: A RESPONSE TO WOOD ET AL. (2010). Abstract Wood et al. (2010) published a meta-analysis in which the authors challenged the utility of the Rorschach Inkblot Test in delineating key differences between psychopathic and non-psychopathic individuals identified by the Psychopathy Checklist-Revised (PCL-R; Hare, 1991/2003). In this article, Gacono et al.’s (2001) five conceptual and four methodological criteria for the evaluation and interpretation of psychopathy/Rorschach literature were employed to provide a detailed review of the approach and procedure used by Wood et al. (2010). We identify and discuss a number of conceptual and methodological problems with the meta-analysis including confusion of the related but distinct terms of diagnosis and assessment, selection of studies, categorical versus dimensional interpretations of data, characterization of PCL-R and Rorschach findings, and meta-analytic methodology. Finally, recommendations for the essential components of well designed and implemented PCL-R and Rorschach studies are provided. Key Words: Psychopathy, Incarcerated Offenders, Rorschach, Methodology, Meta-Analysis,References
Allen, M.J., & Yen, W.M. (2001). Introduction to measurement theory. New York: Waveland Press.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders
(3rd ed., rev.). Washington, DC: Author.
American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders
(3rd ed.). Washington, DC: Author.
American Psychiatric Association. (1968). Diagnostic and statistical manual of mental
disorders (2nd ed.). Washington, DC: Author.
American Psychiatric Association. (1952). Diagnostic and statistical manual of mental
disorders. Washington, DC: Author.
American Psychological Association. (July 19, 2004). Case #125 S. Ct. 1183 (2005). On Writ Of Certiorari To The Supreme Court Of Missouri. In Roper v. Simmons. Retrieved March 20, 2011, from http://www.apa.org/about/offices/ogc/amicus/roper.pdf.
Bannatyne, L., Gacono, C., & Greene, R. (1999). Differential patterns of responding among three groups of chronic, psychotic and forensic outpatients. Journal of Clinical
Psychology, 55(12), 1553-1565.
Ballard, D.W. (2006). Rorschach aggression variables of male juvenile offenders. Dissertation Abstracts International, 66, 5076B.
Berardino, S. D., Meloy, J., Sherman, M., & Jacobs, D. (2005). Validation of the Psychopathic Personality Inventory on a female inmate sample. Behavioral Sciences & The Law, 23(6), 819-836. doi:10.1002/bsl.666.
Bolt, D. M., Hare, R. D., Vitale, J. E. & Newman, J. P. (2004). A multigroup item response
theory analysis of the Psychopathy Checklist-Revised. Psychological Assessment, 16 (2),
-168.
Bridges, M., Wilson, J., & Gacono, C. B. (1998). A Rorschach investigation of defensiveness,
self-perception, interpersonal relations, and affective states in incarcerated pedophiles.
Journal of Personality Assessment, 70, 365-385.
Butcher, J. (Ed.). (2006). MMPI-2: A practitioner's guide. Washington, DC: American
Psychological Association.
Butcher, J. N., Williams, C. L., Graham, J. R., Archer, R. P., Tellegen, A., Ben-Porath, Y. S., & Kaemmer, B. (1992). Minnesota Multiphasic Personality Inventory-Adolescent Version (MMPI-A): Manual for administration, scoring and interpretation. Minneapolis, MN: University of Minnesota Press.
Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989).
Minnesota Multiphasic Personality Inventory -2 (MMPI-2): Manual for administration and scoring. Minneapolis: University of Minnesota Press.
Cohen, J. (1968). Weighed kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70 (4), 213–220.
Cunliffe, T. B. (2002). A Rorschach investigation of incarcerated female psychopaths. Dissertation Abstracts International, 63, 1058B.
Cunliffe, T. B., & Gacono, C. B. (2005). A Rorschach investigation of incarcerated antisocial personality disordered female offenders. International Journal of Offender Therapy and Comparative Criminology, 49, 530-547.
Cunliffe, T. B., & Gacono, C. B. (2008). A Rorschach understanding of antisocial and
psychopathic women. In C. B. Gacono, F. B. Evans, N. Kaser-Boyd, & L. A. Gacono
(Eds.), The handbook of forensic Rorschach assessment (pp. 361-378). New York, NY: Routledge.
Darcangelo, S. M. (1997). Psychological and personality correlates of the Massachusetts Treatment Center classification system for rapists. Dissertation Abstracts International, 58, 2115B.
DeVellis, R. F. (2003). Scale development: Theory and applications, Second ed. Thousand Oaks, CA: Sage Publications.
Egozi-Progeta, V. L. (1999). A comparison of the Roemer and the Rorschach tests as tools for
distinguishing characteristics of psychopathy. Dissertation Abstracts International, 60, 1345B.
Erdberg, P. S. (2008). Multimethod assessment as a forensic standard. In C. B. Gacono, F.
Evans, N. Kaser-Boyd, & L. A. Gacono (Eds.), The handbook of forensic Rorschach
assessment (pp. 561-566). New York, NY : Routledge.
Exner, J. E. (1969). Rorschach responses as an index of narcissism. Journal of Projective Techniques and Personality Assessment, 33, 324-330.
Exner, J. E. (1986). The Rorschach: A comprehensive system: Vol. 1. Basic foundations (2nd
ed.). New York, NY: Wiley.
Exner, J. E. (1993). The Rorschach: A comprehensive system: Vol. 1. Basic Foundations (3rd
ed.). New York: Wiley.
Exner, J. E. (1995). A Rorschach workbook for the comprehensive system (4th ed.). Asheville,
NC: Rorschach Workshops.
Exner, J. E. (2003). The Rorschach: A comprehensive system: Vol. 1. Basic foundations and principles of interpretation (4th ed.). Hoboken, NJ: Wiley.
Exner, J. E., & Erdberg, P. (2005). The Rorschach: A comprehensive system: Vol. 2.
Interpretation (3rd ed.). Oxford, England: Wiley.
Forth, A. E., Kosson, D. S., & Hare, R. (2003). Hare Psychopathy Checklist: Youth Version.
Toronto, Ontario, Canada: Multihealth Systems.
Forth, A. E., Hart, S. D., & Hare, R. D. (1990). Assessment of psychopathy in male young offenders. Psychological Assessment: A Journal of Consulting and Clinical Psychology,
q2(3), 342-344.
Forouzan, E., & Cooke, D. J. (2005). Figuring out la femme fatale: Conceptual and assessment issues concerning psychopathy in females. Behavioral Sciences and the Law, 23, 765- 778.
Gacono, C., & Evans, B. (2004). Entertaining reading, but not science: Book review of What’s wrong with the Rorschach. International Journal of Offender Therapy & Comparative Criminology, 48(2), 253-257.
Gacono, C. B. (1988). A Rorschach interpretation of object relations and defensive structure and their relationship to narcissism and psychopathy in a group of antisocial offenders. (Unpublished doctoral dissertation). United States International University, San Diego,
CA.
Gacono, C. B. (1998). The use of the Psychopathy Checklist—Revised (PCL-R) and Rorschach
in treatment planning with antisocial personality disordered patients. International
Journal of Offender Therapy and Comparative Criminology, 42(1), 49-64.
Gacono, C. (Ed.). (2000). The clinical and forensic assessment of psychopathy: A practitioner's guide. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
Gacono, C. B., Evans, F. B., & Viglione, D. J. (2008). Essential issues in the forensic use of the Rorschach. In C. B. Gacono, F. B. Evans, N. Kaser-Boyd & L. A. Gacono (Eds.), The handbook of forensic Rorschach assessment (pp. 3-20). New York, NY: Routledge.
Gacono, C. B., & Hutton, H. E. (1994). Suggestions for the clinical and forensic use of the Hare
Psychopathy Checklist-Revised (PCL-R). International Journal of Law and Psychiatry, 17(3), 303-317.
Gacono, C. B., Loving, J. L., & Bodholt, R. H. (2001). The Rorschach and psychopathy:
Toward a more accurate understanding of the research findings. Journal of Personality Assessment, 77, 16-38.
Gacono, C. B., & Meloy, J. R. (1991). A Rorschach investigation of attachment and anxiety in
anti-social personality disorder and psychopathy. Journal of Nervous and Mental Disease,179, 546-552.
Gacono, C. B., & Meloy, J. R. (1992). The Rorschach and the DSM-III-R antisocial personality: A tribute to Robert Lindner. Journal of Clinical Psychology, 48, 393-406.
Gacono, C. B., Meloy, J., & Bridges, M. R. (2000). A Rorschach comparison of psychopaths, sexual homicide perpetrators, and nonviolent pedophiles: Where angels fear to tread. Journal of Clinical Psychology, 56(6), 757-777.
Gacono, C. B., Meloy, J., Sheppard, K., & Speth, E. (1995). A clinical investigation of
malingering and psychopathy in hospitalized insanity acquittees. Bulletin of the American Academy of Psychiatry & the Law, 23(3), 387-397.
Gacono, C. B. & Gacono, L. A. (2006). Some caveats for evaluating the research on
psychopathy. Correctional Psychologist. Location: Publisher.
Gacono, C. B., Gacono, L. A., & Evans, F. B. (2008). The Rorschach and antisocial personality disorder. In C. B. Gacono, F. B. Evans, N. Kasser-Boyd, & L. A. Gacono (Eds.), The handbook of forensic Rorschach assessment (pp. 323-359). New York, NY: Routledge.
Gacono, C. B. & Meloy, J. R. (1994). The Rorschach assessment of aggressive and
psychopathic personalities. Hillsdale, NJ: Erlbaum.
Gacono, C. B., & Meloy, J. R. (2009). Assessing Antisocial and Psychopathic Personalities. In
J. Butcher (Ed.), The Oxford Handbook of Personality Assessment. Oxford University
Press [2009; Gacono, Meloy].
Gacono, C. B., Meloy, J. R., & Berg, J. L. (1992). Object relations, defensive operations, and affective states in narcissistic, borderline, and antisocial personality disorder. Journal of Personality Assessment, 59, 32-49.
Gacono, C. B., Meloy, J. R., & Bridges, M. R. (2000). A Rorschach comparison of
psychopaths, sexual homicide perpetrators, and nonviolent pedophiles: Where angels
fear to tread. Journal of Clinical Psychology, 56, 757-777.
Gacono, C. B., Meloy, J. R., & Heaven, T. R. (1990). A Rorschach investigation of narcissism
and hysteria in antisocial personality. Journal of Personality Assessment, 59, 270-279.
Gacono, C. B., Nieberding, R. J., Owen, A., Rubel, J., & Bodholdt, R. (2001). Treating conduct
disorder, antisocial, and psychopathic personalities. In J. B. Ashford, B. Sales, W. H.
Reid (Eds.), Treating adult and juvenile offenders with special needs (pp. 99-129).
Washington, DC: American Psychological Association.
Gacono, C. B. (1990). An empirical study of object relations and defensive operations in antisocial personality disorder. Journal of Personality Assessment, 54, 589-600.
Garb, H. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
Grann, M., Långström, N., Tengström, A., & Stålenheim, E. G. (1998). Reliability of file-based
retrospective ratings of psychopathy with the PCL-R. Journal of Personality Assessment, 70, 416-426.
Hare, R. D. (1980). A research scale for the assessment of psychopathy in criminal populations.
Personality and Individual Differences, 1, 111-119.
Hare, R. D. (1991). Manual for the Revised Psychopathy Checklist. Toronto, Ontario, Canada: Multihealth Systems.
Hare, R. D. (1993). Without conscience: The disturbing world of the psychopaths among us. New York, NY: Pocket Books.
Hare, R. D. (2003). Manual for the Revised Psychopathy Checklist (2nd ed.). Toronto, Ontario, Canada: Multihealth Systems.
Hare, R. D., & McPherson, L. M. (1984). Violent and aggressive behavior by criminal psychopaths. International Journal of Law and Psychiatry, 7(1), 35-50.
Hartmann, E., Norbech, P. B., & Gronnerod, C. (2006). Psychopathic and nonpsychopathic violent offenders on the Rorschach: Discriminative features and comparisons with schizophrenic inpatient and university student samples. Journal of Personality Assessment, 86, 291-305.
Hathaway, S. R., & McKinley, J. C. (1951). Minnesota Multiphasic Personality Inventory.
ManualNew York: Psychological Corporation..
Heaven, T. R. (1988). The relationship between Hare’s Psychopathy Checklist scores and selected Exner Rorschach variables in an inmate population. Dissertation Abstracts International, 49, 3442B.
Heilbrun, K., Warren, J., & Picarello, K. (2003). Third party information in forensic assessment.
In A. M. Goldstein, A. M. Goldstein (Eds.), Handbook of psychology: Forensic psychology, Vol. 11 (pp. 69-86). Hoboken, NJ: John Wiley & Sons Inc.
Hemphill, J. F., Hare, R. D., & Wong, S. (1998). Psychopathy and recidivism: A review. Legal
and Criminological Psychology, 3(Part 1), 139-170.
Holt, S., Meloy, J. R. & Strack, S. (1999). Sadism and sexual sadism in psychopathic and nonpsychopathic offenders. J. Am. Acad. Psychiatry and the Law.
Jenkins, R. L. (1960). The psychopathic or antisocial personality. Journal of Nervous and Mental Disease, 1313,18-334.
Kaiser-Boyd, N. (1993). Rorschach’s of women who commit suicide. Journal of Personality Assessment, 60(3), 458-470.
Keltikangas-Värvinen, L. (1982). Alexithymia in violent offenders. Journal of Personality Assessment, 46(5), 462-467.
Lilienfeld, S. (Ed.), Lynn, S. (Ed.), & Lohr, J. (Ed.). (2003). Science and pseudoscience in
clinical psychology. New York, NY: Guilford Press.
Lindner, R. M. (1943). The Rorschach test and the diagnosis of psychopathic personality. Journal of Criminal Psychopathology, 5, 69-93.
Lindner, R. M. (1944). Rebel without a cause: The hypoanalysis of a criminal psychopath.
New York, NY: Grune and Stratton.
Lindner, R. M. (1946). Content analysis in Rorschach work. Rorschach Research Exchange,
,121-129.
Lindner, R. M. (1950). The content analysis of the Rorschach protocol. In L.E. Abt & L. Bellak (Eds.), Projective psychology (pp. 75-90). New York, NY: Knopf.
Loving, J. L. (1998). Selected Rorschach variables of psychopathic male juvenile offenders. Dissertation Abstracts International, 59, 0878B.
Loving, J. L., & Russell, W. F. (2000). Selected Rorschach variables of psychopathic juvenile offenders. Journal of Personality Assessment, 75, 126-142.
Markon, K. E., Chmielewski, M., & Miller, C. J. (2011). The reliability and validity of discrete
and continuous measures of psychopathology: A quantitative review. Psychological
Bulletin,5, 1-24.
Martin, E. H. (2003). Scientific critique or conformation bias?: An analysis of “What’s wrong
with the Rorschach†by Wood, Nezworski, Lilienfeld, & Garb. The National
Psychologist, 121(5), 19.
McDonald, R. P. (1999) Test theory: a unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates.
Meloy, J. R. (1988). The Psychopathic Mind: Origins, Dynamics, and Treatment. Northvale,
NJ: Aronson.
Meloy, J. (2005). Comment: Some reflections on what's wrong with the Rorschach. Journal of
Personality Assessment, 85(3), 344-346.
Meloy, J. R. (2006). The empirical basis and forensic application of affective and predatory violence. Australian and NZ J Psychiatry 40, 539-547.
Meloy, J. R. (2008). The authority of the Rorschach: An update. In C. B. Gacono, F. B. Evans, N. Kaser-Boyd, & L. A. Gacono (Eds.), The handbook of forensic Rorschach assessment. New York, NY: Routledge.
Meloy, J. R. (in press). Predatory violence and psychopathy. In Nystrom & Nystrom (Eds.), Psychopathy and Law. London: Wiley.
Meloy, J. R., & Gacono, C. B. (1992). The aggression response and the Rorschach. Journal of Clinical Psychology, 48, 104-114.
Meloy, J. R. & Gacono, C. B. (2000). Assessing psychopathy: Psychological testing and report writing. In C.B. Gacono (Ed.), The clinical and forensic assessment of psychopathy (pp. 231-249). Mahwah, NJ: Erlbaum.
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., &
Kubiszyn, T. W. (2001). Psychological testing and psychological assessment: A review of evidence and issues. American Psychologist, 56, 128-165.
Merriam-Webster, Inc. (1986). Webster's third new international dictionary of the English language unabridged. Springfield, MA: Author.
Miller, J. D., & Lynam, D. R. (2012). An Examination of the Psychopathic
Personality Inventory's Nomological Network: A Meta-Analytic Review. Personality Disorders: Theory, Research, and Treatment. doi: 10.1037/a0024567.
Millon, T. (Ed.), Simonsen, E. (Ed.), Birket-Smith, M. (Ed.), & Davis, R. (Ed.). (1998).
Psychopathy: Antisocial, criminal, and violent behavior. New York, NY: Guilford Press.
Morey, L. (1991/2007). Personality Assessment Inventory [2007 Professional Manual]. Lutz, FL: Psychological Assessment Resources.]. Location: Publisher.
Muntz, A. (1999). Object relations and defense mechanisms of psychopathic and nonpsychopathic female offenders: A descriptive study. Dissertation Abstracts International, 60, 2954B.
Nassen, N. N. (2008). Rorschach predictors of psychopathy in violent male offenders. Dissertation Abstracts International, 69, 1963B.
Ogloff, J., Wong, S., & Greenwood, A. (1990). Treating criminal psychopaths in a therapeutic community program. Behavioral Sciences and the Law, 8, 81-90.
Ponder, J. I. (1999). An investigation of psychopathy in a sample of violent juvenile offenders.
Dissertation Abstracts International, 59, 5105B.
Raine, A. & Sanmartin, J. (2001). Violence and psychopathy. New York, NY: Kluwer Academic Publishers.
Rice, M. E., Harris, G. T., & Cormier, C. A. (1992). An evaluation of a maximum security therapeutic community for psychopaths and other mentally disordered offenders. Law and Human Behavior, 16, 399-412.
Rice, M. E., Harris, G. T., & Quinsey, V. L. (1990). A follow-up of rapists assessed in a
maximum-security psychiatric facility. Journal of Interpersonal Violence, 5(4), 435-448.
Rice, M. E., & Harris, G. T. (1995). Violent recidivism: Assessing predictive validity. Journal of Consultingand Clinical Psychology, 63(5), 737-748.
Rorschach, H. (1942). Psychodiagnostics. New York: Grunne & Stratton. (Original work published 1921)
Siemsen, R. A. (1999). Relationships of Rorschach and MMPI-2 variables to the Hare Psychopathy Checklist – Revised among mentally-ill incarcerated felons. Dissertation Abstracts International, 60, 2367B.
Smith, A. M. (1995). Juvenile psychopathy: Rorschach assessment of narcissistic traits in conduct disordered adolescents. Dissertation Abstracts International, 55, 5088B.
Smith, A. M., Gacono, C. B., & Kaufman, L. (1997). A Rorschach comparison of non-
psychopathic conduct disordered adolescents. Journal of Clinical Psychology, 53, 289-
Smith, J. M. (2012, in preparation). Female psychopathy: A Rorschach investigation of
personality structure. (Unpublished Doctoral Project). Carlos Albizu University, Miami,
FL.
Sreenivasan, S., Garrick, T., Norris, R., Cusworth-Walker, S., Weinberger, L. E., Essres, G., & Fain, T. (2007). Predicting the likelihood of future sexual recidivism: Pilot study findings from a California sex offender risk project and cross-validation of the Static-99. Journal of the American Academy of Psychiatry and the Law, 35(4), 454-468.
Uebersax, J. S. (1987). Diversity of decision-making models and the measurement of interrater
agreement. Psychological Bulletin, 101 (1), 140-146.
Viglione, D. J, & Meyer, G. J. (2008). An overview of psychometrics for forensic practice. In C. B. Gacono, F. B. Evans, N. Kaser-Boyd, and L. A. Gacono (Eds.). The handbook of forensic Rorschach assessment (pp. 21-54). New York, NY: Routledge.
Viglione, D. J. (1999). A review of recent research addressing the utility of the Rorschach. Psychological Assessment, 11(3), 251-265.
Viglione, D. J. (1995). Basic considerations regarding data analysis. In J. E. Exner, Jr. (Ed.),
Issues and methods in Rorschach research. (pp. 195-227). Mahwah, NJ: Lawrence
Erlbaum Associates.
Viglione, D. J., Brager, R. C., & Haller, N. (1988). Usefulness of structural Rorschach data in identifying inpatients with depressive symptoms: A preliminary study. Journal of Personality Assessment, 81(2), 149-156.
Weiner, I. B. (1998). Principles of Rorschach interpretation. Mahwah, NJ: Lawrence Erlbaum
Associates Publishers.
Welsh, R. K. (1999). Psychopathy and psychological risk markers of violent recidivism. 14 Dissertation Abstracts International, 60, 2968B.
Wong, S. (1988). Is Hare's Psychopathy Checklist reliable without the interview?. Psychological Reports, 62(3), 931-934.
Wong, S. (1984). Criminal and institutional behaviors of psychopaths. Ottawa, Ontario: Programs Branch Users Report, Ministry of the Solicitor General of Canada.
Wood, J. M., Lilienfeld, S. O., Garb, H. N., & Nezworski, M. T. (2000). The Rorschach test in
clinical diagnosis: A critical review, with a backward look at Garfield (1947). Journal of Clinical Psychology, 56, 395-430.
Wood, J. M., Lilienfeld, S. O., Nezworski, M. T., & Garb, H. N. (2001a). Coming to grips with negative evidence for the Comprehensive System for the Rorschach: A comment on Gacono, Loving, and Boldholdt; Ganellen and Bornstein. Journal of Personality Assessment, 77, 48-70.
Wood, J. M., Nezworski, M. T. , Lilienfeld, S. O., & Garb, H. N., (2003). What’s wrong with the
Rorschach? Science confronts the controversial inkblot test. San Francisco, CA: Jossey- Bass.
Wood, J. M., Lilienfeld, S. O., Nezworski, M. T., Garb, H. N., Holloway Allen, K. &
Wildermuth, J. L. (2010). Validity of Rorschach inkblot scores for discriminating psychopaths from nonpsychopaths in forensic populations: A meta-analysis. Psychological Assessment, 22(2), 336-349.
Young, M. H., Justice, J. V., Erdberg, P. S., & Gacono, C. B. (2000). The incarcerated
psychopath in psychiatric treatment: Management or treatment? In C.B. Gacono (Ed.), The clinical and forensic assessment of psychopathy: A practitioners guide (pp. 313-331). Mahwah, NJ: Lawrence-Erlbaum Associates.
