Equivalence of Remote, Online Administration and Traditional, Face-to-Face Administration of Woodcock-Johnson IV Cognitive and Achievement Tests
Abstract
Many children in need do not receive the mental health services they require. This is true with psychoeducational services in schools, where a shortage of school psychologists has been identified and an estimated 15% of all students struggle with attentional or learning difficulties that are unassessed and unaddressed, largely due to problems with access to psychoeducational evaluations. Remote, online psychoeducational evaluations have the potential to decrease this access problem by assisting school psychologists with their evaluation workload. The present study evaluated the equivalence of a remote, online administration procedure for the Woodcock-Johnson IV cognitive and achievement tests with traditional, in-person administration. Results revealed no significant differences between the scores on any index or individual test between the administration procedures. The remote, online procedure is a viable alternative for the traditional, in-person administration of the WJ IV, having the potential to improve psychoeducational evaluation access for many students across the countryReferences
Barak, A. (1999). Psychological applications on the Internet: A discipline on the threshold of a new millennium. Applied and Preventive Psychology, 8(4), 231-245.
Beattie, D., Cunningham, S., Jones, R., & Zelenko, O. (2006). ‘I use online so the counsellors can't hear me crying’: Creating design solutions for online counselling. Media International Australia Incorporating Culture and Policy, 118(1), 43-52.
Berends, L., Gardiner, P., Norman, N., Devaney, M., Ritter, A., & Clemons, S. (2004). Rural pathways: A review of the Victorian drug treatment service system in regional and rural Victoria. Melbourne, Victoria: Turning Point Alcohol and Drug Centre.
Boydell, K. M., Hodgins, M., Pignatiello, A., Teshima, J., Edwards, H., & Willis, D. (2014). Using technology to deliver mental health services to children and youth: a scoping review. Journal of the Canadian Academy of Child & Adolescent Psychiatry, 23(2), 87-99.
Castillo, J. M., Curtis, M. J., & Tan, S. Y. (2014). Personnel needs in school psychology: A 10-year follow-up study on predicted personnel shortages. Psychology in the Schools, 51(8), 832–849.
Chester, A., & Glass, C. A. (2006). Online counselling: A descriptive analysis of therapy services on the Internet. British Journal of Guidance & Counselling, 34(2), 145-160.
Clopton, K. L., & Knesting, K. (2006). Rural school psychology: Re-opening the discussion. Journal of Research in Rural Education, 21(5), 21-5.
Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences. New York, NY: Routledge Academic.
Cortiella, C., & Horowitz, S. H. (2014). The state of learning disabilities: Facts, trends and emerging issues. New York: National Center for Learning Disabilities. www.ncld.org/wp-content/uploads/2014/11/2014-State-of-LD.pdf (accessed 4/21/2017).
Cruz, M., Krupinski, E. A., Lopez, A. M., & Weinstein, R. S. (2005). A review of the first five years of the University of Arizona telepsychiatry programme. Journal of Telemedicine and Telecare, 11(5), 234-239.
Cummings, J. A., Harrison, P. L., Dawson, M. M., Short, R. J., Gorin, S., & Palomares, R. S. (2004). The 2002 conference on the future of school psychology: Implications for consultation, intervention, and prevention services. Journal of Educational and Psychological Consultation, 15(3-4), 239-256.
Cunningham, J. A., Humphreys, K., & Koski-Jännes, A. (2000). Providing personalized assessment feedback for problem drinking on the Internet: A pilot project. Journal of studies on alcohol, 61(6), 794-798.
Curtis, M. J., Chesno-Grier, J. E., Abshier, D. W., Sutton, N. T., & Hunley, S. (2002). School psychology: Turning the corner into the twenty-first century. Communiqué, 30(8), 1, 5–6.
Delpit, L. D. (1995). Other people’s children: Cultural conflict in the classroom. New York, NY: New Press.
DiPerna, J. C. (2005). Review of the Cognitive Abilities Test, Multilevel Edition, Form 6. In R. A. Spies & B. S. Plake (Eds.), The Sixteenth Mental Measurements Yearbook (pp. 228-234). Lincoln: University of Nebraska.
Elford, R., White, H., Bowering, R., Ghandi, A., Maddiggan, B., St John, K.,…Battcock, A. (2000). A randomized, controlled trial of child psychiatric assessments conducted using videoconferencing. Journal of Telemedicine and Telecare, 6(2), 73-82.
Etter, J. F., & Etter, J. F. (2006). The internet and the industrial revolution in smoking cessation counselling. Drug and Alcohol Review, 25(1), 79-84.
Fagan, T. K. (2004). School psychology’s significant discrepancy: Historical perspectives on personnel shortages. Psychology in the Schools, 41(4), 419–430.
Flores, G. (2010). Racial and ethnic disparities in the health and health care of children. Pediatrics, 125(4), e979-e1020.
Gadke, D. L., Valley-Gray, S., & Rossen, E. (2016). NASP annual report of graduate education in school psychology: 2014– 2015. NASP Research Reports, 1(2).
Hibel, J., Farkas, G., & Morgan, P. L. (2010). Who is placed into special education? Sociology of Education, 83(4), 312–332.
Inkelas, M., Raghavan, R., Larson, K., Kuo, A., & Ortega, A.N. (2007). Unmet mental health need and access to services for children with special health care needs and their families. Ambulatory Pediatrics, 7(6), 431–438.
Jensen, P. S., Goldman, E., Offord, D., Costello, E. J., Friedman, R., Huff, B., ... & Conger, R. (2011). Overlooked and underserved: “Action signs†for identifying children with unmet mental health needs. Pediatrics, 128(5), 970-979.
Kieling, C., Baker-Henningham, H., Belfer, M., Conti, G., Ertem, I., Omigbodun, O., ... & Rahman, A. (2011). Child and adolescent mental health worldwide: Evidence for action. The Lancet, 378(9801), 1515-1525.
Lingely-Pottie, P., & McGrath, P. J. (2006). A therapeutic alliance can exist without face-to-face contact. Journal of Telemedicine and Telecare, 12(8), 396-399.
Lohman, D. F., & Hagen, E. P. (2001). Cognitive Abilities Test, Form 6. Itasca, IL: Riverside Publishing.
Morgan, P. L., Farkas, G., Hillemeier, M. M., & Maczuga, S. (2012). Are minority children disproportionately represented in early intervention and early childhood special education? Educational Researcher, 41(9), 339–351.
Morgan, P. L., Farkas, G., Hillemeier, M. M., Mattison, R., Maczuga, S., Li, H., & Cook, M. (2015). Minorities are disproportionately underrepresented in special education: Longitudinal evidence across five disability conditions. Educational Researcher, 44(5), 278-292.
Myers, K. M., Valentine, J. M., & Melzer, S. M. (2007). Feasibility, acceptability, and sustainability of telepsychiatry for children and adolescents. Psychiatric Services, 58(11), 1493-1497.
Myers, K. M., Valentine, J. M. & Melzer, S. M. (2008). Child and adolescent telepsychiatry: Utilization and satisfaction. Telemedicine and e-Health, 14(2), 131-137.
Myers, K. M., Vander Stoep, A., Mccarty, C. A., Klein, J. B., Palmer, N. B., Geyer, J. R., & Melzer, S. M. (2010). Child and adolescent telepsychiatry: Variations in utilization, referral patterns and practice trends. Journal of Telemedicine and Telecare, 16(3), 128-133.
National Association of School Psychologists. (2010). Model for Comprehensive and Integrated School Psychological Services. Bethesda, MD: Author.
National Survey of Children’s Health. (2012). Data Query from the Child and Adolescent Health Measurement Initiative. Retrieved April 26, 2017 from Data Resource Center for Child & Adolescent Health: http://childhealthdata.org/browse/survey/results?q=2542&r=1.
Neisser, U., Boodoo, G., Bouchard Jr, T. J., Boykin, A. W., Brody, N., Ceci, S. J., ... & Urbina, S. (1996). Intelligence: Knowns and unknowns. American Psychologist, 51(2), 77-101.
Patel, V., Kieling, C., Maulik, P. K., & Divan, G. (2013). Improving access to care for children with mental disorders: a global perspective. Archives of disease in childhood, 98(5), 323-327.
Pesamaa, L., Ebeling, H., Kuusamaki, M. L., Winblad, I., Isohanni, M., & Moilanen, I. (2004). Videoconferencing in child and adolescent telepsychiatry: A systematic review of the literature. Journal of Telemedicine and Telecare, 10(4), 187-192.
Pesamaa, L., Ebeling, H., Kuusamaki, M. L., Winblad, I., Isohanni, M., & Moilanen, I. (2007). Videoconferencing in child and adolescent psychiatry in Finland – an inadequately exploited resource. Journal of Telemedicine and Telecare, 13(3), 125-129.
Reed, G. M., McLaughlin, C. J., & Milholland, K. (2000). Ten interdisciplinary principles for professional practice in tele-health: Implications for psychology. Professional Psychology: Research and Practice, 31(2), 170-178.
Reschly, D. J. (2000). The present and future status of school psychology in the United States. School Psychology Review, 29(4), 507–522.
Reynolds, M. R., & Niileksela, C. R. (2015). Test Review: Schrank, FA, McGrew, KS, & Mather, N.(2014). Woodcock-Johnson IV Tests of Cognitive Abilities. Journal of Psychoeducational Assessment, 33(4), 381-390.
Salyers, M. P., Bonfils, K. A., Luther, L., Firmin, R. L., White, D. A., Adams, E. L., & Rollins, A. L. (2017). The relationship between professional burnout and quality and safety in healthcare: A meta-analysis. Journal of General Internal Medicine, 32(4), 475–482.
Schrank, F. A., McGrew, K. S., & Mather, N. M. (2014). Woodcock-Johnson IV. Itasca, IL: Riverside Publishing.
Wright, A. J. (2016). Equivalence of remote, online administration and traditional, face-to-face administration of Woodcock-Johnson IV cognitive and achievement tests [White Paper]. Retrieved April 26, 2017, from PresenceLearning.com: http://www.presencelearning.com/app/uploads/2016/09/WJ-IV_Online_Remote_whitepaper_FINAL.pdf
Villarreal, V. (2015). Test Review: Schrank, FA, Mather, N., & McGrew, KS (2014). Woodcock-Johnson IV Tests of Achievement. Journal of Psychoeducational Assessment, 33(4), 391-398.
Young, K. S. (2005). An empirical examination of client attitudes towards online counseling. CyberPsychology & Behavior, 8(2), 172-177.
