Jaehwa Choi

Jaehwa Choi
Associate Professor, Assessment, Testing, and Measurement
(202) 994-2602

Jaehwa Choi is Associate Professor and Program Director of the Assessment, Testing, and Measurement Program in the Department of Educational Leadership.

He is also the Executive Director of the Computer Adaptive Formative Assessment (CAFA) Laboratory (CAFA Lab, Inc.) and has conducted various Information and Communication Technology (ICT)-based assessment projects in collaboration with Samsung Electronics (Intelligence Solution Team), Korea Institute for Curriculum and Evaluation (KICE; Assessment Advancement Team), Korea Research Institute for Educational Assessment (KRIEA), and others.

His research interests and current projects include:

  • Next Generation Assessment Models: Truncated or semi-truncated logistic (a.k.a., PTL or PSTL) item response theory models; Non-linear growth modeling for latent traits; assessment models for machine/artificial intelligence; Markov chain Monte Carlo (MCMC) estimation methods, advanced structural equation models; hierarchical linear models.
  • Intelligent Assessment Engineering Systems: Automatic item generation (AIG) using machine learning techniques; computer-adaptive formative assessment models; educational big data analytic systems; problem solving artificial intelligent (AI) System using Deep Learning Artificial Neural Network (DL ANN); diagnostic assessment system using DL ANN.
  • Technology-enhanced STEM Education Applications: K-Math Workbook System using AIG (6 and 7 grades); CAFA Smart Assignment System for K-12 Math; Pathway to Advancement and Success in Statistics (PASS) System.

He has also authored or invented several assessment systems and statistical analysis software programs:

  • CAFA AIG System (v 1.0 Beta): An innovative assessment tool that integrates cognitive and psychometric theories with assessment development theory and practices in order to generate assessment items using state-of-the-art technology. (http://AIG.CAFALab.com/)
  • CAFA K-Math Workbook System (v 1.0 Beta): Computer Adaptive Formative Assessment Client Application for Common Core Math Workbook [Computer System]. CAFA Lab, Inc.
  • CAFA Smart Assignment System (v 1.0 Beta): Computer Adaptive Formative Assessment Client Application for School Assignments [Computer System]. CAFA Lab, Inc.
  • CAFA System (v 1.0 Beta): Computer Adaptive Formative Assessment System for Educational Services [Computer System]. CAFA Lab, Inc. (http://eMathTest.com/CAFA)
  • BayesPCC (v 3.0.0): A stand-alone Microsoft Windows software program for estimating Polychoric correlation matrices using Bayesian estimation methods.
  • ezra (v 1.0.0): A Microsoft Excel Add-In for test item analysis.

He served as co-chair (2010-2011) and chair (2011-2012) of the Structural equation modeling special interest group of the American Educational Research Association. He also served as a member of the constitution and by-laws committee (2009-2010) and treasurer (2011-2012) of the Korean-American Educational Researchers Association. He has taught dozens of assessment or quantitative methods workshops (e.g., Automatic Item Generation, Assessment Engineering, Multilevel Analysis, SPSS Syntax, etc.) in the United States and abroad.

For more information (e.g., office hours, course information, research projects, etc.) visit his personal website (http://Jaehwa.Choi.CAFALab.com).

Education
Ph.D., University of Maryland
M.A., University of Maryland
B.A., Department of Business Administration, Sogang University
B.A., Department of Philosophy, Sogang University

Publications

Choi, J., Kim, H., & Pak, S. (2018). Evaluation of Automatic Item Generation Utilities in Formative Assessment Application for Korean High School Students. Journal of Educational Issues, 4(1), 68-89. doi:10.5296/jei.v4i1.

Young, D. & Choi, J. (2018). Information and Computer Technologies for Improving International Assessment. In S. Swayze & V. Ford (Eds.), Innovative Applications of Knowledge Discovery and Information Resources Management. PA: IGI Global. doi:10.4018/978-1-5225-5829-3

Choi, J. (2018). Roles and Impacts of Automatic Item Generation on Assessment Research, Practice, and Policy. In S. Swayze & V. Ford (Eds.), Innovative Applications of Knowledge Discovery and Information Resources Management. PA: IGI Global. doi:10.4018/978-1-5225-5829-3

Choi, J., Kim, S., & Yoon, K. (2017). CAFA AIG Manual: Computer Adaptive Formative Assessment Automatic Item Generation User’s Guide [System Manual], 2nd edition. Clarksville, MD: CAFA Lab, Inc.

Choi, J. (2017). Next Generation Item and Test Development: A Practical Introduction to Automatic Item Generation. Washington, D.C.: Assessment, Testing and Measurement Technical Report Series, The George Washington University.

Beveridge, S., Appleyard, J., Choi, J., & DiNardo, J. (2017). Application of the Knowledge Validation Inventory - Revised to Examine Individual and Regional Variation Training Needs of Rehabilitation Counselors, Education and Training Issues in Forensic Vocational Analysis, 16(2).

Zeglin, R. J., Hergenrather, K. C., Poppen, P. J., Choi, J., Zea, M.C., & Reisen, C. (2017). Latino Sexual Beliefs Scale: An Exploratory Factor Analysis of Latino MSM, Archives of Sexual Behavior, doi:10.1007/s10508-017-0988-3.

Choi, J., & Levy, R. (2017). Markov chain Monte Carlo Estimation Methods for Structural Equation Modeling: A Comparison of Subject-level Data and Moment-level Data Approaches. Biometrics and Biostatistics International Journal, 6(5): 00182. DOI: 10.15406/bbij.2017.06.00182

Choi, J., Kim, S., & Yoon, K. (2017). K-Math Workbook Grade 7. Clarksville, MD: CAFA Lab, Inc.

Choi, J. (2017, January). The Rise of Assessment Engineering in 4th Industrial Revolution. Invited article of the 2017 newsletter of the Korean Society for Educational Evaluation, Seoul, Korea.

Choi, J., Kim, S., & Yoon, K. (2016). K-Math Workbook Grade 6. Clarksville, MD: CAFA Lab, Inc.

Choi, J. (2016). Introduction to Assessment Engineering. Assessment, Testing, and Measurement Technical Report Series. The George Washington University, Washington DC.

Choi, J., & Lee, J. (2016). Book review on the next generation of testing: common core standards, smarter-balanced, PARCC, and the nationwide testing movement. Teachers College Record, Date Published: November 14, 2016. http://www.tcrecord.org ID Number: 21738.

Dardick, W., & Choi, J. (2016). Teacher Empowered Assessment System: Assessment for the 21st Century. Journal of Applied Educational and Policy Research, 2(2).

Marotta, S., Shaine, M., & Choi, J. (2015). Posttraumatic growth among combat veterans: A proposed developmental pathway. Psychological Trauma: Theory, Research, Practice, and Policy.

Choi, J., Kang, M., Kim, N., Dardick, W., & Zhang, X. (2015). A smart way of coping with Common Core challenges - Introduction to CAFA SmartWorkbook. Journal of Educational Issues, 1(2), 70-89.

Chen, J., Zhang, D., & Choi, J. (2014). Estimation of the latent mediated effect with ordinal data using the limited-information and Bayesian full-information approaches. Behavioral Research Methods.

Marmarosh, C., Bieri, K., Schutt, J., Barone, C., & Choi, J. (2014). The insecure psychotherapy base: Using client and therapist attachment styles to understand the early alliance. Psychotherapy.

Chen, J., Choi, J., Stapleton, L. & Weiss, B. (2014). An empirical evaluation of mediation effect analysis with manifest and latent variables using Markov chain Monte Carlo and alternative estimation methods. Structural Equation Modeling: A Multidisciplinary Journal, 21(2).

Choi, J., Kim, S., & Yoon, K. (2014). CAFA Automatic Item Generation (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for Automatic Item Generation [Computer System]. eMathTest, Inc.

Choi, J., Kim, S., & Yoon, K. (2014). CAFA Smart Workbook (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for Common Core Math Workbook [Computer System]. eMathTest, Inc.

Stewart, J. F., Mallery, C., & Choi, J. (2013). College student persistence: A multilevel analysis of distance learning course completion at the crossroads of disability. Journal of College Student Retention: Research, Theory & Practice, 15(3), 367-385.

Levy, R. & Choi, J. (2013). An introduction to Bayesian structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (2nd ed.). Greenwood, CT: Information Age Publishing, Inc.

Choi, J. & Kim, S. (2013). Reliability. In Kim, S. (Eds.), Educational measurement (4th ed. Trans. in Korean). New York: American Council on Education and Macmillan.

Tekleselassie, A., Mallery, C., & Choi, J. (2013). Applying the multivariate model to unpack the gender gap in college access among African Americans and Caucasians. Journal of Negro Education, 82(2), 139-156.

Choi, J., Kim, S., & Yoon, K. (2013). CAFA Smart Assignment (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for School Assignments [Computer System]. eMathTest, Inc.

Marmarosh, C., Nikityn, M., Moehringer, J., Ferraioli, L., Kahn, S., Cerkevich, A., Choi, J., & Reisch, E. (2013). Adult attachment, attachment to the supervisor, and the supervisory alliance: How they relate to novice therapists’ perceived counseling self-efficacy. Psychotherapy, 50(2), 178-88.

Choi, J., Kim, S., & Yoon, K. (2012). CAFA (v 1.0 Beta) System: Computer Adaptive Formative Assessment System for Educational Services [Computer System]. eMathTest, Inc.

Choi, J., Kim, S., Chen, J., & Dannels, A. S. (2011). A comparison of maximum likelihood and Bayesian Estimation for Polychoric Correlation using Monte Carlo simulation. Journal of Educational and Behavioral Statistics, 36(4), 523-549.

Choi, J., Dunlop, M., Chen, J., & S. Kim. (2011). A comparison of different approaches for coefficient alpha for ordinal data. Journal of Educational Evaluation, 24(2), 485-506.

Tekleselassie, A., Mallery, C., & Choi, J. (2011). Applying the multivariate model to unpack the gender gap in college access among African Americans and Caucasians. Graduate School of Education and Human Development Working Paper Series. The George Washington University.

Choi, J., Peters, M., & Mueller, R. (2010). Correlational analysis of ordinal data: From Pearson's r to Bayesian Polychoric Correlation. Asia Pacific Education Review, 11, 459-466.

Stewart, J. F., Mallery, C., & Choi, J. (2010). A multilevel analysis of distance learning achievement: Are college students with disabilities making the grade? Journal of Rehabilitation, 76(2), 27-39.

Choi, J. (2010). ezIA User’s Guide Korean Version [Software Manual], 1st edition.

Kroopnick, H. M., Chen, J., Dayton, C. M., & Choi, J. (2010). Assessing classification bias in latent class analysis: Comparing resubstitution and leave-one-out methods. Journal of Modern Applied Statistical Methods, 9(1), 52-63.

Choi, J., Fan, W., & Hancock, G. R. (2009). A note on confidence intervals for two-group latent mean effect size measures. Multivariate Behavioral Research, 44(3), 396-406.

Choi, J., Harring, J. R., & Hancock, G. R. (2009). Latent growth modeling for logistic response functions. Multivariate Behavioral Research, 44(5), 620-645.

Marmarosh, C., Gelso, C., Markin, R., Majors, R., Mallery, C., & Choi, J. (2009). The real relationship in psychotherapy: Relationships to adult attachments, working alliance, transference, and therapy outcome. Journal of Counseling Psychology, 56(3), 337-350.

Chen, J., & Choi, J. (2009). A comparison of maximum likelihood and expected a posteriori estimation for polychoric correlation using Monte Carlo simulation. Journal of Modern Applied Statistical Methods, 8, 337-354.

Choi, J., Chen, J., & Kim, S. (2009). BayesPCC (v 3.0.0): A stand-alone Microsoft Windows software program for estimating Polychoric correlation matrices using Bayesian estimation methods [Computer software].

Chen, J., Choi, J., & Kim, S. (2009). BayesPCC for Windows User’s Guide [Software Manual], 2nd edition.

Choi, J., Kim, S., & Yoon, K. (2009). ezIA (v 1.0.0): A Microsoft Excel Add-In for Test Item Analysis [Computer Software]. Delta Sigma Soft, Inc.

Choi, J., Kim, S., & Yoon, K. (2009). ezIA (v 1.0.0): A Microsoft Excel Add-In for test item analysis [Computer software].

Choi, J., & Chen, J. (2009). ezIA User’s Guide [Software Manual], 2nd edition.

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC: A Matlab subroutine for estimating polychoric correlation matrices using an Expected A Posteriori estimation method. [Matlab Subroutine].

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC for Windows User’s Guide [Software Manual], 1st edition.

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC: Matlab Subroutine User’s Guide [Software Manual].

Hancock, G. R., & Choi, J. (2006). A vernacular for linear latent growth models. Structural Equation Modeling: A Multidisciplinary Journal, 13, 352-377.

In the News

Dr. Jaehwa Choi presented a session entitled, "CryptoTest: Solution to AoI Trilemmausing Blockchain and Crypto-economy System" at the 2018 Beyond Multiple Choice conference in Washington, D.C.

Dr. Jaehwa Choi and Dr. William Dardick provided a one-day on site training for the Office of the State Superintendent of Education (OSSE) in DC about the "Basics of Educational Measurement."

Dr. Jaehwa Choi gave three presentations in South Korea: 1) "CryotoTest: Solution to AoI Trilemma using Blockchain and Crypto-economy system," at the e-Learning Korea 2018 Conference; 2) "Policy Implications of Automatic Item Generation," at the Korea Institute for Curriculum and Evaluation; and 3) "Policy Implications of Teacher Empowered Assessment (TEA) Framework," at the Global Symposium on ICT in Education.

Dr. Jaehwa Choi gave a talk entitled "Automatic Item Generation: Psychometric Implications" for the AIR Assessment Group at the American Institute of Research in Washington, D.C. In addition, Dr. Choi presented "Logistic Growth Curve Models: Predictive Learning Progress Accountability System" for the NAEP team at American Institute of Research.

Innovative Applications of Knowledge Discovery and Information Resources Management, edited by Dr. Susan Swayze with GSEHD alumna Dr. Valerie Ford (Ed.D., Human and Organizational Learning), has been published by IGI Global.
The volume contains 12 chapters segmented into three sections: (1) People and Technology Issues in the Twenty-First Century, (2) Knowledge Discovery and Learning, and (3) Perspectives on Information Resources Management. The book was written by 20 authors representing six countries. GSEHD chapter contributors include Dr. Jaehwa Choi, alumna Dr. Letitia Larry (Ed.D., Executive Leadership Program), alumnus Dr. Thomas Gronow (Ed.D., Human and Organizational Learning), doctoral candidate Tina Rodrigue (Ed.D., Executive Leadership Program), and alumna Danielle Young (master's, Assessment, Testing, and Measurement). Although the publication is intended as a reference book marketed to libraries, the scope of this work underscores the interdisciplinarity of information technology and data science.