Jaehwa Choi

Jaehwa Choi
Associate Professor, Assessment, Testing, and Measurement
(202) 994-2602

Jaehwa Choi is Associate Professor and Program Director of the Assessment, Testing, and Measurement Program in the Department of Educational Leadership.

He is also the Executive Director of the Computer Adaptive Formative Assessment (CAFA) Laboratory (CAFA Lab, Inc.) and has conducted various Information and Communication Technology (ICT)-based assessment projects in collaboration with Samsung Electronics (Intelligence Solution Team), Korea Institute for Curriculum and Evaluation (KICE; Assessment Advancement Team), Korea Research Institute for Educational Assessment (KRIEA), and others.

His research interests and current projects include:

  • Next Generation Assessment Models: Truncated or semi-truncated logistic (a.k.a., PTL or PSTL) item response theory models; Non-linear growth modeling for latent traits; assessment models for machine/artificial intelligence; Markov chain Monte Carlo (MCMC) estimation methods, advanced structural equation models; hierarchical linear models.
  • Intelligent Assessment Engineering Systems: Automatic item generation (AIG) using machine learning techniques; computer-adaptive formative assessment models; educational big data analytic systems; problem solving artificial intelligent (AI) System using Deep Learning Artificial Neural Network (DL ANN); diagnostic assessment system using DL ANN.
  • Technology-enhanced STEM Education Applications: K-Math Workbook System using AIG (6 and 7 grades); CAFA Smart Assignment System for K-12 Math; Pathway to Advancement and Success in Statistics (PASS) System.

He has also authored or invented several assessment systems and statistical analysis software programs:

  • CAFA AIG System (v 1.0 Beta): An innovative assessment tool that integrates cognitive and psychometric theories with assessment development theory and practices in order to generate assessment items using state-of-the-art technology. (http://AIG.CAFALab.com/)
  • CAFA K-Math Workbook System (v 1.0 Beta): Computer Adaptive Formative Assessment Client Application for Common Core Math Workbook [Computer System]. CAFA Lab, Inc. (http://K-Math.CAFALab.com/)
  • CAFA Smart Assignment System (v 1.0 Beta): Computer Adaptive Formative Assessment Client Application for School Assignments [Computer System]. CAFA Lab, Inc.
  • CAFA System (v 1.0 Beta): Computer Adaptive Formative Assessment System for Educational Services [Computer System]. CAFA Lab, Inc. (http://eMathTest.com/CAFA)
  • BayesPCC (v 3.0.0): A stand-alone Microsoft Windows software program for estimating Polychoric correlation matrices using Bayesian estimation methods.
  • ezra (v 1.0.0): A Microsoft Excel Add-In for test item analysis.

He served as co-chair (2010-2011) and chair (2011-2012) of the Structural equation modeling special interest group of the American Educational Research Association. He also served as a member of the constitution and by-laws committee (2009-2010) and treasurer (2011-2012) of the Korean-American Educational Researchers Association. He has taught dozens of assessment or quantitative methods workshops (e.g., Automatic Item Generation, Assessment Engineering, Multilevel Analysis, SPSS Syntax, etc.) in the United States and abroad.

For more information (e.g., office hours, course information, research projects, etc.) visit his personal website (http://Jaehwa.Choi.CAFALab.com).

Education
Ph.D., University of Maryland
M.A., University of Maryland
B.A., Department of Business Administration, Sogang University
B.A., Department of Philosophy, Sogang University

Publications

Chen, J., Zhang, D., & Choi, J. (2014). Estimation of the latent mediated effect with ordinal data using the limited-information and Bayesian full-information approaches. Behavioral Research Methods.

Marmarosh, C., Bieri, K., Schutt, J., Barone, C., & Choi, J. (2014). The insecure psychotherapy base: Using client and therapist attachment styles to understand the early alliance. Psychotherapy.

Chen, J., Choi, J., Stapleton, L. & Weiss, B. (2014). An empirical evaluation of mediation effect analysis with manifest and latent variables using Markov chain Monte Carlo and alternative estimation methods. Structural Equation Modeling: A Multidisciplinary Journal, 21(2).

Choi, J., Kim, S., & Yoon, K. (2014). CAFA Automatic Item Generation (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for Automatic Item Generation [Computer System]. eMathTest, Inc.

Choi, J., Kim, S., & Yoon, K. (2014). CAFA Smart Workbook (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for Common Core Math Workbook [Computer System]. eMathTest, Inc.

Stewart, J. F., Mallery, C., & Choi, J. (2013). College student persistence: A multilevel analysis of distance learning course completion at the crossroads of disability. Journal of College Student Retention: Research, Theory & Practice, 15(3), 367-385.

Levy, R. & Choi, J. (2013). An introduction to Bayesian structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (2nd ed.). Greenwood, CT: Information Age Publishing, Inc.

Choi, J. & Kim, S. (2013). Reliability. In Kim, S. (Eds.), Educational measurement (4th ed. Trans. in Korean). New York: American Council on Education and Macmillan.

Tekleselassie, A., Mallery, C., & Choi, J. (2013). Applying the multivariate model to unpack the gender gap in college access among African Americans and Caucasians. Journal of Negro Education, 82(2), 139-156.

Choi, J., Kim, S., & Yoon, K. (2013). CAFA Smart Assignment (v 1.0 Beta) System: Computer Adaptive Formative Assessment Client Application for School Assignments [Computer System]. eMathTest, Inc.

Marmarosh, C., Nikityn, M., Moehringer, J., Ferraioli, L., Kahn, S., Cerkevich, A., Choi, J., & Reisch, E. (2013). Adult attachment, attachment to the supervisor, and the supervisory alliance: How they relate to novice therapists’ perceived counseling self-efficacy. Psychotherapy, 50(2), 178-88.

Choi, J., Kim, S., & Yoon, K. (2012). CAFA (v 1.0 Beta) System: Computer Adaptive Formative Assessment System for Educational Services [Computer System]. eMathTest, Inc.

Choi, J., Kim, S., Chen, J., & Dannels, A. S. (2011). A comparison of maximum likelihood and Bayesian Estimation for Polychoric Correlation using Monte Carlo simulation. Journal of Educational and Behavioral Statistics, 36(4), 523-549.

Choi, J., Dunlop, M., Chen, J., & S. Kim. (2011). A comparison of different approaches for coefficient alpha for ordinal data. Journal of Educational Evaluation, 24(2), 485-506.

Tekleselassie, A., Mallery, C., & Choi, J. (2011). Applying the multivariate model to unpack the gender gap in college access among African Americans and Caucasians. Graduate School of Education and Human Development Working Paper Series. The George Washington University.

Kroopnick, H. M., Chen, J., Dayton, C. M., & Choi, J. (2010). Assessing classification bias in latent class analysis: Comparing resubstitution and leave-one-out methods. Journal of Modern Applied Statistical Methods, 9(1), 52-63.

Choi, J., Peters, M., & Mueller, R. (2010). Correlational analysis of ordinal data: From Pearson's r to Bayesian Polychoric Correlation. Asia Pacific Education Review, 11, 459-466.

Stewart, J. F., Mallery, C., & Choi, J. (2010). A multilevel analysis of distance learning achievement: Are college students with disabilities making the grade? Journal of Rehabilitation, 76(2), 27-39.

Choi, J. (2010). ezIA User’s Guide Korean Version [Software Manual], 1st edition.

Choi, J., & Chen, J. (2009). ezIA User’s Guide [Software Manual], 2nd edition.

Choi, J., Fan, W., & Hancock, G. R. (2009). A note on confidence intervals for two-group latent mean effect size measures. Multivariate Behavioral Research, 44(3), 396-406.

Choi, J., Harring, J. R., & Hancock, G. R. (2009). Latent growth modeling for logistic response functions. Multivariate Behavioral Research, 44(5), 620-645.

Marmarosh, C., Gelso, C., Markin, R., Majors, R., Mallery, C., & Choi, J. (2009). The real relationship in psychotherapy: Relationships to adult attachments, working alliance, transference, and therapy outcome. Journal of Counseling Psychology, 56(3), 337-350.

Chen, J., & Choi, J. (2009). A comparison of maximum likelihood and expected a posteriori estimation for polychoric correlation using Monte Carlo simulation. Journal of Modern Applied Statistical Methods, 8, 337-354.

Choi, J., Chen, J., & Kim, S. (2009). BayesPCC (v 3.0.0): A stand-alone Microsoft Windows software program for estimating Polychoric correlation matrices using Bayesian estimation methods [Computer software].

Chen, J., Choi, J., & Kim, S. (2009). BayesPCC for Windows User’s Guide [Software Manual], 2nd edition.

Choi, J., Kim, S., & Yoon, K. (2009). ezIA (v 1.0.0): A Microsoft Excel Add-In for Test Item Analysis [Computer Software]. Delta Sigma Soft, Inc.

Choi, J., Kim, S., & Yoon, K. (2009). ezIA (v 1.0.0): A Microsoft Excel Add-In for test item analysis [Computer software].

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC: A Matlab subroutine for estimating polychoric correlation matrices using an Expected A Posteriori estimation method. [Matlab Subroutine].

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC for Windows User’s Guide [Software Manual], 1st edition.

Choi, J., Chen, J., & Kim, S. (2007). EAPPCC: Matlab Subroutine User’s Guide [Software Manual].

Hancock, G. R., & Choi, J. (2006). A vernacular for linear latent growth models. Structural Equation Modeling: A Multidisciplinary Journal, 13, 352-377.

In the News

Dr. Jaehwa Choi provided an invited talk entitled Automatic Item Generation: Game Changer of Educational Reform in the Era of 4th Industrial Revolution at the 2017 meeting of the Global HR Forum in Seoul, Korea. He gave another invited presentation entitled Introduction to Assessment Engineering Framework at Korea Education and Research Information Service (KERIS) at Taegu, Korea. In addition, Dr. Choi led a one-day workshop, Next Generation Item and Test Development: A Practical Introduction to Automatic Item Generation, for the members of Korean Society for Educational Evaluation in Seoul, Korea.

Dr. Jaehwa Choi and researchers at CAFA Lab., Inc., provided a four-day professional training program to CISCO Systems. This webinar training was specially designed to teach how to develop Automatic Item Generation (AIG) templates using the Computer Adaptive Formative Assessment (CAFA) AIG System.

Dr. Jaehwa Choi presented a paper entitled General Logistic Latent Growth Models: An Inherently Nonlinear Growth Modeling Framework at the 2017 annual meeting of the National Council on Measurement in Education (NCME) with Dr. Ji Hoon Ryoo from UVA and Dr. Jeff Harring from UMCP.

Dr. Jaehwa Choi and Dr. Ji Hoon Ryoo (University of Virginia) co-instructed the 2017 Spring Assessment, Testing and Measurement (ATM) Workshop Series on SPSS Syntax and STATA. More than 120 registered participants took part in the workshops which covered introductory and intermediate level data analysis topics.

Dr. Jaehwa Choi conducted an ATM Workshop titled Data Analysis with SPSS Syntax Intro-Level. This workshop provided an overview of the SPSS Syntax system and the benefits of it over the point and click method. After the overview, several intro-level statistical modules implementations were demonstrated using the Syntax system.