Research - Presentations

Presentations 2019-2020

Students noted in bold.

Invited Speakers

Bandalos, D.L., Coleman, C., & Henderek, J. G. (2019, October). Causes of CFA correlated residuals and what you can do about them. Presidential address at the annual meeting of the Society for Multivariate Experimental Psychology, Baltimore, MD.

Horst, S.J. (2019, October). Dealing with Drift, Missing Data, and Anchor Instability. Invited discussant presentation at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Huff, K., Markus, K., Sireci, S., & Bandalos, D. (Moderator). (2020, October). Validity evidence based on testing consequences. Invited virtual panel session at the annual meeting of the Northeastern Educational Research Association (NERA).

Hundley, S.P. (Moderator), Fulcher, K.H., Jankowski, N., Kinzie, J., & Orr, V.F. (2020, October) Plenary session and virtual panel discussion at the IUPUI Assessment Institute.

Leventhal, B.C. (2020, September). The fields of quantitative psychology and educational/psychological measurement. Invited virtual talk to the Data Analytics Though Applied Statistics club at the University of Pittsburgh.

Leventhal, B.C. (2020, October). What are quantitative psychology, measurement, and assessment? Invited virtual talk for Applications of Psychology at Washington & Lee University, Lexington, VA.

Pope, A., & Prendergast, C.(2019, September). A simple model for learning improvement: Weigh pig, feed pig, weight pig. Invited keynote speakers at Best Practices in Assessment & Continuous Improvement workshop at the University of North Alabama, Florence, AL.

Prendergast, C., & Pope, A. (2019, September). Learning improvement best practices. Invited workshop delivered as part of the Best Practices in Assessment & Continuous Improvement workshop at the University of North Alabama, Florence, AL.

Prendergast, C., Pope, A., & Horst, S. J. (2019, October). Creating the Assessment Skills Framework: Classifying and identifying professional development needs. Presentation at the IUPUI Assessment Institute, Indianapolis, IN.

Randall, J., Rios, J., Buckendahl, C., Finney, S.J., Huff, K., Madison, M., & Tong, Y. (2020, April). Graduate training in educational measurement and psychometrics: A curricula review of graduate programs in the U.S. Panel session at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.

Professional Workshops

Bandalos, D.L. (June, 2019). Scale Development and Evaluation. Invited workshop for Portland State University Workshop Series. Portland, OR.

Bandalos, D.L., & Spratto, E.M. (2020, February). Developing non-cognitive scales: Research-based recommendations. Center for Faculty Innovation, James Madison University.

Bao, Y. & Satkus, P. (2020, December). Evaluating the assessment of student learning in higher education institutions. Virtual pre-conference workshop presented at the annual meeting of the Southern Association of Colleges and Schools, Commission on Colleges (SACSCOC).

Coleman, C., Prendergast, C.P, & Fulcher, K.H. (2020, December). More than results: Reframing assessment as learning improvement. Virtual pre-conference workshop presented at the annual meeting of the Southern Association of Colleges and Schools, Commission on Colleges (SACSCOC).

Craig, B.G., Perkins, B.A., Horst, S.J., & Harris, H.D. (2019, October). Generalized Boosted Modeling in R. Workshop presented at the annual conference of the Northeastern
Educational Research Association, Trumbull, CT.

Finney, S.J. (2020, May). Implementation fidelity: Data you need when evaluating and improving programming. Workshop presented at the Higher Education Assessment Conferences, Henniker, NH.

Fulcher, K.H. & Prendergast, C.P. (2020, October). More than results: An advanced workshop integrating assessment with learning improvement. Virtual pre-conference workshop delivered at the IUPUI Assessment Institute.

Horst, S.J., Lovett, M., Hershock, C., Finney, S.J. & Fulcher, K. H. (2019, June). Assessment for learning improvement: Comparing two universities’ approaches to reveal key principles and strategies. Educause Webinar.

Horst, S.J., & Perkins, B. (2020, October). Quasi-experimental research designs within the educational context. Virtual workshop presented at the annual meeting of the Northeastern Educational Research Association (NERA).

Leventhal, B.C., & Hathcoat, J.D. (2019, October). Supporting the interpretations and uses of assessment scores: What reliability and validity mean and why they are necessary. Workshop presented at the IUPUI Assessment Institute, Indianapolis, IN.

Leventhal, B.C., & Hathcoat, J.D. (2019, December). Reframing assessment evidence: How evidence should be used to make valid and reliable interpretations of assessment data. Workshop presented at the annual meeting of the Southern Association of Colleges and Schools Commission on Colleges (SACSCOC), Houston, TX.

Leventhal, B.C., & Thompson, K.N. (2020, December). Investigating the reliability and validity of our assessment evidence. Virtual pre-conference workshop presented at the annual meeting of the Southern Association of Colleges and Schools, Commission on Colleges (SACSCOC).

Patterson, H., & Finney, S.J. (2020, March). The multi-level assessment cycle: Defining everyone’s contribution to student learning outcomes assessment. Presented at the annual meeting of NASPA, Austin, TX.

Pope, A.M., Horst, S.J., Prendergast, C., Finney, S.J., & Crewe, M.* (2019, June). Let’s get real: Applying research design principles to a messy assessment world. Workshop presented at the annual meeting of the Association for the Assessment of Learning in Higher Education (AALHE). St. Paul, MN.

Pope, A., Prendergast, C., Crewe, M., & Horst, S. J. (2019, April). Answering the right questions…Can we back up that claim? Virginia Assessment Group 2019 Spring Drive-In.  Telepresence workshop across six Virginia universities, Harrisonburg: VA.

Pope, A., & Finney, S.J. (2020, March). Building evidence-informed programs: A practical guide to applying theory and research to practice. Sponsored session at the annual meeting of NASPA, Austin, TX.

Pope, A., Patterson, C., Gonzalez, S., & Finney, S.J. (2019, Nov). Inspiration to action: Using program theory to engage with learning outcomes assessment. Presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

National and International Presentations

Ames, A.J., Depaoli, S., Leventhal, B.C., Middleton, K., & Willse, J. (2020, July). Recruiting students for the measurement profession. Virtual panel session for the Special Interest Group in Measurement in Education of the National Council of Measurement in Education (NCME).

Bao, Y. (2019, October). A Preliminary Study of Model Selection Indices for Polytomous-attribute Diagnostic Classification Models. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Bao, Y., Urquhart, K., & Speno, M. (moderator). (2020, October). A good dissertation is a finished dissertation, but what comes next?: Post-dissertation potential. GSIC Virtual panel session at the annual meeting of the Northeastern Educational Research Association (NERA).

Blanco, D., Shapovalov, Y., Hathcoat, J.D., & Leventhal, B. (2019, June). Item analysis in criterion-referenced testing: A study of differences in pre, post, and pre-post judgments. Poster presented at the Annual meeting of the American Psychological Society, Washington, DC.

Boyne, S., Fulcher, K. H., & Horst, S. J. (2019, June). Cross-pollination: Visiting other institutions and bringing assessment strategies back home. Presentation at the annual meeting of the Association for the Assessment of Learning in Higher Education (AALHE), St. Paul, MN.

Carrier, H.S., Clarke, K., Leventhal, B.C., & Vess, D. (2019, November). The efficacy of tutorial-test model for first-year information literacy skills competency development. Paper presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Clarke, K. & Leventhal, B.C. (2019, September). Effectively communicating general education learning outcomes to multiple stakeholders. Paper presented at the Association of General and Liberal Studies Constitute, Orlando, FL.

Clauser, A., Leventhal, B.C., Lottridge, S., Smith, K., & Perkins, B. (moderator). (2020, October). Navigating the in-person or virtual interview process. GSIC virtual panel session at the annual meeting of the Northeasten Educational Research Association (NERA).

Craig, B.G., Horst, S.J., & Harris, H.D. (2019, October). Sonography Certification Examinations: Ine Influence of Practice Tests and Self-Selection Bias. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Ezike, N., Ames, A.J., & Leventhal, B.C. (2020, September). Evaluation of the SAS IRT procedure: Parameter recovery and item fit. Paper presented virtually at the annual meeting of the National Council on Measurement in Education (NCME).

Finney, S.J. & Buchanan, H. (2020, October). A more efficient path to learning improvement: The utility of evidence-informed programming and practices. Virtual session presented at the IUPUI Assessment Institute.

Finney, S.J., & Henning, G. (2020, October). Incorporating program theory and implementation fidelity in CAS self-study. Virtual session presented at the IUPUI Assessment Institute.

Fulcher, K.H., Horst, S.J., & Patterson, C. (2020, October). Developing an assessment and improvement skillset. Sponsored virtual session at the IUPUI Assessment Institite.

Garant, R.C., Perkins, B.A., Hartka, T.A., & Horst, S.J. (2019, November). Nobody put assessment results in the corner! Effectively using assessment results, program theory, and implementation fidelity to evidence learning improvement. Paper presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Gregg, N., & Leventhal, B.C. (2019, July). An IRTree approach investigating the construct dependency of response styles.Poster presentation at the annual International Meeting of the Psychometric Society, Santaigo, Chile.

Gregg, N., & Leventhal, B.C. (2019, October). Evidence of a two-stage response process from adaptive Likert items. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Gregg, N. (2019, October). Student perceived relevance and confidence of success in general education: A cohort comparison. Paper presented at the annual meeting of the Northeastern Educational Research Association (NERA), Trumbull, CT.

Harris, H.D., & Horst, S.J. (2019, July). The effect of differential measurement error on treatment effect estimation. Paper presented at the annual International Meeting of the Psychometric Society, Santiago, Chile.

Hathcoat, J.D., Blanco, D., Leventhal, B., Shapovalov, Y. (2019, October). Using item analysis to improve assessment instruments. Oral presentation provided at the annual meeting of the IUPUI Assessment Institute, Indianapolis IA.

Hathcoat, J.D., & Gregg, N. (2020, February). The importance of context and intentional assignment design in assessment. Oral presentation provided at the annual American Association of Colleges and Universitites General Education conference, Jacksonville, FL.

Hathcoat, J.D., Blanco Murakoshi, D., Leventhal, B.C., & Shapovalov, Y. (2019, October). Using item-level statistics to improve assessment instruments. Paper presented at the IUPUI Assessment Institute, Indianapolis, IN.

Hazard, G., Clarke, K., & Leventhal, B.C. (2019, November). Students’ value of general education: What perception data tells us about our students. Paper presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Holmes, P., & Leventhal, B.C. (2019, November). Thinking critically about critical thinking: What predicts students’ critical thinking ability? Poster presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Horst, S.J. (2019, November). User-centered library collection assessment. Discussant for scholarly paper session at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Horst, S. J., & Leventhal, B. C. (2019, June). Asking questions: A guide for how to use assessment to connect faculty with administration interests. Paper presentation at the annual meeting of the Association for the Assessment of Learning in Higher Education (AALHE), St. Paul, MN.

Horst, S.J., Lovett, M., Hershock, C., Finney, S.J. & Fulcher, K. H. (2019, June). Assessment for learning improvement: Comparing two universities’ approaches to reveal key principles and strategies. Educause Webinar.

Horst, S.J., & Prendergast, C.P. (2020, October). Planning assessment professional development opportunities: Applying an expectancy-value theory lens. Virtual session presented at the IUPUI Assessment Institute.

Leventhal, B.C. (2019, October). Assessment and measurement and quantitative psychology: What are they and why study each? Webinar presented through the Kenyon College Institutional Effectiveness Office.

Leventhal, B.C., Schubert, L., & Trybus, M. (2019, October). Beyond buy-in: Inspiring faculty participation in assessment. Paper presented at the IUPUI Assessment Institute, Indianapolis, IN.

Montenegro, E., Pope, A., & Prendergast, C. (2019, October). Improvement for whose benefit? How issues of equity impact campus assessment efforts. Presented at the IUPUI Assessment Institute, Indianapolis, IN.

Gregg, N. (2019, October). Student perceived relevance and confidence of success in general education: A cohort comparison. Paper presented at the annual meeting of the Northeastern Educational Research Association (NERA), Trumbull, CT.

Pastor, D.A. (2019, November). Using the Political Engagement Project Survey to understand change in college students’ civic competency and engagement. Presentation at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Patterson, C.R., & Pastor, D.A. (2019, October). Political participation profiles in college student populations. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Pedrick, B., & Leventhal, B.C. (2019, November). The use of generalizability theory to determine measurement error on an ethical reasoning performance assessment. Poster presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Perkins, B. A. & Horst, S. J. (2020, Apr). Propensity score analysis when treatment group is larger than comparison group: An applied assessment example. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA. https://convention2.allacademic.com/one/aera/aera20/ (Conference cancelled)

Perkins, B.A., Finney, S.J., & Satkus, P. (2019, July). Predicting examinee effort and test performance from change in emotions during a test: A latent growth model. Paper presented at the European Conference on Psychological Assessment, Brussels, Belgium.

Perkins, B.A., Pastor, D.A., & Finney, S.J. (2020, April). Examining the relations between emotions, importance, and expended effort during a low-stakes institutional accountability test. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.

Perkins, B. A. & Patterson, C.R. (2020, October). One criterion at a time: A guide to developing an analytic rubric. Virtual session presented at the IUPUI Assessment Institute.

Pike, G.R., McConnell, K., & Hathcoat, J.D. (2019, October). The methodology behind the VALUE approach to assessment: Empirical evidence, pragmatic “lessons learned” and future directions. Oral presentation provided at the annual meeting of the IUPUI Assessment Institute, Indianapolis IA.

Pope, A., Patterson, C., Gonzalez, S., & Finney, S.J. (2019, November). Inspiration to action: Using program theory to engage with learning outcomes assessment. Presented at the annual meeting of the Virginia Assessment Group, Richmond, VA.

Pope, A., Bare, A., & Finney, S.J. (2020, March). Overhauling and assessing an academic success program: An example of theory to practice. Paper presented at the annual meeting of NASPA, Austin, TX.

Prendergast, C., Pope, A., & Horst, S.J. (2019, October). Creating the Assessment Skills Framework: Classifying and identifying professional development needs. Presented at the IUPUI Assessment Institute, Indianapolis, IN.

Satkus, P., Finney, S.J., & Perkins, B.A. (2019, July). Examining the functioning of test emotion items across testing platforms and gender: A measurement invariance study. Paper presented at the European Conference on Psychological Assessment, Brussels, Belgium.

Satkus, P., & DeMars, C.E. (2019, October). Examining the Effects of Specifying Bayesian Priors on the Wald’s Test for DIF. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT.

Satkus, P., & DeMars, C.E. (2019, October). An Applied Example of a Two-Tier Multiple Group Testlet Model. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT.

Satkus, P., & DeMars, C. E. (2020, April). Examining the Performance of the Alignment Method in DIF Analyses. Paper presented at the annual meeting of the the National Council on Measurement in Education, San Francisco, CA. (conference cancelled)

Satkus, P., & Finney, S.J. (2020, April). Test value and emotions: Predicting examinee effort and performance on low-stakes tests. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA. (Conference canceled)

Sauder, D.C. (2019, October). Examining the effects of missing data on covariates used in propensity score matching. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT.

Shapovalov, Y., Blanco Murakoshi, D., & Prendergast, C.P. (2020, October). Planning for learning improvement: The role of hypothetical examples. Virtual session presented at the IUPUI Assessment Institute.

Smith, K.L., & Finney, S.J. (2019, November). Helping students learn better: Elevating program theory and implementation fidelity in a university-level context. Paper presented at the annual meeting of the Association for the Study of Higher Education, Portland, OR.

Spratto, E.M., Bandalos, D.L., & Leventhal, B.C. (2019, October). Seeing the forest and the trees: Applying IRTree models to noncognitive data. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Stitt-Bergh, M., Gorksi, K., Baker, G., Fulcher, K.H., & Van Dyke, R. (Moderator). (2020, October). Perspectives on learning improvement. Sponsored virtual panel session at the IUPUI Assessment Institite.

Tang, H., & Bao, Y. (2019, October). Educators’ Usage of Open Educational Resources: Comparison by Nations. The 16th Annual Open Education Conference, Phoenix, AZ.

Thompson, K.N., & Leventhal, B.C. (2020, September). The impact of undesirable distractors on estimates of ability. Paper presented virtually at the annual meeting of the National Council on Measurement in Education (NCME).

Thompson, K.N., & Leventhal, B.C. (2019, October). Interpreting distractor function: The paradigm does matter. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT.

Ziegler, C.K., McFatrich, M., Lucas, N., & Leventhal, B.C. (2019, October). A novel IRTree Model for identifying extreme response styles using anchoring vignettes. Poster presented at the International Society for the Quality of Life Research Annual Conference, San Diego, CA

Internal Workshops and Presentations

Craig, B.G., Perkins, B.A., Horst, S.J., & Harris, H.D. (2019, October). Generalized Boosted Modeling in R. Workshop presented to the Center for Assessment & Research Studies and Inteleos (virtually), Harrisonburg, VA.

Garant, R.C., Perkins, B.A., Hartka, T.A., & Horst, S.J. (2019, November). Nobody puts assessment results in the corner! Effectively using assessment results, program theory, and implementation fidelity to evidence learning improvement. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.

Gregg, N. (2019, September). Education accountability and assessment: The National Center for the Improvement of Educational Assessment. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.

Gregg, N., & Leventhal, B.C. (2019, October). Evidence of a two-stage response process from adaptive Likert items. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.

Hathcoat, J.D., Blanco Murakoshi, D., Leventhal, B.C., & Shapovalov, Y. (2019, October) Using item analysis to improve assessment instruments. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.

Herr, R., & Leventhal, B.C. (2020, September). Longitudinal growth of students’ information literacy skills at JMU. Presented virtually as a part of the Student Internship Research Symposium hosted by the Center for Assessment & Research Studies at James Madison University.

Pope, A., Patterson, C., Gonzalez, S., & Finney, S.J. (2019, November). Inspiration to action: Using program theory to engage with learning outcomes assessment. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.

Satkus, P., & DeMars, C. E. (2020, April). Examining the Performance of the Alignment Method in DIF Analyses. Paper presented at the annual meeting of the the National Council on Measurement in Education, San Francisco, CA. (conference cancelled)

Satkus, P., & DeMars, C. E. (2019, October). Examining the Effects of Specifying Bayesian Priors on the Wald's Test for DIF. Paper presented at the annual meeting of the Northeastern Educational Research Association. Rocky Hill, CT.

Satkus, P., & DeMars, C. E. (2019, October). An Applied Example of a Two-Tier Multiple-Group Testlet Model. Paper presented at the annual meeting of the Northeastern Educational Research Association. Rocky Hill, CT.

Thompson, K.N., & Leventhal, B.C. (2019, October). Interpreting distractor functioning: the paradigm does matter. Presented as part of the CARS Talk Symposium Series at James Madison University, Harrisonburg, VA.