Research - Presentations

Presentations 2017-2018

Students noted in bold.

Invited Speakers

Curtis. N. A, Brown, S., Fulcher, K. H, & Race, P. (June, 2018). UK/US Higher Education Assessment Think Tank Summit. Organized and run by the authors. Participants include 20 of the leading names in higher education assessment in the UK and US. Two-Day meeting in Leeds, United Kingdom.

Curtis, N. A. (April, 2018). Student-Faculty Partnership in the Assessment Process. Invited half-day workshop to faculty, staff, students, and administration of Middle Tennessee State University. Approximately 50 people in attendance.

Curtis, N. A. (April, 2018). Student-Faculty Partnership in the Assessment Process. Invited keynote presentation to faculty, staff, students, and administration of Middle Tennessee State University. Approximately 100 people in attendance.

Curtis, N. A., & Au, C. B. (2017, October). Meta-assessment: Evaluating and improving academic program assessment to better inform improvement efforts. Invited workshop presented at the IUPUI Assessment Institute, Indianapolis, IN. Approximately 40 people in attendance.

Finney, S. J. (2018, March). Toward more accurate inferences: Test-taking motivation matters. Invited presentation for the Empirical Educator Project, Stanford University. Approximately 50 people in attendance. HEA http://www.psyc.jmu.edu/assessment/features/stanford.html

Fulcher, K. H. (2018, February). Invited Keynote Presentation at Western Carolina University on learning improvement. Cullowhee, NC. Approximately 75 people in attendance.

Fulcher, K. H. (2018, March). Learning Improvement through Assessment: From Experiences at James Madison University. Invited presentation at Combining Course and Program Level Learning Outcomes Assessment Symposium. Sponsored by JSPS KAKENHI Grant Number JP15H03473. Kyoto, Japan. Approximately 80 people in attendance.

Fulcher, K. H. (2018, March). Philosophical Education in Japan. Thoughts for Your Consideration. Moderator for Japanese philosophy group seminar, sponsored by Japan’s National Institute for Educational Policy Research, Kyoto, Japan. Approximately 15 people in attendance.

Holzman, M. A., & Gregg, N. L. (2017, November). Introduction to assessment. Invited presentation at the annual meeting of the Virginia Assessment Group, Richmond, VA. Approximately 20 people in attendance.
Leventhal, B. C. (2017, September). Learning improvement in higher education. Invited talk for Discipline-Based Science Education Research Center. Pittsburgh, PA. Approximately 40 people in attendance. 

Pope, A. M. (2018, March). Deadly threats: Identifying and addressing major threats to the validity of assessment results. Invited presentation at the NASPA Student Personnel Administrators annual conference, Philadelphia, PA. Approximately 20 people in attendance.

Professional Workshops

Amato, H., Pope, A., & Holzman, M. A. (2017, December). Developing an assessment culture: Strategic approaches to faculty development in assessment. Workshop presented at the annual meeting of the Southern Association of Schools and Colleges - Commission on Colleges, Dallas, TX. Approximately 50 people in attendance.

Ames, A. J., Waterbury, G. T., & Holzman, M. (2017, December). Meta-assessment: Evaluating the quality of assessment practice. Workshop presented at the annual meeting of the Southern Association of Schools and Colleges - Commission on Colleges, Dallas, TX. Approximately 50 people in attendance.

Ames, A. J, Waterbury, G. T., & Perkins, B. A. (2018, June). Meta-Assessment: A Blueprint for Evaluating Programmatic Effectiveness. Skill building workshop presented at the Association for the Assessment of Learning in Higher Education Annual Conference, Salt Lake City, UT. Approximately 26 people in attendance.

Curtis, N. A., Anderson, R. D., & McDevitt, J. (June, 2018). Student Partnership in Program-Level Student Learning Outcomes Assessment. Workshop conducted at the annual conference of the Association for the Assessment of Learning in Higher Education (AALHE) in Salt Lake City, UT.  Approximately 15 number of people in attendance.

Fulcher, K. H., Good, M. R., Smith, K. L., & Coleman, C. D.  (2017, December). More than results: An advanced workshop integrating assessment with learning improvement. Workshop presented at the annual meeting of the Southern Association of Colleges and Schools Commission on Colleges, Dallas, TX. Approximately 70 people in attendance.

Goldberg, A., Markle, R., & Pastor, D. A. (2018, June). Civic engagement: From mission statements to meanings and measures. Pre-conference workshop at the annual Civic Learning and Democratic Engagement meeting, Anaheim, CA. Approximately 60 people in attendance.

Hathcoat, J. D., Gregg, N., & Curtis, N. (2017, December). Developing, Implementing, and Scoring Performance Assessments in the Arts and Humanities. A three-hour workshop presented at the annual meeting of the Southern Association of Schools and Colleges - Commission on Colleges, Dallas, TX. Approximately 30 people in attendance.

Holzman, M., & Gregg, N. (2017, November). Introduction to Assessment. A one-hour workshop presented at the annual meeting of the Virginia Assessment Group, Richmond, VA. Approximately 25 people in attendance.

Horst, S. J. (2017, October). JMU International Programs and Assessment. Workshop presented to administrative personnel at the Universitas Katolik Parahyangan (UNPAR). Bandung, Indonesia. 5 people in attendance

Horst, S. J. (2017, October). JMU Multicultural Programs and Assessment. Workshop presented to administrative personnel at the Universitas Katolik Parahyangan (UNPAR). Bandung, Indonesia. 5 people in attendance

Horst, S. J. (2017, October). Assessment at JMU. Workshop presented to administrative personnel at the Universitas Katolik Parahyangan (UNPAR). Bandung, Indonesia. 5 people in attendance. 

Horst, S. J. (2017, October). Critical Thinking and Ethical Reasoning at JMU. Workshop, including JMU’s It’s Complicated: Contagion, presented to law students and faculty at the Universitas Katolik Parahyangan (UNPAR). Bandung, Indonesia. 40 people in attendance.

Markle, R., Weiss, H. A., & Pastor, D. A. (2017, October). A house of civic engagement, a foundation for civic learning. Webinar sponsored by Educational Testing Service and hosted by the Chronicle of Higher Education. 206 people in attendance.

Markle, R., & Pope, A. M. (2018, May). The assessment process with improvement in mind. Workshop presented at the annual forum of the Association of Institutional Research, Orlando, FL. Approximately 35 people in attendance.

Stone, C. A., & Leventhal, B. C. (2018, April). Bayesian analysis of response style IRT models using SAS PROC MCMC. Workshop presented at the Annual Meeting of the National Council of Measurement in Education, New York, NY. Approximately 10 people in attendance. 

National and International Presentations

Ames, A. J., Curtis, N. A., Holzman, M. A., Ong, T. Q., & Smith, K. L. (2017, July). Detecting rater fatigue using Bayesian change point models. Paper presented at the International Meeting of the Psychometric Society, Zurich, Switzerland. Approximately 50 people in attendance.

Ames, A. J., Myers, A. J., Holzman, M. A., & Leventhal, B. C. (2017, October). IRTree models: Application to rater response processes. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT. Approximately 10 people in attendance.

Au, C. B., & Ames, A. J. (2018, April). Posterior predictive checking of local misfit for Bayesian confirmatory factor analysis. Poster presented at the annual meeting of the National Council on Measurement in Education, New York, NY. Approximately 30 people in attendance.

Bandalos, D. L., Hedeker, D., & Ames, A. J. (2017, July). Use of the Mixed-Effects Location-Scale Model to detect inconsistent responding. Paper presented at the International Meeting of the Psychometric Society, Zurich, Switzerland. Approximately 30 people in attendance.

Brown, C., Hathcoat, J. D., Hogbood, L., Wilson, S. (2018, April). The assessors and the assessed: Utilizing outside assessment for continuing growth. Panel discussion at the annual meeting of National Association of Communication Centers, Harrisonburg, VA.  Approximately 25 people in attendance.

Curtis, N. A., Ames, A. J., & Holzman, M. A. (2017, July). The Diagnostic Rating System (DRS): Stronger cognitive process validity evidence for performance assessment ratings. Poster presented at the International Meeting of the Psychometric Society, Zurich, Switzerland. Approximately 30 people in attendance.

Curtis, N. A. & Trice, A. D. (July, 2017). Cultural competence/responsiveness: Can it be measured? Can it be assessed? Presentation at the International School Psychology Association Conference in Manchester, United Kingdom. Approximately 20 people in attendance.

Curtis, N. A., & Anderson, R. D. (September, 2017). Student Partners in Program-Level Assessment: A Global Perspective. Presentation at the Engagement Scholarship Consortium in Auburn, AL. Approximately 20 people in attendance.

Curtis, N. A., Ames, A. J., & Holzman, M. A. (2017, October). The Diagnostic Rating System (DRS): Development and evidence for use. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT. Approximately 10 people in attendance.

Curtis, N. A., Pierrakos, O., & Anderson, R. D. (October, 2017). The Engineering Student Identity Scale: A cross disciplinary exploration of factor structure. Presented at the annual meeting of Frontiers in Education in Erie, PA. Approximately 20 people in attendance. 

Curtis, N. A., & Anderson, R. D. (December 2017). Partnering with Students in Program-Level Assessment. Presented at the annual meeting of the Southern Association of Colleges and Schools Commission on Colleges in Dallas, TX. Approximately 40 people in attendance.

Curtis, N. A., & Ames, A. J. (2018, April). Evaluating the utility of the Diagnostic Rating System for performance assessment. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY. Approximately 30 people in attendance.

Curtis, N. A., & Fulcher, K. H. (June 2018). The Pedagogy of Interteaching: Engaging students in the learning and feedback process. Presentation at the International Assessment in Higher Education Conference in Manchester, United Kingdom. Approximately 15 people in attendance.

Curtis, N. A., Anderson, R. D., & McDevitt, J. (June 2018). Student Partnership in Program-Level Student Learning Outcomes Assessment. Workshop at the Association for the Assessment of Learning in Higher Education in Salt Lake City, UT. Approximately 15 people in attendance.

Finney, S. J., & Horst, S. J. (2017, May). Extending the 3x2 achievement goal model to the general academic domain. Poster presentation at the annual meeting of the Association for Psychological Science. Boston, MA. Approximately 25 people in attendance.

Finney, S. J., & Horst, S. J. (2018, June). Student affairs professionals’ commitment to and competency in assessment: Spotlighting an often untapped partner in evidencing student learning. Presentation at annual meeting of the Higher Education Data Sharing (HEDS) Consortium, Spokane, WA. Approximately 97 people in attendance.

Fulcher, K. H., (2017, July). Assessing the Quality of Assessment Practice. Concurrent Sessions (2) presented for the SACSCOC Institute on Quality Enhancement and Accreditation, Austin, TX. Approximately 220 attendees in attendance.

Fulcher, K. H., Tracy, P., & Townsend, L. (2017, November). From Compliance Zombie to Improvement Catalyst: Multiple Perspectives on Syncing Assessment with Improvement Efforts. Presentation for the Virginia Assessment Group Conference, Richmond, VA. Approximately 50 people in attendance.

Fulcher, K. H., Jankowski, N., Markle, R., & Russell, J. (2018, June). Paved with Good Intentions: When Good Assessment Plans Go Wrong, and How to Fix Them. Panel presentation for the Association for the Assessment of Learning in Higher Education, Salt Lake City, UT. Note, authors in alphabetical order. Approximately 80 people in attendance.

Harris, H. D., & Horst, S. J. (2017, July). Investigating the effect of covariate selection on treatment estimation when using propensity score matching techniques: A simulation study. Poster presentation at the International Meeting of the Psychometric Society. Zurich, Switzerland. Approximately 25 people in attendance.

Holtzman, S., Steinberg, J., Harris, H. D., & Sauder, D.C. (2017, October). Data management tips and tricks: An application to university student assessment. Presented as part of a symposium series conducted at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT. Approximately 15 people in attendance.

Holzman, M. A., Curtis, N. A., & Ames, A. J. (2017, October). The Diagnostic Rating System (DRS): A rating method to facilitate international programmatic changes. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT. Approximately 10 people in attendance.

Horst, S. J., & Smith, M. (2017, November). Developing a writing assessment through a “Group Assessment Fellows” experience. Poster presentation at the annual meeting of the Virginia Assessment Group. Richmond, VA. Approximately 50 people in attendance.

Kerr, C.S. (2017, October). Merging Learning Outcomes and Engagement Research. Paper presented at the Northeastern Educational Research Association. Trumbull, Connecticut. Approximately 12 people in attendance.

Myers, A. J., & Finney, S. J. (2017, October). When should examinee motivation be measured? A structural means modeling approach. Paper presented at the annual meeting of the Northeastern Educational Research Association, Trumbull, CT. Approximately 10 people in attendance. P

Myers, A. J., Ames, A. J., Leventhal, B. C., & Holzman, M. A. (2018, April). An item response tree model for validating rubric scoring processes. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY. Approximately 30 people in attendance.

Myers, A. J., & Finney, S. J. (2018, April). Does it matter when examinee motivation is measured? A moderated mediation analysis. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY. Approximately 30 people in attendance.

Myers, A. J. & Finney, S. J. (2018, April). Analysis of change: Examining the effect of attributional bias on self-reported motivation. Paper presented at the annual meeting of the National Council on Measurement in Education, NYC. Approximately 30 people in attendance.

Ong, T. Q., Kopp, J., Jones, A., & Malangoni, M. (2018, February). The General Certifying Examination: Exploring the influence of gender and nationality on ratings. Paper presented at the Academic Surgical Congress meeting, Jacksonville, FL. Approximately 20 people in attendance.

Ong, T. Q., Pastor, D. A, & Yang, S. (2018, April). The effects of administering alerts at fixed points during a low-stakes test. Paper presented at the annual conference of the American Educational Research Association, New York, NY. Approximately 30 people in attendance.

Ong, T. Q., Kopp, J., & Jones, A. (2018, April). Is there gender bias on the American Board of Surgery General Surgery Certifying Examination? Paper presented at the annual conference of the American Educational Research Association, New York, NY. Approximately 20 people in attendance.

Pastor, D. A., Ong, T. Q., & Orem, C. D. (2017, November). College students’ perceptions of civic engagement activities: An argument for distinguishing between political and non-political activities. Paper presented at the annual meeting of the Virginia Assessment Group, Richmond, VA. Approximately 60 people in attendance.

Pope, A. M., & Markle, R. (2018, April). Evaluating assessment quality at the institution level: A look at civic engagement and intercultural competency. Paper presented at the annual meeting of the American Educational Research Association, New York, NY. Approximately 20 people in attendance.

Pyburn, E. M., Waterbury, G. T., & Curtis, N. A. (June, 2017). Can I ask you a question? Writing quality items for programmatic assessment. Session presented at the annual conference of the Association for the Assessment of Learning in Higher Education, Louisville, KY. Approximately 25 people in attendance.

Pyburn, E. M., & Bandalos, D. L. (October, 2017). How does this survey make you feel? Using think-aloud interview for research and scale development. Paper presented at the annual conference of the Northeastern Educational Research Association, Trumbull, CT. Approximately 15 people in attendance.

Satkus, P., Finney, S. J., & Perkins, B. (2018, April). Going beyond test-taking motivation: Students’ emotional reactions when completing tests for institutional accountability mandates. Paper presented at the annual meeting of the American Educational Research Association, NYC. Approximately 30 people in attendance. MP

Sauder, D., Leventhal, B. C., & Horst, S. J.(2018, May). Effects of a summer statistics refresher boot camp. Poster presentation at the Electronic Conference on Teaching Statistics. State College, PA. (https://www.causeweb.org/cause/ecots/ecots18/program/posters) Attendees unknown – virtual conference. EL

Sauder, D. C. (2018, April). Gender invariance on the test-specific Student Opinion Scale. Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY. Approximately 15 people in attendance. MP

Szendey, O., Curtis, N.A., Pope, A. (November, 2017). Madison Assessment Scholars: Engaging Students in Program-Level Assessment. Presented at the annual meeting of the Virginia Assessment Group. Richmond, VA. Approximately 100 people in attendance. HEA

Waterbury, G. T., & DeMars, C. E. (October 2017) A User Friendly Effect Size: When Normality Matters. Presented at the Conference of the Northeastern Educational Research Association, Trumbull, CT. Approximately 15 people in attendance. MP

Waterbury, G. T., & Spratto, E. M. (November, 2017). Can I ask you a question? Writing quality items for programmatic assessment. Paper presented at the annual conference of the Virginia Assessment Group, November, 2017. Approximately 30 people in attendance. HEA