In Fall 2019, three pilot projects from across three disciplinary areas were conducted for the core area “Competency in Quantitative Reasoning” (CQUR). For each of the three projects, student exams were randomly selected from several sections of CQUR-designated courses within that area, for a total of 75-83 exams per area. (This sample size reflects a 5% margin of error.) Each four-member faculty scoring team analyzed the exams from their respective disciplinary area using the learning outcomes criteria on the CQUR rubric that was provided. Each exam was read by at least two scorers, and the most consistent paired set of scores was used in the final compilation of results. After viewing the results, scorers shared their insights via a scorer feedback session and survey.
Findings
Findings are reported separately for each disciplinary area, given the variation that existed across areas, e.g., differences in assignment prompts, interpretations of the rubric, and course level. The distinctiveness of approaches to quantitative reasoning was not anticipated at the start of the project but it was one of the most revealing findings. It is important to note that these results should not be interpreted across areas in a comparative sense, but rather to illustrate the variety of findings that can be anticipated in assessing this core attribute, quantitative reasoning. These charts summarize the frequency of scores for each learning outcome (LO). The CQUR rubric used contains four performance levels, with level 4 as the highest.
Scorers were in strong agreement that learning outcomes 3, 4, and 5 involve higher-order thinking skills and thus students should have extra opportunities to practice them. Scorers also agreed that even though the CQUR courses they analyzed were highly discipline-specific, that the skills students learn are transferable to quantitative reasoning skills they would need/encounter in every-day life.
Actions
Faculty scorer feedback suggestions were compiled to create a list of Faculty Tips. This document and the Quantitative Reasoning (CQUR) rubric, which was collaboratively devised and refined during this project, will be shared with all faculty teaching courses that carry the CQUR core attribute code. It is hoped that this additional faculty support will help future students taking this course.
These materials are provided here: