During 2019-2020 CSP is initiating an assessment process that uses Blackboard tools for the recording, aggregating, and reporting of student learning outcomes assessment. These tools include EAC and Blackboard Outcomes.
How Does Blackboard Work with EAC?
EAC is a building block developed by a third-party that integrates seamlessly within Blackboard Learn, where courses operate. EAC uses “primary” assessment, that is, instructor-scored rubrics, tests, discussion boards, etc. It allows for the reporting of in-course student achievement data across sections and terms. EAC is based on aligning student learning outcomes (program, CORE, Graduate) with RUBRIC ROWS and TEST ITEMS. Program coordinators can manage their own assessment plans by making learning outcome alignments within Master courses that are copied to sections. Program coordinators can run reports that display aggregated student achievement data on program and institutional outcomes across sections and terms.
How Does Blackboard Outcomes Work?
Blackboard Outcomes uses “juried” assessment. That means Blackboard pulls sample sets of artifacts (assignments submitted in Blackboard) that have been aligned with the learning outcomes you’re looking to assess. Then, these samples get assigned to a reader or group of readers outside the course – designated department faculty, for example – each of whom scores each artifact in their assigned sample according to the rubric for the outcome(s). With multiple scorers, Blackboard can provide feedback on inter-rater reliability. In this system, a sample, rather than every single assignment, can be pulled in the case of large numbers of students. Also, the course instructor is only grading the assignment for the course, not additionally assessing program outcomes.
Because fewer faculty would be involved in reading/scoring student artifacts using Outcomes, programs with large numbers of learning outcomes may not find it feasible to score all program outcomes every year. These departments may want to schedule a cycle where they review student achievement of a few different outcomes each year.
Use the following forms to plan your transition to Blackboard Assessment Tools
Assessment Plan for Program Outcomes: This form indicates which Blackboard assessment tool(s) (EAC or Outcomes) your program will be using.
Undergraduate Program Blackboard Assessment Set-Up OR Graduate Program Blackboard Assessment Set-Up: In these forms you paste/write your Program Learning Outcomes (PSLOs), their associated Rubrics, and the courses/assignments where you will assess the PSLOs. (You’ll find older versions of your curriculum maps in the Google folder.)
Timeline Map for Assessment (for Outcomes Users): This matrix allows you to plan out over 3-5 years the PSLOs or institutional learning outcomes you want to focus on for particular years. Spreading out analysis of assessment results over a few years allows you to a) do more in-depth analysis of a skill or content in the curriculum because you’re not having to spend time on your other 5-10 learning outcomes; b) allows longer for improvements you’ve implemented to be integrated and show up in your assessment results; c) gives you more than one or two semesters of aggregated data to review on a given outcome. Outcomes users benefit most from using the timeline approach, but any program can choose to spread out their learning outcomes assessment (analysis).