CAEP Annual Reporting Measures

MEASURES OF PROGRAM IMPACT:

• Measure 1: Impact that completers' teaching has on P-12 learning and development

  STANDARD 4.1: Impact on P-12 Learning

  The Clinical Placement Office is currently undergoing reorganization and the faculty and Director of Field Placement will evaluate options for assessing program impact on K-12 learners in Fall 2020. 

  Student Teacher Evaluation Form 

• Measure 2: Indicators of teaching effectiveness
  STANDARD 4.2: Indicators of teaching effectiveness
  
  

  • Spring 2019 Student Teacher Evaluations Outcome Report
  • Fall 2019 Student Teacher Evaluations Outcome Report
  • Student Teacher Evaluation Form
• Measure 3: Satisfaction of Employers and Employment Milestones

  STANDARD 4.3: Satisfaction of Employers and Employment Milestones

  Employer Satisfaction

  In Fall of 2019, USD piloted an employer survey. We solicited from the faculty names of community stakeholders (principals, district leaders, etc.) to receive an “employer” survey that we based on the 2018-19 CTC Employer Survey. The survey asks the employers about their impression of our graduates in general, not about a specific graduate. We sent the survey to 38 recipients over a 6-week period. We received 11 responses. To capture data on recent graduates from within the last three years, the survey design asked the recipient when they last hired a USD graduate. Respondents who indicated “I don’t know” or “More than three years ago” were automatically directed to the end of the survey and were not asked for feedback. Four respondents indicated “I don’t know” and “More than three years ago”. Further, not all respondents answered all the questions. Thus, we ended up with six completed responses.

  Upon reflecting on the pilot, we have made the following changes. Going forward, all answers will be forced and we will ask respondents to indicate the credential areas of the graduates. Since the n’s are small we are postponing delving deep into the findings. The plan going forward includes administering the survey in Summer 2020, adding more stakeholders to the recipients list and increasing the response rate. The report will be prepared for discussion at the August 2020 faculty retreat. For results of the Fall 2019 pilot please see the report.

  Alumni Employment

  The most recent biannual 2015-17 Alumni survey indicate that all respondents are highly successful in gaining employment. Alumni Survey data show that 82% of Multiple Subject Credential alumni found a job within three months of graduation from their program. In addition, 93% of Single Subject Credential alumni and 82% of Special Education credential alumni found a job within three months of graduation from their respective programs.

  Community Stakeholder Survey

  Master Teacher Survey 2018-2019

  Satisfaction of Employers and Employment Milestones Annual Report

• Measure 4: Results of completer surveys

  STANDARD 4.4: Completer Satisfaction

  SOLES uses several data points to measure program completer satisfaction. In addition to SOLES’s designed and distributed alumni and exit surveys, we also review satisfaction surveys by the California Commission on Teacher Credential. (Please see attached CTC completer surveys). The sets of data provide an overview of completer satisfaction with educator preparation programs SOLES. Data are disaggregated by programs Multiple Subject, Single Subject and Special Education.

  • Alumni Survey Leadership Report 2017
  • CTC Completer Survey 2018-2019 Multiple Subject Prelim
  • CTC Completer Survey 2018-2019 Single Subject Prelim
  • CTC Completer Survey 2018-2019 Ed Specialist Prelim
  • 2019 Exit Survey Report Multiple Subject
  • 2019 Exit Survey Report Single Subject
  • 2019 Exit Survey Report Ed Specialist
• Measure 5: Graduation rates from preparation programs

  STANDARD 4.5: Graduation Rates

  We know anecdotally the majority of students complete their studies within the designated time required to earn the degree. However, due to the design of our programs, the registrar and Institutional Research are challenged with quantifying the retention and completion rates for the following reasons: 1. Not all students start the program as part of a cohort. 2. Some graduate students begin in a cohort, such as most one-year credential students, but the length of the program can differ from 12 months to 18 months to 2 years, so the expected time to degree varies. 3. Most post-bacc students are pursuing a master's degree, in addition to a credential, so time to completion varies. 4. Some students pursue two or more credentials (e.g., special ed and multiple subject), and declare the secondary subject later.

  We will meet with the USD Institutional Research office to device a mechanism for calculating the completion rate before our next self-study of 2020.

• Measure 6: Ability of completers to meet licensing (certification) and any additional state requirements

  STANDARD 4.6 Ability of completers to meet licensing (certification) and any additional state requirements

  CalTPA

  The results of the 2018-19 CalTPA indicate 100% of SOLES students passed the CalTPA. The faculty analyzed the results and flagged any mean score that was both below 3.0 (on a 5 pt. rubric) and had a 0.4 or greater negative distance between the mean rubric score of the state.

  Subject area flag- defined as those subject areas that met both of the above area criteria.

  The analysis found 14 flags:

  23% were in the category “Apply”

  35% were in the category “Plan”

  23% were in the category “Teach and Assess”

  15% were in the category “Reflect”

  The determination was to continue to review the results and monitor flags. For full analysis, please see the attached document below.

  Exams

  Based on data from Pearson, the USD School of Leadership and Education Sciences pass rates for 2016-17, 2017-18 and 2018-19  on the California State Teacher Credential licensing requirements, CBEST, RICA, and the subject subtests English, Math, Social Science, Science, Biology, Chemistry, Physics, Earth/Planetary, Writing, Spanish Science exceed the California statewide pass rates. 

   

  Exams	AY 16-17 SOLES	AY 16-17 CA Statewide	AY 17-18 SOLES	AY 17-18 CA Statewide	AY 18-19 SOLES	AY 18-19 CA Statewide
  CBEST	80%	69%	80%	68%	75%	66%
  CSET	89%	77%	86%	73%	84%	72%
  RICA	Low n	79%	79%	72%	76%	71%

  
  
  

• Measure 7: Ability of completers to be hired in education positions for which they are prepared
  STANDARD 4.7: Ability to be Hired 
  

  • Positions Hired- Annual Report 
• Measure 8: Student Consumer Information

  STANDARD 4.8: Student Consumer Information

  For specific student consumer information, please see https://www.sandiego.edu/facts/heoa/. This page responds to requirements outlined in the Higher Education Opportunity Act by coordinating information from across the university. Each link leads to a Web site that provides detailed information. The links are updated throughout the year as new information becomes available and meet federal requirements for information required to be disclosed under the Higher Education Act of 1965, as amended by the Higher Education Opportunity Act of 2008 (HEOA).

  The 3 Year Student Loan Default Rate for USD is 1.8% (2016 Cohort).