Annual Student Learning Outcomes Assessment Report

For outcome 1 – all students must successfully orally present a case study to the faculty and students at least once during the clinical seminar as part of their clinical practice. During spring 2005, junior RT student scores ranged from 0 to 4 with mean of 3.37.

2. Capstone course

For outcome 1 – “Trends and Professional Issues” is a writing intensive capstone course that concentrates on a series of reflective assignments designed to allow the senior student to demonstrate their proficient writing skills in respiratory therapy. Mean score was 4.7 on scales of 1 to 5. In spring 2005, 88% of senior RT students were graded as very good.

3. Mid-Program comprehensive exam

For outcome 2 - Upon completion of the first year of the respiratory care program, graduates will demonstrate competent understanding of advanced skills by scoring >75% of this exam. This exam is given at the end of the summer semester. Scores ranged from 71 to 89 with average score of 82.6.

4. NBRC Entry Level CRT

For outcome 2 – all students must successfully complete the National Board for Respiratory Care’s (NBRC) Entry Level Exam, and obtain the “Certified Respiratory Therapist” credential to demonstrate cognitive mastery of entry level skills. The pass rate this past Spring was 100% with all students passing on the first attempt.

5. NBRC Written Registry Exam

For outcome 2 - NBRC Written Registry exam is a measure of cognitive mastery on advanced therapist skills and procedures taken after graduation, and involves predominantly ‘application’ and ‘analysis’ items. The class of 2004 has a 78% pass rate (18 of 23 graduates, 8 graduates have yet to take the exam).

6. NBRC Clinical Simulation Exam

For outcome 2 - NBRC Clinical Simulation exam is another measure of cognitive mastery on advanced therapist skills and procedures taken after graduation, and involves demonstration of higher-level patient management ability, including therapeutic procedure initiation and modification. The class of 2004 has a 58% pass rate (14 of the 24 graduates, 7 graduates have yet to take the exam).

7. Employer Survey - Cognitive

For outcome 2 - following graduation from the program, students are asked to provide employment status and location, and a nationally standardized survey instrument on their cognitive ability is sent to the clinical employer. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from 11 employers who hired graduates of the class of 2004. No scores < 3 were reported regarding knowledge base (mean of 4.6).

8. Graduate Survey- Cognitive

For outcome 2 –six-months after graduation students are asked to evaluate their satisfaction with the program preparation for understanding of content areas in Respiratory Therapy. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from eight Class of 2004 graduates. No scores < 3 were reported regarding knowledge base (mean of 4.85).

9. Departmental Exit Exam

For outcome 2 - a final cumulative and comprehensive assessment of understanding and minimal competency of content areas in Respiratory Therapy. A satisfactory passing score is required to complete the program and graduate. This is a standardized written self-assessment exam administered on-line by the NBRC. A passing score is 70%. Graduating seniors in May scored from 54% to 84% with the mean at 73.3%.

10. Employer Survey-Psychomotor

For outcome 3 -following graduation from the program, a nationally standardized survey instrument on students’ clinical skills is sent to the clinical employer. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from 11 employers who hired graduates of the class of 2004. No scores < 3 were reported on clinical proficiency (mean 4.5).

11. Graduate Survey-Psychomotor

For outcome 3 – six-month post graduation students are asked to evaluate their satisfaction with the program preparation for performance of clinical skills in Respiratory Therapy. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from eight graduates of the Class of 2004. No scores < 3 were reported regarding clinical proficiency (mean 4.6).

12. Summative Psychomotor Evaluation

For outcome 3 - in order to complete the program, each student must demonstrate adequate clinical skills as rated by an instructor. Grading is Pass/Fail. All graduating seniors (100%) in May scored satisfactorily on their final clinical externship skills check-off.

13. Employer Survey-Affective

For outcome 4 - following graduation from the program, a nationally standardized survey instrument on students’ professional behavior is sent to the clinical employer. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from 11 employers who hired graduates of the class of 2004. No scores < 3 were reported regarding behavioral skills (mean 4.9).

14. Graduate Survey-Affective

For outcome 4 – six-months post graduation students are asked to evaluate their satisfaction with the program preparation for professional behavior in Respiratory Therapy. For each item, a score of >2 on a 1 to 5 scale is needed to indicate minimal acceptability. Responses were received from eight graduates of the class of 2004. No scores < 3 were reported regarding behavioral skills (mean 4.8).

15. Summative Affective Evaluation

For outcome 4 - in order to complete the program, each student must demonstrate adequate professional behavior as rated by an instructor. Grading is Pass/Fail. All graduating seniors in Spring 2005 (100%) demonstrated adequate professional behavior in their clinical practice.

16. Entry Level Self Assessment Exam

For outcome 5 - all students must complete this exam at the end of fall semester of the senior year, as a formative exercise to prepare for the first phase of the national board exam (Entry Level CRT). This exam is given via the Web and feedback is provided on each content area. Fall semester 2005, scores were from 46 to 79 with the mean score of 70.

17. NBRC Clinical Simulation Exam

For outcome 6 - this exam is a measure of cognitive mastery on advanced therapist skills and procedures taken after graduation. The exam consists of 10 separate patient management problems. The clinical setting and patient situation for each problem are designed to simulate reality and be relevant to the clinical practice of respiratory care. This exam also involves demonstration of higher-level patient management ability, including therapeutic procedure initiation and modification. A passing score is required on this exam in addition to that on the Written Registry, to obtain the credential of ‘Registered Respiratory Therapist’ (RRT). The class of 2004 has 15 of the 31 graduates (48%) who earned the RRT credential.

C. Data Analysis

Data was analyzed by review of reports from the NRBC for examination results, clinical evaluations for skills check-offs and professional behavior, and descriptive details of standardized forms from the national accrediting agency for respiratory therapy (Committee on Accreditation for Respiratory Care – CoARC).

II. Achievement of Departmental Objectives for Students

Undergraduate

1. Communication skills both orally and in writing

Students successfully achieved objectives in communication skills.

2. Advanced respiratory therapy skills

Overall, students successfully achieved objectives in advanced respiratory therapy skills as evidenced by 100% pass rate for CRT exam on the first attempt. One student did not meet the minimum score for the mid-program comprehensive exam and that student’s progress in the program was halted. One student has yet to graduate due to failing score on department exit exam. NBRC written registry and clinical simulation scores for the class of 2004 are lower than anticipated, particularly the clinical simulation exam.

3. Technical performance of advanced skills

Students successfully achieved objectives in technical performance.

4. Professional behaviors expected of advanced-level therapists

Students successfully achieved objectives in professional behaviors.

5. Use of technology

Students successfully achieved objectives in use of technology.

6. Critical thinking skills within the context of professional respiratory care practice

Approximately half of the class of 2004 has successfully achieved objectives in critical thinking.

B. Graduate

Not assessed due to hold on admissions for FY 05

III. Changes to Procedures or Curriculum on Assessment

A. Undergraduate

In spring 2005, RT 4075, Patient Care Management, was revised to emphasize analysis of patient care management strategies for the respiratory therapist. The results of this change for the class of 2005 are pending.

B. Graduate

Not assessed due to hold on admissions for FY 05

IV. Changes in Department’s Assessment Goals

After only one year of assessing learning outcomes in this context, no changes will be made at this time.