Undergraduate Student Learning Outcomes Assessment Report

 Master of Science Student Learning Outcomes Assessment Report

 

Unit Name     Computer Information Systems       

 

Degree Programs     BBA       

 

Prepared by Carl Stucke, Date     July 31, 2005       

 

Academic Year:  2004-2005

 

Number of graduates from each degree program this academic year:

 

Degree

Summer 2004

Fall 2004

Spring 2005

BBA CIS

33

30

23

 

Number of students in each program major:

 

Degree

Summer 2004

Fall 2004

Spring 2005

BBA CIS

270

437

392

 

 I. Assessment Procedures

 

        General approach

As part of the ongoing assessment of our CIS BBA program, the CIS department has leveraged the CIS 4980 "Capstone" course.  Students in this required course are assigned to real world organizations for the purpose of exercising the full range of topics from the CIS undergraduate core courses.  Since these are real world environments, the needs of specific organizations may not cover all topics.  See the CIS assessment plan at http://education.gsu.edu/ctl/outcomes/RCB/CIS_BBA_Assessment_Plan-8-04.htm.  CIS has developed a survey to gain structured and free form feedback from individuals involved with CIS 4980 “Capstone” projects.  Use of this survey began in Spring 2005 (although we have project materials from several earlier semesters as well as informal feedback and observations from students and faculty). 

 

The form used in this Capstone survey appears as appendix A.  At the end of each semester, the CIS 4980 teams present their projects to fellow students, faculty, and clients.  Each of these viewers (excluding students) is asked to complete a survey for each team’s presentation.  Students’ are asked to complete the survey to comment on their own performance and on their level of preparation to perform within each of the areas on the survey.  And, there are areas for “open” comments.  Again, please see the survey form for additional info.

 

The survey’s areas cover the full range of primary objectives of the courses within the CIS undergraduate core (and also within most electives).  In particular, we can map the areas back to the CIS courses and measure whether scores are increasing (hopefully reflecting continuing improvement in the conduct of the associated courses and the in resulting student learning). 

 

The attached spreadsheet contains all survey responses (less the names of reviewers and of teams being reviewed) and some initial averages (see the spreadsheet for details).  To construct these averages, the 6 (Not applicable) and 7 (Applicable but not shown) responses were not included.  Viewing the survey form will bring additional clarity to this reasoning.  

 

Outcomes assessed

The objectives to be assessed are the aggregation of the objectives of the BBA CIS core curriculum and of several elective courses.  These are:

Acquired and scoped the system and user requirements
Specified, analyzed, & refined the system and user requirements
Designed the specified system using an appropriate architecture
Developed program specifications
Developed test plans
Developed implementation plans
Designed and developed an effective, efficient, and graphically pleasing user interface
Designed the programs according to specifications
Coded/developed the specified & designed programs
Tested the developed programs to show conformance to specification
Tested the developed overall system to show conformance to the system specification
Documented the developed programs & system
Developed user manual
Planned and managed the overall project
Communicated effectively with the client and users
Used an object-oriented programming language
Used object-oriented concepts and notation
Appropriately applied database concepts and techniques
Appropriately applied telecommunications concepts and techniques
Appropriately applied security & privacy concepts and techniques
Appropriately selected and used other concepts, languages, tools, and techniques

Elements of assessment

 

        The assessment utilized a survey form (now online).  Please see appendix A. 

 

Data collected and data analysis

 

        All of the Spring 2005 projects were assessed.  Faculty, instructors of the CIS 4980 sections, clients, alumni, and students viewed presentations and documentation from the project teams.  72 responses were received.  Some responders fell into more than one category (assessment data).

 

  Number of Responders Number of Responses Overall Avg
Client 4 5 4.90
Instructor 2 9 4.60
Alum 3 18 3.91
Faculty 6 22 3.52
Student 27 27 4.27
All     4.24

 

 

II. Achievement of Departmental Objectives for Students

 

The most impressive comments came from the real world clients of the student teams.  Note that client average was 4.9 out of 5.  Students as well as clients feel that the CIS program is meeting the needs.  Not surprisingly, the faculty exercised higher standards in their reviews. 

 

The Objectives Sorted By Average worksheet in the attached spreadsheet shows testing programs, database development, system testing, implementation plan preparation, and test plan development as the scored the lowest.  Of these, only database is part of the curriculum but not part of the core.

 

III. Changes to Procedures or Curriculum Based on Assessment

 

    Based on this assessment outcomes and, primarily on informal assessment feedback from previous capstone course presentation sessions, CIS UPC will proposed a change in the program structure to allow database as a "required course choice".  

 

IV. Changes in Department’s Assessment Goals

 

        No changes are currently planned in this assessment process or goals.  This will be reconsidered at the end of each semester's assessment activities.

 

 

 

 

Appendix A

 

  CIS Capstone Survey  

 

Reviewer Name

Reviewer Classification (please check each that applies)

Client      CIS Alum     Faculty  Instructor (of this section)  Student
Team being reviewed

Materials reviewed (please check each that applies)

Project(s)   Exam(s)   Other assignments   
Capstone Section (if you know this)
 
 

 

Please indicate your assessment of whether this team successfully accomplished each of the following tasks (there may be some overlap in tasks)

1 = Strongly Disagree, Not Even Close

2 = Somewhat, Needs Improvement

3 = Agree, Average, Adequate

4 = Exceeded Expectation

5 = Strongly Agree, Outstanding

6 = Not Applicable

7 = Not Shown in work

Acquired and scoped the system and user requirements
1 2 3 4 5 6 7
Specified, analyzed, & refined the system and user requirements
1 2 3 4 5 6 7
Designed the specified system using an appropriate architecture
1 2 3 4 5 6 7
Developed program specifications
1 2 3 4 5 6 7
Developed test plans
1 2 3 4 5 6 7
Developed implementation plans
1 2 3 4 5 6 7
Designed and developed an effective, efficient, and graphically pleasing user interface
1 2 3 4 5 6 7
Designed the programs according to specifications
1 2 3 4 5 6 7
Coded/developed the specified & designed programs
1 2 3 4 5 6 7
Tested the developed programs to show conformance to specification
1 2 3 4 5 6 7
Tested the developed overall system to show conformance to the system specification
1 2 3 4 5 6 7
Documented the developed programs & system
1 2 3 4 5 6 7
Developed user manual
1 2 3 4 5 6 7
Planned and managed the overall project
1 2 3 4 5 6 7
Communicated effectively with the client and users
1 2 3 4 5 6 7
Used an object-oriented programming language
1 2 3 4 5 6 7
Used object-oriented concepts and notation
1 2 3 4 5 6 7
Appropriately applied database concepts and techniques
1 2 3 4 5 6 7
Appropriately applied telecommunications concepts and techniques
1 2 3 4 5 6 7
Appropriately applied security & privacy concepts and techniques
1 2 3 4 5 6 7
Appropriately selected and used other concepts, languages, tools, and techniques (when there was a better selection,  please use the comments box below to note what was selected and what selection would have been better)
1 2 3 4 5 6 7

Comments or recommendations regarding students or project:

Comments or recommendations regarding GSU CIS program:

Comments or recommendations to improve this survey:

Thanks!