Undergraduate Student Learning Outcomes Assessment Report
Degree Programs BBA
Academic Year: 2004-2005
Number of graduates from each degree program this academic year:
|
Degree |
Summer 2004 |
Fall 2004 |
Spring 2005 |
|
BBA CIS |
33 |
30 |
23 |
Number of students in each program major:
|
Degree |
Summer 2004 |
Fall 2004 |
Spring 2005 |
|
BBA CIS |
270 |
437 |
392 |
General approach
As part of the ongoing assessment of our CIS BBA program, the CIS department has leveraged the CIS 4980 "Capstone" course. Students in this required course are assigned to real world organizations for the purpose of exercising the full range of topics from the CIS undergraduate core courses. Since these are real world environments, the needs of specific organizations may not cover all topics. See the CIS assessment plan at http://education.gsu.edu/ctl/outcomes/RCB/CIS_BBA_Assessment_Plan-8-04.htm. CIS has developed a survey to gain structured and free form feedback from individuals involved with CIS 4980 “Capstone” projects. Use of this survey began in Spring 2005 (although we have project materials from several earlier semesters as well as informal feedback and observations from students and faculty).
The form used in this Capstone survey appears as appendix A. At the end of each semester, the CIS 4980 teams present their projects to fellow students, faculty, and clients. Each of these viewers (excluding students) is asked to complete a survey for each team’s presentation. Students’ are asked to complete the survey to comment on their own performance and on their level of preparation to perform within each of the areas on the survey. And, there are areas for “open” comments. Again, please see the survey form for additional info.
The survey’s areas cover the full range of primary objectives of the courses within the CIS undergraduate core (and also within most electives). In particular, we can map the areas back to the CIS courses and measure whether scores are increasing (hopefully reflecting continuing improvement in the conduct of the associated courses and the in resulting student learning).
The attached spreadsheet contains all survey responses (less the names of reviewers and of teams being reviewed) and some initial averages (see the spreadsheet for details). To construct these averages, the 6 (Not applicable) and 7 (Applicable but not shown) responses were not included. Viewing the survey form will bring additional clarity to this reasoning.
The objectives to be assessed are the aggregation of the objectives of the BBA CIS core curriculum and of several elective courses. These are:
Acquired and scoped the system and user requirements Specified, analyzed, & refined the system and user requirements Designed the specified system using an appropriate architecture Developed program specifications Developed test plans Developed implementation plans Designed and developed an effective, efficient, and graphically pleasing user interface Designed the programs according to specifications Coded/developed the specified & designed programs Tested the developed programs to show conformance to specification Tested the developed overall system to show conformance to the system specification Documented the developed programs & system Developed user manual Planned and managed the overall project Communicated effectively with the client and users Used an object-oriented programming language Used object-oriented concepts and notation Appropriately applied database concepts and techniques Appropriately applied telecommunications concepts and techniques Appropriately applied security & privacy concepts and techniques Appropriately selected and used other concepts, languages, tools, and techniques
Elements of assessment
Data collected and data analysis
All of the Spring 2005 projects were assessed. Faculty, instructors of the CIS 4980 sections, clients, alumni, and students viewed presentations and documentation from the project teams. 72 responses were received. Some responders fell into more than one category (assessment data).
Number of Responders Number of Responses Overall Avg Client 4 5 4.90 Instructor 2 9 4.60 Alum 3 18 3.91 Faculty 6 22 3.52 Student 27 27 4.27 All 4.24
II.
Achievement of Departmental Objectives for Students
The most impressive comments came from the real world clients of the student teams. Note that client average was 4.9 out of 5. Students as well as clients feel that the CIS program is meeting the needs. Not surprisingly, the faculty exercised higher standards in their reviews.
The Objectives Sorted By Average worksheet in the attached spreadsheet shows testing programs, database development, system testing, implementation plan preparation, and test plan development as the scored the lowest. Of these, only database is part of the curriculum but not part of the core.
III. Changes to Procedures or Curriculum Based on Assessment
Based on this assessment outcomes and, primarily on informal assessment feedback from previous capstone course presentation sessions, CIS UPC will proposed a change in the program structure to allow database as a "required course choice".
IV. Changes in Department’s Assessment Goals
No changes are currently planned in this assessment process or goals. This will be reconsidered at the end of each semester's assessment activities.
Appendix A