The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides evidence of improvement based on analysis of the results in each of the following areas: 3.3.1.3. academic and student support services.
SACSCOC Off-site Committee's Response
LSU A&M does not document the strategies used to select the academic and student support units included in the report or how these units represent a valid cross-section of units at the institution. The documentation fails to substantiate a sampling strategy if one was used to address this principle.
The institution did provide a thorough review and assessment of the student support units under the Division of Student Life and Enrollment. While the document refers to academic support units within the division of Student Life and Enrollment, no clear assessment document was provided for academic support programs. For example, advising, tutoring and Library services that were included in CS 3.4.9 are not discussed in the response to 3.3.1.3.
Furthermore, the documentation does not provide a clear understanding of the organizational levels selected for assessment outside of the Division of Student Life and Enrollment.
LSU A&M's Response
As requested by the Off-Site Review Committee, Louisiana State University and A&M College (LSU) is providing the following additional documentation regarding the assessment documentation and strategies of additional units, specifically those academic support programs that were included in CS 3.4.9 and that were not previously discussed in the response to CS 3.3.1.3.
Sampling of Valid Cross-Section of Units
Student support units as identified in CS 2.10 included assessment documentation for all 12 departments within the Division of Student Life and Enrollment. Additional documentation was provided for 3 of 5 departments addressed in CS 2.10 to include Communication across the Curriculum (CxC); Equity, Diversity and Community Outreach; and Health Promotions; thereby, providing a valid sample of the support services addressed in CS 2.10.
Academic Support Services, as identified in CS 3.4.9, include
(A) Tutoring,
(B) Academic Advising,
(C) Counseling/Consulting,
(D) Information Technology,
(E) Mentoring,
(F) Academic and Resources Centers,
(G) Laboratories,
(H) Special Services,
(I) Experiential Learning,
(J) Distance Learning Resources, and
(K) Libraries.
The initial compliance certificate for CS 3.3.1.3 included six of the eleven areas identified in the compliance certificate for CS 3.4.9, including Tutoring, Academic Advising, Academic and Resources Centers, Special Services, Experiential Learning, Distance Learning Resources, and Libraries. The remaining five areas are addressed in this response.
Assessment of Academic Support Services
As stated in the off-site review report “the institution did provide a thorough review and assessment of the student support units under the Division of Student Life and Enrollment”; therefore, this response will focus on those academic support services that were not previously included. The following provides a representative sample by type of academic support as categorized in the certificate for CS 3.4.9.
TUTORING
Center for Academic Success
Tutorial services are offered primarily through the Tutorial Center in the Center for Academic Success. Student usage numbers of the Tutorial Center since Fall 2010 are represented in this chart.
Spring 2010 |
# of users unknown |
215 respondents |
Fall 2010 |
1665 unique students |
213 respondents |
Spring 2011 |
1398 unique students |
166 respondents |
Fall 2011 |
1765 unique students |
192 respondents |
Spring 2012 |
1398 unique students |
65 respondents |
Fall 2012 * |
8176 surveyed |
583 |
Spring 2013 * |
8366 surveyed |
323 |
* numbers increased due to combination of surveys.
To minimize survey fatigue, in Fall 2012, the Center for Academic Success (CAS) began a combined assessment of academic support services, including tutoring and supplemental instruction. Additionally, focus groups were facilitated in Fall Semester 2012 to address student perception of the tutorial center and tutoring services [1].
Key Finding(s) and/or Change(s) Resulting from Assessment of CAS Tutoring Services
Supplemental Instruction (SI) is also evaluated through an online survey completed by all students who attend a session.
The sample includes all students enrolled in a course section in which the Center for Academic Success (CAS) provided Supplemental Instruction Support in each given semester.
|
Students surveyed |
Student Respondents |
Fall 2010 |
4150 |
784 |
Spring 2011 |
5617 |
780 |
Fall 2011 |
4394 |
641 |
Spring 2012 |
7365 |
488 |
Fall 2012 * |
8176 surveyed |
583 |
Spring 2013 * |
8366 surveyed |
323 |
* numbers increased due to combination of surveys
Key Finding(s) and/or Change(s) Resulting from Assessment of Supplemental Instruction
While tutoring is primarily provided by the Center for Academic Success through the Tutorial Center and Supplemental Instruction, student sub-populations are also served in various academic support departments including Residential Life Residential College Program, Cox Center for Student Athletes, and the Office of Multicultural Affairs.
Residential Colleges Tutoring Programs
Key Findings of 2012-2013 Data [15]
|
HRC |
ITRC |
BRC |
ERC |
Total |
Students Tutored, Fall 2012 |
37 |
46 |
55 |
132 |
365 |
Total Student Visits, Fall 2012 |
136 |
222 |
246 |
335 |
939 |
Students E-mailed Regularly with Study Guides, Fall 2012 |
414 |
152 |
227 |
337 |
1130 |
Key Findings of 2011-2012 Data [16]
Key Findings of 2010-2011 Data [17]
Cox Communication Academic Center for Student Athletes (CCACSA)
Sample: Students and staff who serve as tutors for the Cox Center for Athletes and student athletes using the tutorial services (Completed survey: 2010: 95; 2011: 84; 2012: 55; 2013: 82)
|
Students and staff Respondents |
2010 |
95 |
2011 |
84 |
2012 |
55 |
2013 |
82 |
Key Finding(s) and/or Change(s) Resulting from Assessment
Genesis Tutoring
Genesis Tutoring is evaluated through a pre/post test paper survey and monitoring usage data.
Key Finding(s) and/or Change(s) Resulting from Assessment
SMARTTHINKING Online Tutoring
Online Tutoring is offered through a service called SMARTHINKING in subject areas including writing, reading, math, basic math, business, science, Spanish, computers and technology.
Student Sample: The 2007 student sample of 847 included all students who used the online tutoring service SMARTTHINKING, with 115 respondents.
Key Finding(s) and/or Change(s) Resulting from Assessment
ACADEMIC ADVISING
Academic advising/consulting/counseling is decentralized and located within each of the academic colleges. A sample of five of the ten academic colleges’ assessment of academic advising is included below.
LSU uses the National Survey on Student Engagement (NSSE) as a university-wide assessment of various institutional functions, including academic advising. LSU participated in NSSE in 2003 and 2004, and began a two-year cycle of administering the NSSE in 2007, with continued participation in 2009, 2011, and 2013.
The NSSE changed radically in 2013. Prior to 2011 there was no question that specifically addressed interaction with advisors; however, it included questions that allowed students to provide open-ended information regarding their experiences at the institution. In 2013, the question asked, “How do you rate the quality of your interaction with academic advisors?”
LSU’s freshmen compare closely, 65% vs. 66%, to our Carnegie Peers with respect to high satisfaction with their advisors. Further, those who rated their advisors as “poor” are identical at 4%. This trend carries through to the seniors, with 64% of both our seniors and their Carnegie peer counterparts being satisfied with their advising. The percentage of LSU students who responded “poor” was 6% as compared to 5% among Carnegie peers. [23] [24]
Analysis of freshman data showing progression of percent of answers in the top two categories (“Quite a bit,” “Very much”) in chronological order from 2007-2013 indicates growth in satisfaction of our freshmen with advising and also shows over the past six years LSU drawing even with, and eventually slightly surpassing, Carnegie peers in satisfaction with freshmen advising.
Analysis of data for seniors showing progression of percent of answers in the top two categories in chronological order from 2007-2013 indicates growth in satisfaction with advising as they also catch, and eventually slightly surpass, their Carnegie peers in 2013.
University College
Advising for the majority of first year students at LSU is provided through the University Center for Freshman Year in University College. University College has utilized assessment for continuous improvement of programs and services, and implemented changes based on assessment results. Below are examples of evidence of improvement based on analysis of assessment results.
Sample: Students who attend one-on-one academic advising appointments in UCFY. (Sample = 8170; Respondents = 1559)
Key Finding(s) and/or Change(s) Resulting From Assessment
College of Agriculture
Academic Advising Services, offered through the College of Agriculture, are evaluated through survey questions included on the LSU Graduating Student Survey.
Key Finding(s) and/or Change(s) Resulting from Assessment
College of Art and Design
Academic Advising Services offered through the College of Art and Design are evaluated through exit interviews with graduating seniors (Each May, the Dean and Associate Dean meet with a sampling of graduating students from each of the four units within the College.) Feedback provided to the units as appropriate and is used to improve student support services offered by the college. As a result of data collected in 2011, advisors implemented “Advising Nights” to reach additional students and accommodate student schedules [31].
College of Humanities and Social Sciences (CHSS)
Academic Advising Services offered through the College of Humanities and Social Sciences are evaluated through a paper survey offered to students following an appointment with an academic counselor.
Survey results are used to ensure that the CHSS is doing what is necessary to assist students in a positive and impactful way. Changes are made as a result of careful interpretation of the data. Results also are used in evaluation of academic counselors and, specifically, to provide feedback regarding immediate issues associated with a specific counselor. They also are included in the counselor’s annual evaluation. Additionally, results are used at weekly staff meetings to address big-picture issues. [32]
College of Human Sciences and Education (CHSE)
Academic Advising Services offered through the College of Human Sciences and Education are evaluated through an online Survey sent out via email following student advising appointments. As a result of steady student number growth over the last 10 years from a student population of approximately 1200 students to our current undergraduate population of approximately 2000 students, the CHSE began implementing “service satisfaction surveys” to all students who completed an appointment beginning in November of 2012.
Key Finding(s) and/or Change(s) Resulting from Assessment
Graduating Student Survey
Graduating students complete an exit survey administered by Career Services that provides student feedback in a variety of areas. Included are opportunities for students to report open-ended feedback regarding their academic advising experience. Results are shared with the academic colleges, and each college utilizes results for change and improvement [34] [35] [36] [37] [38] [39].
LSU LIBRARIES
The LSU Libraries is committed to tracking and evaluating a wide variety of metrics and statistics that provide a solid foundation for assessment and decision-making. The Libraries regularly tracks serial and database usage data, circulation data, gate count, reference transactions, and instruction sessions. The Libraries use this information to assess its collection and services and to adjust to the changing needs of the university.
The assessment of instruction in the Libraries is accomplished in several ways. The Libraries one-credit instruction course, LIS 1001, uses a pre-/post-test mechanism to assess students’ learning of information literacy skills. The Libraries’ instruction committee modifies the content of the course as needed. The Libraries also provide one-time instruction for students at the request of faculty members. These 45-60 minute instructional activities are assessed by use of an online form that allows students to provide feedback about the session. The Libraries also has online tutorials for students with embedded feedback forms.
The following are examples of changes implemented because of the LSU Libraries assessment activities.
Serials Survey and Assessment
Approximately every five years, LSU Libraries administers a serials-needs assessment survey to faculty. At the request of the Libraries, faculty submit lists of ranked serial titles deemed essential for their research or teaching. The last serial survey was completed in spring 2009.
WebFeat Evaluation Leading to EBSCO Discovery Service
In an effort to provide an easier, more comprehensive and effective searching experience for patrons, in 2006 LSU Libraries initiated a subscription to a new federated search program called WebFeat, which would search all of the databases for which WebFeat was paid to set up a connection.
WebFeat and other federated search engines were a step in the right direction, but eventually proved to be inadequate to the task because of the slow speed at which searches were conducted. After several years of trying to fine-tune the program, the Libraries cancelled its subscription in 2009.
At the same time, next generation systems were being developed on the market to perform similar functions. LSU Libraries monitored these developments, and in 2012 procured EBSCO’s Discovery System.
In fall of 2012 the Libraries fully deployed the EBSCO Discovery System and has spent the past year fine-tuning it. Initial anecdotal responses through reference librarian interactions with patrons as well as classroom use by librarians have been very good and very encouraging. The new generation search systems are providing the more comprehensive, easier, Google-style searching that patrons seem to want. More formal evaluations of this system will be implemented in the academic year 2012-2013; usage data continues to be monitored.
Print Approval Plan repurposed to e-DDA model
During fiscal year 2012 the LSU Libraries evaluated the process of purchasing print monographs within the set parameters of collection development’s Approval Plan. The decision was made to repurpose and adapt the Approval Plan to include electronic books through a new business model which allows for point-of-need access called e-DDA, or electronic demand-driven acquisition. E-books can either be “borrowed” as a short-term loan with a small fee (paid by the Libraries) or purchased by the Libraries for a larger cost.
The electronic demand-driven acquisition model contains its own assessment and feedback mechanism. Items are purchased based directly on the amount of use they receive from faculty, staff, and students. Insufficient use = no purchase; enough use to effect a “trigger” (based on multiple criteria) = one short-term loan (paid); two short-term loans = one purchase. The initial success of this program caused the Libraries to expand the FY2012 pilot of science e-books only to a program incorporating e-books in the social sciences as well. The e-DDA model has greatly reduced the Libraries’ book expenditures, while providing an increased number of titles to which full-text access is available.
Tracking ILB requests for purchase recommendations
The Libraries’ Interlibrary Borrowing unit and subject liaisons track and assess data generated by faculty, staff, and students when requests are made to borrow materials not owned or accessible at LSU. In fall 2011 additional fields were added to the Interlibrary Borrowing submission form (Illiad) asking patrons if they recommend the Libraries purchase the material requested for borrowing [40]. All purchase recommendations are then sent from ILB to subject liaisons to review and make final purchasing decisions [41].
Implementing a new document delivery service
In February 2012 Interlibrary Borrowing (ILB) launched a pilot project to test their ability to offer document delivery services. ILB staff scanned and electronically delivered articles and book chapters owned only in print and Middleton Library. The pilot project lasted about one year and it became an official service for faculty and staff in January 2013, as the workload was deemed manageable with existing staff. [42]
After the success of the faculty and staff pilot, ILB decided to launch another pilot for graduate students in January 2013 and the advertising strategy was very similar to the faculty and staff pilot. The number of requests we received for Document Delivery increased tremendously [43], but response to the service was also extremely positive, especially from students researching off campus or working full-time jobs while going to school [44]. In July of 2013, the Libraries officially expanded the service to graduate students.
Organizational Units Selected for Assessment beyond the Division of Student Life and Enrollment
Requests for information were made to representatives within academic colleges and units that support student success as part of their primary mission, yet do not report to the Division of Student Life and Enrollment. The units included in the initial compliance certificate for CS 3.3.1.3 were those who self-reported assessment efforts in the pursuit of offering and strengthening academic and student support services. Additionally, the first certificate focused on the student life and academic support units that had been addressed in CR 2.10.
Additional information regarding assessment of the other academic support areas identified in the compliance certificate for CS 3.4.9 is included below. The addendum includes samples of assessment of Counseling/Consulting, Information Technology, Mentoring, Academic & Resource Centers, Laboratories, Special Services, Experiential Learning, and Distance Learning.
COUNSELING/CONSULTING
Various forms of counseling and consulting are offered throughout the institution. Learning strategies consultations are offered through the Center for Academic Success. Counseling/ consulting is centralized in terms of mental health counseling within the Student Health Center and career counseling within Career Services.
Center for Academic Success Learning strategies consultations are evaluated through online Survey following the consultation.
Individual Consultation Survey at the Center for Academic Success (CAS)
|
Students surveyed |
Student Respondents |
Spring 2011 |
189 |
38 |
Fall 2011 |
344 |
57 |
Spring 2012 |
73 |
33 |
Fall 2012 |
163 |
35 |
Key Finding(s) and/or Change(s) Resulting from Assessment:
Career Counseling
This service is evaluated through an online Survey following a career decision-making (i.e. career counseling) appointment.
Career Decision-Making Post-Appointment Survey- included all students participating in individual career decision counseling appointments offered by Career Services
|
Students surveyed |
Student Respondents |
2011-2012 |
unknown |
257 |
2012-2013 |
unknown |
213 |
Key Finding(s) and/or Change(s) Resulting from Assessment
INFORMATION TECHNOLOGY
Information Technology is regularly assessed through a variety of ways, including surveys and the monitoring of usage data.
Key Finding(s) and/or Change(s) Resulting From Assessment
MENTORING
Tiger Transition Team
Tiger Transition Team Mentor/Mentee Evaluation Survey
|
Mentors surveyed |
Mentor Respondents |
Mentees surveyed |
Mentee Respondents |
Fall 2010 |
232 |
82 |
387 |
107 |
Fall 2011 |
155 |
38 |
|
|
Spring 2012 |
|
|
275 |
12 |
Key Finding(s) and/or Change(s) Resulting from Assessment
ACADEMIC AND RESOURCE CENTERS
Academic and Resource Centers, as identified in the compliance certificate for CS 3.4.9, include services offered through a variety of offices throughout the LSU Campus. Below is a sampling of assessment data from three academic and resource centers.
Communication across the Curriculum (CxC)
The sample includes students and faculty participating in Communications-Intensive (C-I) courses.
Key Finding(s) and/or Change(s) Resulting from Assessment
Disability Services
Disability Services provides/coordinates a wide of array of accommodations and services for students with disabilities including note taking, alternative format text and other materials, accommodative testing, interpreting and captioning, etc. Disability Services utilizes tracking data.
Data on # of Students Served by Disability Services
Year |
# of Students Served |
% Increase Over Previous Year |
2011 |
1300 |
8.20% |
2012 |
1426 |
9.69% |
2013 |
1596 |
11.92% |
Data on # of Exams Proctored in Disability Services
Year |
# of Exams Proctored |
% Increase Over Previous Year |
2011 |
6428 |
31.13% |
2012 |
7493 |
16.57% |
2013 |
8850 |
18.11% |
Key Finding(s) and/or Change(s) Resulting From Assessment
Residential Colleges
Sample: The student sample included all students who lived in a residential college hall.
Key Finding(s) and/or Change(s) Resulting From Assessment
LABORATORIES
Laboratories are regularly assessed through the tracking and feedback data. A sample of two laboratories at LSU is included below.
Communication across the Curriculum Studio (Laboratories)
The Communication across the Curriculum Studios across campus are equipped with state-of-the-art technology and highly-skilled communication advisors. Tracking usage numbers in laboratories is used to assess effectiveness and need.
Key Finding(s) and/or Change(s) Resulting from Assessment
Computer Aided Design & Geographic Information Systems (CADGIS) Computer Lab
The CADGIS Computer Lab is assessed through exit interviews with graduating seniors. Each May, the dean and associate dean meet with a sampling of graduating students (grad and undergrad) within the College of Art and Design, the primary users of the CADGIS Lab.
Key Finding(s) and/or Change(s) Resulting from Assessment
SPECIAL SERVICES
Below is a sample of one of the special services identified in the compliance certificate for CS 3.4.9.
IMPACT Assessment
Sample: The student sample included all students who participated in the IMPACT program. (2010 survey: 127 = Sample, 38 = Respondents; 2011-2013 quantitative data comparison).
Key Finding(s) and/or Change(s) Resulting from Assessment
EXPERIENTIAL LEARNING
Experiential Learning, as identified in the compliance certificate for CS 3.4.9, consists of service-learning (S-L) through the Center for Community Engagement Learning and Leadership (CCELL)
Key Finding(s) and/or Change(s) Resulting From Assessment.
DISTANCE LEARNING RESOURCES AND ACADEMIC SUPPORT
Online Student Services
LSU offers instruction via multiple modalities. Online instruction involves (1) students in and around the Baton Rouge area taking some, or all, courses online and (2) students outside of the geographical area who are completely enrolled and access all services online. Students have access to a wide range of services regardless of the modality in which the course is delivered, including orientation materials and online tutorials regarding learning styles. A needs and satisfaction survey that was implemented to allow students in the LSU Online program to provide feedback to the university included assessment of needs as related to students experience with academic resources for distance learning. Below is a select summary of those results.
Sample: The sample included all students enrolled in the LSU Online program (Sample = 45; Respondents = 26) and was administered Spring 2013.
Key Finding(s) and/or Change(s) Resulting from Assessment
SMARTTHINIKING Online tutoring available for distance education students is referenced in the beginning of this response in association with tutoring provided by the institution.