Step 7: Standard Report Contents

MSL Report Contents

Reviewing the MSL Example Report is the best way to get a sense of what will be in the MSL report.  You may download a copy of the MSL Example Report here.

Please become familiar with the report ordering deadlines - missing the deadlines may result in not receiving your preferred report contents.

The MSL Standard Report will come in 6 Modules:

Module 1: Study Design and Methodology

This module will serve as an overview to the study design and methodology. It will describe data use and acknowledgement policies; an overview of the study purpose, history, rationale, theoretical frame, conceptual frame, participating institutions and details about the sample selected. It will also include specific facts relating to the MSL questionnaire instrument, including details about validity and reliability, self-report data limitations, and cross-sectional design considerations. This module will also include specific information regarding the overall and institution-specific data collection activities such as response rates, completion times, and other custom requests.

Module 2: Respondent Characteristics & Distributions

This report provides key information regarding who responded to the survey and what they reported overall. Module 2 is made up of three different table types: First, the Response Rates table shows the response rate (AAPOR RR2) (The American Association for Public Opinion Research. 2011. Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. 7th edition. AAPOR) for your school compared with the overall study and your comparison groups. Response rates by demographic categories (Gender, Race, and Class Standing) are also given if data were provided in the school sample. The Basic Response Distribution portion of this report is helpful for understanding the degree to which your sample mirrors both your institution’s full undergraduate population as well as the samples against which you are comparing data (i.e., the comparison groups that you selected to appear in the report). And lastly, the Respondent Distribution Across Variables section provides sample sizes and distributions for most survey items.

Example of Response Rates Report:

Response Rates Report.png

Example of Response Distribution Report:

Response Distribution Report.png

Module 3: General and Sub-Study Outcomes

This report provides important information on your students’ reported achievement across the general and sub-study outcomes in the MSL. It also provides statistical tests to determine the extent to which your students score significantly differently than their peers in the comparison groups that you’ve selected. In addition to the general and sub-study outcomes, Module 3 also includes the MSL Delta Measure tables, which provide a change over time analysis focused on outcome achievement for seniors at your school (for community colleges, this measure has been adapted to include all students in your sample).

Example of General and Stub-Study Outcomes Report:

General and Stub-Study Outcomes Report.png

Example of Delta Measure: Change Over time Report:

Delta Measure- Change Over time Report.png

Module 4: Campus Outcomes

This report provides insight into the relationships that exist between key demographic characteristics (e.g., race, gender) and outcome measures as well as student experiences during college (e.g., student organization involvement, mentoring relationships, participation in leadership training programs) and outcome measures. These results point to critical differences in outcome achievement among student sub-populations as well as the experiences during college that seem to have the greatest influences on your students’ outcomes.

Examples of Campus: Inputs and Environments by Outcomes Tables:

Module 5: National Outcomes

This report is a repeat of Module 4, however, it will display the same results using the random sample national dataset.

Module 6: Custom Question Responses (If Applicable)

If custom questions were provided, this report will present categorical frequencies or numerical means as appropriate for the question asked. Any text response or open-ended items will not be included in these tables, however, they will be provided in the accompanying data file.

Scott D. Crawford