Point-in-Time reports provide a picture of student learning and progress at a specific point in time (i.e. within one time interval).
Point-in-Time reports can be run on Assessment Instruments or Outcome Sets. They can be used to add visual information in support of your report narrative and to judge how students are doing as they enter the program. This will give you baseline data for use in progress reporting; to show that students are learning as they progress through the instructional program. Point-in-Time reports may also be used to judge how students are doing as they finish the instructional program and to show that your instruction is effective. Lastly, they may be used in data-driven improvement efforts.
Step 1: Open Advanced Filters
1. Click on the Advanced Filters option to open the report setting options.
Step 2: Select Report Scope
2. Using the List By drop-down menu, select the desired option.
3. Using the Statistics drop-down menu, select Overall Average, Performance Level Counts, or Percent.
Step 3: Select Time Intervals
4. Click into the existing time interval fields to select your desired date range.
5. Click Apply after making your selection.
If you do not select a specific time interval for your report, the time interval will default to the last cache build range.
Step 4: Select Filter Options
All Filter Options are optional. Select only those that are desired for your specific report.
6. Click the Choose Instrument button to select the Assessment Instrument. This button may also be labelled Choose Outcome if you are running the report by Outcome Set.
7. Use the Table of Contents menu to select a specific Table of Contents and section(s) to use to filter the assessments in your report.
8. If you wish to filter the assessments by responses that you have collected on one of your Forms, you can choose to either "Filter by select individual responses" or "Compare responses for a single question". You will then be prompted to select the Form and the question(s) you wish to use for filtering or comparing.
9. If you wish to filter the assessments by the department or group to which the students belong, use the Choose button to make this selection.
10. If you wish to filter the assessments by Assessor, you can choose to "Filter by Assessor Department/Group", "Filter by Individual Assessor", or "Filter by Department Contact List".
11. The Assessment Volume option will allow you to select a minimum number of assessments that must exists for the select Assessment Instrument or Outcome Set in order to be included in your report.
Step 5: Select Calculation & Output Options
12. Calculation Options
- In Case of Multiple Submissions: If more than one submission was made and scored, this option allows you to select to include all submissions, average student submission scores, use the latest student submission score, or use the earliest student submission score.
- Filter by Date: This option allows you to select to filter by the date the submissions were made or the date the submissions were assessed.
- Statistics Mode: This option allows you to select to display population or sample statistics.
- Calculate Rubric Means Using: You have the option to calculate instrument means using Criterion scores or Overall scores.
- Reliability Assessment Scores: If you have performed reliability tests using this assessment instrument you can select to include or exclude the reliability assessment scores.
- Held Scores: This option allows you to decide whether or not you would like to include held scores in your report.
- Resubmission Scores: This option allows you to choose whether you would like to include or exclude resubmission scores in your report.
13. Output Options
Select the output options you wish to include in your report by clicking on the associated checkboxes.
14. Pegging Scheme
If would like to apply a pegging scheme to the assessment instrument used for this report, use the drop-down menu to select the desired pegging scheme.
The output options selected in this example are for the purposes of this sample report. Please select the desired output options based on what you would like to display in your report.
What does "Zero Performance Levels" mean?
Zero performance levels may be set up as part of your performance levels when you are creating rubrics. A score of zero generally means that the work was not submitted, or that the submitted work did not satisfy the requirements. Including the zero score in the calculation of the mean will negatively impact the mean score. Check the option only if you want to include any zero scores in the calculation of the mean.
Zero scores should not be confused with Not Applicable criterion scores. N/A scores are not included in the calculation of the mean score
What does "Mean Bar Chart" mean?
The Mean Bar chart gives an indication of the range of scores. For example, if you have a seven (7) performance level scoring range, a mean of 3.5 would have a 50% mean bar chart.
Step 6: Generate Report
15. Click on the Generate Report button.
Step 7: Review the Report
Your report will now be displayed in table format. You have the following options on this screen:
16. Settings Summary: To view a summary of the report settings, click setting summary icon.
17. Report Settings: To make changes to the report parameters, select this option. If you make any changes on the report settings, click the Reload button to see the changes take effect.
18. Export: If you would like to save the report on your computer, you can export it as Excel TSV, Raw XML or Excel XML.
19. Save New: This options allows you to save this report so that you can run it in the future without having to select the parameters again. Saving the report will also allow you to insert the report into a portfolio.
20. Click on the Remove from Site Library button to remove the saved report from the library, if applicable.
21. Report Table Options:
- Show/Hide Columns: This option allows you to hide any of the columns that are currently displayed. You can also select to show them (unhide) if you have previously hidden them.
- Copy: To save a copy of the report table to your clipboard so that you can paste it elsewhere (e.g. into a Word Document on your computer).
- CSV: To download the report to your computer in CSV format, use this option.
- Print: This option will create a printer-friendly version of the report so that it can be printed.
Step 8: Browse Report Results
Viewing a mean score for an entire Outcome Set is of limited value, since this view will tell you nothing about discrete skills. To gain further insight into student abilities, examine individual Outcomes (Outcome Sections or Subsections).
22. Click the Browse link on the right side of the table.
Step 9: Drill Down into Results
You can now drill further into Outcome results of interest.
23. Click on a point on the line graph or bar graph and select a drill-down option. In this case, we have selected Drill down into outcomes.
Identify low scores that have high percent values (Outcomes that have the lowest scores).
Step 10: View Outcome Scores by Student
24. Drill into these low scores by clicking on the bar or graph point again and select a drill option. Select Related Information and choose the Outcome Scores by Student (Matrix) option to view Outcome Section scores by student.