LAT User Guides

  1. Home
  2. For Students
  3. For Faculty
  4. For TS Coordinators
    1. LAT Roles, Account Provisioning and Attributes
    2. About the DRF Assessment System
    3. About Rubrics
    4. About the Field Placement Database
    5. About Forms and Surveys
  5. Integration
Home > For TS Coordinators > About the DRF Assessment System

About the DRF Assessment System

The DRF Assessment System is a collection of tools designed to enable an organization to define, organize, evaluate, and report on a folio of work products.

Preparing to use the DRF Assessment System consists of two steps. The first step is to design a Directed Response Folio (DRF) Template that defines work requirements and associated methods of evaluation.

This presentation will provide an overview of the different components of the DRF Assessment System.
File Attachments:
  1. DRF Assessment System Overview (2018).pptx DRF Assessment System Overview (2018).pptx

Best Practices in DRF Setup

This presentation will walk through the best practices for setting up the DRF assessment system for the following uses:

  • Clinical Implementations
  • General Education Portfolio Assessment
  • Showcase Portfolios
  • Showcase Portfolio Assessment
  • Course Outcomes Assessment
File Attachments:
  1. Happy Path Implementations (2018).pptx Happy Path Implementations (2018).pptx

DRF Template Construction

The DRF Template outlines the tasks or requirements that will be scored in a program to which authors will respond. Using the DRF Template Builder, the TS Coordinator determines the outline or structure for the folio, adds directions for the author, and assigns a corresponding evaluation method for each area.

This guide will provide instructions for constructing a DRF Template.
File Attachments:
  1. Quick Start Guide - DRF Template Construction (2018).pdf Quick Start Guide - DRF Template Construction (2018).pdf

Assigning Evaluation Methods

When assigning evaluation methods to requirements in a DRF Template, the following will be decided:

  • which evaluation method occurs at each level
  • if you want DRF weighting
  • the point values (if applicable)
  • whether evaluation methods are visible to Authors.

This guide provides information about the evaluation methods available and instructions for assigning them.
File Attachments:
  1. DRF Evaluation Setup Recommendations.pptx DRF Evaluation Setup Recommendations.pptx
  2. Quick Start Guide - Assigning DRF Template Evaluation Methods (2018).pdf Quick Start Guide - Assigning DRF Template Evaluation Methods (2018).pdf

DRF Programs

The DRF Program defines and provides the structure for how participating individuals work with a selected Directed Response Folio (DRF). When creating a DRF Program, numerous preferences are set and participants are enrolled as Authors, Reviewers, and/or Evaluators to facilitate how work will be done, scored, and distributed.

This guide provides step by step instructions for creating a DRF Program.
File Attachments:
  1. DRF Enrollment Overview (General Options).pptx DRF Enrollment Overview (General Options).pptx
  2. DRF Grouping.pptx DRF Grouping.pptx
  3. Quick Start Guide - DRF Programs (2018).pdf Quick Start Guide - DRF Programs (2018).pdf

Manual Grouping

If the Multiple Groups option has been selected as part of the DRF Program setup, it requires groups to be manually created in order to pair Authors with Evaluators.

This guide provides step by step instructions for creating and managing manual groups.
File Attachments:
  1. Quick Start Guide - Manual Grouping (2018).pdf Quick Start Guide - Manual Grouping (2018).pdf

DRF Program Reports

The reporting tools available for DRF Programs aggregate student portfolio (DRF) data. This data can include student activity, student work submissions, evaluations, and successful alignment to standards.  

It is possible to generate reports on both individuals and groups. Many reports can be exported to Microsoft Excel for manipulation, archiving, or both. These reports can aid in determination of individual performance and form the basis for formative Program/Unit evaluations and institutional accreditation.

These guides will provide step by step instructions for generating each of the DRF Reports available in LAT.
File Attachments:
  1. Quick Start Guide - Adding a Custom Distribution or Weighting to a Rubric Criteria Report (2018).pdf Quick Start Guide - Adding a Custom Distribution or Weighting to a Rubric Criteria Report (2018).pdf
    The Performance by Rubric Criteria Report has additional preferences that will allow you to include a custom distribution and/or weighting in the report results. This guide provides the steps for enabling those preferences.
  2. Quick Start Guide - Author Form Response Report (2018).pdf Quick Start Guide - Author Form Response Report (2018).pdf
    The Author Form Responses Report enables you to generate a report based on the data entered by Authors into custom forms. It provides an easy way to view aggregated results for both an entire group of respondents or for an individual. This report provides a way to compare submission form responses, for a single requirement or for multiple requirements, when the same form is used in multiple areas of a DRF. To narrow your search, you can filter by a particular date range of submissions, which can include both submitted and not yet submitted versions.
  3. Quick Start Guide - Evaluator Activity Report (2018).pdf Quick Start Guide - Evaluator Activity Report (2018).pdf
    The Evaluator Activity report displays the real-time status of evaluation activity, by one or all Evaluators, for selected programs. As well as the identity of the Evaluator, the report identifies the Author, Program, and Category/Requirement. Additional content of the report will vary, depending on the evaluation status you choose.
  4. Quick Start Guide - Evaluator Form Response Report (2018).pdf Quick Start Guide - Evaluator Form Response Report (2018).pdf
    The Evaluation Form Responses Report allows you to generate a report based on the evaluations completed using custom forms built using the LAT Form Builder. It provides a way to see aggregated results for both the entire group of respondents and for individual respondents. This report enables you to compare submission evaluation form responses for a single requirement of a DRF. The Evaluation Form Responses Report can only be used to aggregate data for forms used as evaluation methods. The aggregation of data from forms used for Author submission purposes is done by the Form-Based Author Submission Results Report.
  5. Quick Start Guide - Multi-Program Status Reports (2018).pdf Quick Start Guide - Multi-Program Status Reports (2018).pdf
    The Multi-Program Status Report provides information about the Program enrollment for an Author or group of Authors. This report displays information about the number of requirements of a DRF that have been submitted and the number of evaluations that have been completed.
  6. Quick Start Guide - Performance by DRF Category Report (2018).pdf Quick Start Guide - Performance by DRF Category Report (2018).pdf
    Performance by DRF Category is one of several Performance/Outcome Assessment Reports available from the DRF Program Reports page. This report shows requirement and/or category performance in single or multiple DRF programs or for a selected DRF Template.
  7. Quick-Start Guide - Performance by Rubric Criteria Report (2018).pdf Quick-Start Guide - Performance by Rubric Criteria Report (2018).pdf
    The customized performance report allows you to generate folio assessment performance reports based on selected rubric criteria used to evaluate items in one or more DRF Templates. Since a variety of rubric criteria can be selected for each report, the report is fully customizable. From this report area, you can access and edit custom report formats you have already created, and generate reports on report formats created and shared by other report Coordinators in your learning community.
  8. Quick-Start Guide - Performance Standards Report (2018).pdf Quick-Start Guide - Performance Standards Report (2018).pdf
    The Performance by Standards Report allows you to generate folio assessment performance reports based on selected standards addressed by rubric criteria used to evaluate items in one or more DRF Templates. Since a variety of rubric criteria can be selected for each report, the rubric criteria are automatically grouped by selected standards based on the rubric/standards connection established during rubric setup. From this report area, you can generate reports in system auto-generated format and access reports shared by other report Coordinators in your learning community.
  9. Quick-Start Guide - Program Activity Report (2018).pdf Quick-Start Guide - Program Activity Report (2018).pdf
    The Program Activity Report graphically displays a real-time summary of the work status of Authors in a DRF Program, including the number of Authors who have submitted, and the number of Authors who have been evaluated, in specific areas of the DRF.

Copying DRF Templates and Programs

After the DRF Assessment system has been in use for a period of time, it may be necessary to copy the DRF Template and/or DRF Program in certain situations such as:

  • Changes in evaluation instruments and/or requirements
  • Need to control enrollment
  • Automatically filter submission and evaluation activity by specific groups of students or time frame

This guide provides the steps for making a copy of a DRF Template and Program.
File Attachments:
  1. Quick Start Guide - Copying DRF Templates and Programs (2018).pdf Quick Start Guide - Copying DRF Templates and Programs (2018).pdf
Author: Beth Ortiz
Last modified: 3/26/2018 3:20 PM (EDT)