Use the following checklist to assure that required elements (v) are addressed in your CIF report. Recommended items are denoted with a ‘w’. Report corrections and suggestions to iusr@nist.gov. This checklist is also available in Word97 format.

 Title Page

w Enter Company Logo or Name

v Identify report as: Common Industry Format for Usability Test Report v1.1

v Name the product and version that was tested

v Who led the test

v When the test was conducted

v Date the report was prepared

v Who prepared the report

v Customer Company Name

v Customer Company contact person

v Contact name(s) for questions and/or clarifications

v Enter phone number

v Enter email address

v Enter mailing or postal address

w Enter Company Logo or Name; may be omitted

Executive Summary

v Provide a high level overview of the test

v Name and describe the product

vSummary of method(s) including number and type of participants and tasks

vResults expressed as mean scores or other suitable measure of central tendency

w Reason for and nature of the test

w Tabular summary of performance results

v Start on new page; end with page break

Introduction

Full Product Description

vFormal product name and release or version

vDescribe what parts of the product were evaluated

vThe user population for which the product is intended

w Any groups with special needs

w brief description of the environment in which it should be used

w the type of user work that is supported by the product

Test Objectives

v State the objectives for the test and any areas of specific interest

v Functions and components with which the user directly and indirectly interacted

w Reason for focusing on a product subset

Method

Participants

vThe total number of participants tested

vSegmentation of user groups tested, if more than one

v Key characteristics and capabilities of user group

v How participants were selected; whether they had the essential characteristics

vDifferences between the participant sample and the user population

w Description of groups with special needs

v Table of participant (row) characteristics (columns)

Context of Product Use in the Test

vAny known differences between the evaluated context and the expected context of use

Tasks

vDescribe the task scenarios for testing

vExplain why these tasks were selected

vDescribe the source of these tasks

vInclude any task data given to the participants

vCompletion or performance criteria established for each task

Test Facility

w Describe the setting, and type of space in which the evaluation was conducted

w Detail any relevant features or circumstances which could affect the results

Participant’s Computing Environment

v Computer configuration, including model, OS version, required libraries or settings

v If used, browser name and version; relevant plug-in names and versions

Display Devices

v If screen-based, screen size, resolution, and color setting

v If print-based, the media size and print resolution

v If visual interface elements can vary in size, specify the size(s) used in the test

Audio Devices

w If used, specify relevant settings or values for the audio bits, volume, etc

Manual Input Devices

w Ifused, specify the make and model of devices used in the test

Test Administrator Tools

v If a questionnaire was used, describe or specify it here

w Describe any hardware or software used to control the test or to record data

Experimental Design

v Describe the logical design of the test

v Define independent variables and control variables

v Describe the measures for which data were recorded

Procedure

vOperational definitions of measures

v Operational definitions of independent variables or control variables

vTime limits on tasks

vPolicies and procedures for interaction between tester(s) and subjects

w Sequence of events from greeting the participants to dismissing them

w Non-disclosure agreemens, form completion, warm-ups, pre-task training, and debriefing

w Verify that the participants knew and understood their rights as human subjects

w Specify steps followed to execute the test sessions and record data

w Number and roles of people who interacted with the participants during the test session

w Specify if other individuals were present in the test environment

w State whether participants were paid

Participant General Instructions

v Instructions given to the participants (here or in Appendix)

w Instructions on how participants were to interact with any other persons present

Participant Task Instructions

v Task instruction summary

Usability Metrics

v Metrics for effectiveness

v Metrics for efficiency

v Metrics for satisfaction

Results

Data Analysis

v Data Scoring

v Data Reduction

v Statistical Analysis

Presentation of the Results

Performance Resultsv

v Tabular Performance Results per task or task group

v Summary Table(s) of Performance Results across all tasks

v Graphical Presentation of Performance Results

Satisfaction Results v

v Tabular Satisfaction Results

v Summary Table(s) of Satisfaction Results

v Graphical Presentation of Satisfaction Results

Appendices

v Custom Questionnaires, if used

v Participant General Instructions

v Participant Task Instructions

w Release Notes