Data Collection


Process Scorecard

Description

A process scorecard evaluates a process according to a set of predefined criteria. Based on the user's feedback, the scorecard gives a rating for the process and often times short recommendations according to the rating the process receives.

Questionnaire for User Interface Satisfaction

Description

The questionnaire for user interface satisfaction (QUIS) elicits user opinions and evaluates user acceptance of a computer interface. The questionnaire asks the user to rate the interface in areas such as ease of use, consistency, system capability, and learning. The questions relate to human-computer interfaces and responses are normally measured on an ascending scale from 1 to 10.

Survey

Description

A survey is a means of collecting data from a targeted group, typically key stakeholders, with the purpose of eliciting opinions, behavior, or knowledge, usually related to their needs or satisfaction. There are many formats for a survey including a questionnaire, an interview, or a focus group.

Log

Description

A log is a generic data collection form used for recording what has been done, when it was done, who did it, and any other information pertinent to a situation. Since a log is generic, it is generally created to apply to the user’s particular situation. A log is usually in some type of table format, where there are columns for recording information such as time, location, and personnel, and then a main column for recording what happened or what was done. A log can be used to record pieces of information ranging from one word to a paragraph or even more.

NASA Task Load Index

Description

The NASA task load index (NASA TLX) is a tool for measuring and conducting a subjective mental workload (MWL) assessment. It allows you to determine the MWL of a participant while they are performing a task. It rates performance across six dimensions to determine an overall workload rating. The six dimensions are as follows:

1. Mental demand – how much thinking, deciding, or calculating was required to perform the task.
2. Physical demand – the amount and intensity of physical activity required to complete the task.

Verbal Protocol Analysis

Description

A verbal protocol analysis (VPA) is a think-aloud method of eliciting cognitive and physical process descriptions from a user. The descriptions are of processes that are performed by the user to complete a specific task.

Kepner-Tregoe Matrix

Description

A Kepner-Tregoe matrix is used to find causes of a problem. It isolates the who, what, when, where, and how aspects of an event, keeping the focus on the elements that have an impact on the event and eliminating the elements that do not. This allows you to compare what the problem is, with what it is not, illuminating distinctive features of the problem and pointing out its potential causes.

Workload Profile Technique

Description

The workload profile technique is a subjective, multidimensional mental workload (MWL) assessment tool. It is used to determine demand ratings imposed by a task across the eight following dimensions:

1. Perceptual or central processing
2. Response selection and execution
3. Spatial processing
4. Verbal processing
5. Visual processing
6. Auditory processing
7. Manual output
8. Speech output.

Observation

Description

Observation serves as a means of capturing what and how a person performs his or her work (in either the real or a simulated work environment).