Evaluating a User Interface with Ergonomic Criteria

Author(s): Scapin, D. L.

Journal/Book: Int J Human-Computer Interact. 1995; 7: 355 Chestnut St, Norwood, NJ 07648. Ablex Publ Corp. 105-121.

Abstract: The usefulness of a set of ergonomic criteria for the evaluation of user interfaces was assessed using a mixed two-factors experimental design. Two groups of usability specialists (control, criteria) were asked to evaluate the interface of a musical database management system in two phases. In the first phase of the experiment, all the participants relied solely on their expertise; in the second phase they were instructed to evaluate the management system again but this time through the replay of their previous exploration: Participants in the criteria group used a set of ergonomic criteria whereas the participants in the control group did not. In the first phase, the two groups did not differ in terms of: (a) the number of usability problems detected, and (b) the proportions of usability problems uncovered as well as the proportion of usability problems found in common, with respect to the number of single evaluations (one by participant) that were computed into combined evaluations (i.e., aggregates). In the second phase, however, the participants in the criteria group had better performances than those in the control group: They uncovered more new problems, and the proportion of problems uncovered as well as the proportion of problems found in common was greater as a function of the number of evaluators in the aggregates. To sum up, the criteria increased the evaluation performance of the experts.

Note: Article JMC Bastien, Inst Natl Rech Informat & Automat, Projet Psychol Ergon Informat, Domaine Voluceau, BP 105, F-78153 Le Chesnay, France

Zurück | Weiter