The main questions the evaluation process aims to answer are:
- How well does the design satisfy the requirements?
- Does the design offer an appropriate user experience?
Chapter 13
In chapter 13, the authors present an evaluation framework, which aimes to help planning the evaluation studies. The presented framework DECIDE can be devided in 6 parts. Initially the high-level goals of the evaluation studies must be determined. By that the scope of the studies can be set, which helps to guide the evaluation. Secondly, questions, that should be answered by the evaluation, have to be formed. In the next step an evaluation methods has to be chosen. This depends not only on the questions formed and the context, but also on practical issues. Often a combination of diffrent methods can be chosen. Afterwards one has to identify practical issues, such as issues involving the participants, facilities and equipment needed, schedule and budget constraints or expertise needed to conduct and evaluate the studies. In the fifth step the evaluators have to decide on how to deal with any ethical issues that might arise during the evaluation process. In the final step the evaluation takes place. The design is evaluated and the resultsare analyzed, interpreted and presented. However during this process the evaluators must check, whether the gathered data is consistent, valid, whether it has ecological validity, whether the results are distorted and therefore biases occure and whether those are within the scope of the study.
Chapter 15
In chapter 15 diffrent types of evaluation methods are presented. Methods presented are heuristic evaluations and diffrent types of walkthroughs as well as analytics. Both heuristic evaluation and walktroughs do not require the presence of the user, but can be conducted by experts. In analytics, however, the user interaction is secretely logged and analysed afterwards.
No comments:
Post a Comment