Seminar 2 summary
Evaluation is a method to use in order to make sure that a whole design/product or parts of it is working properly from a user perspective. What part that is being evaluated can differ, depending on what the aim of the design/product is. The different evaluation methods were discussed, settings involving users (both controlled and in the wild) and settings not involving users.
During the seminar the following questions were discussed:
- What setting and method is appropriate for evaluating our application?
- Are the results valid? reliable? What about biases etc.?
In the next excersice we will perform a heuristic evaluation. This evaluation doesn't involve any potential user which could be a seen as a drawback. Furthermore, all experts are from the course. The group is therefore contemplating performing a cognitive walkthrough with a person that isn't taking the course, to avoid bias. We also would like to perform a evaluation in a natural setting to involve actual users. This will be done in the later stages, when we have a hi-tech prototype.
Doing a usability test in a controlled setting such as a laboratory, will not be feasible as the scope of the project does not allow such a evaluation.
Due to the fact that Augemented Reality (AR) is a relatively new technology, performing evaluations without the users could be less reliable and less valid compared to evaluating a more established technology since there is less knowledge about such systems. Furthermore users might not have any previous experiences with AR to base their expressions and opinions on, which can cause problems in regards to the validity of evaluation involving users.
Since only a prototype will be developed in this project, a final summative evaluation will not be conducted. However, starting from next weeks exercises formative evaluations will be performed.
Usability testing through experiments was discussed during the seminar and the group concluded that such a method of evaluation will not be performed as it usually is done in a later stage of the development process. Analytics, where user traffic through a system will not be performed due to the same reasons. We won't have a fully functional system and enough users to test this.
Evaluation is a method to use in order to make sure that a whole design/product or parts of it is working properly from a user perspective. What part that is being evaluated can differ, depending on what the aim of the design/product is. The different evaluation methods were discussed, settings involving users (both controlled and in the wild) and settings not involving users.
During the seminar the following questions were discussed:
- What setting and method is appropriate for evaluating our application?
- Are the results valid? reliable? What about biases etc.?
In the next excersice we will perform a heuristic evaluation. This evaluation doesn't involve any potential user which could be a seen as a drawback. Furthermore, all experts are from the course. The group is therefore contemplating performing a cognitive walkthrough with a person that isn't taking the course, to avoid bias. We also would like to perform a evaluation in a natural setting to involve actual users. This will be done in the later stages, when we have a hi-tech prototype.
Doing a usability test in a controlled setting such as a laboratory, will not be feasible as the scope of the project does not allow such a evaluation.
Due to the fact that Augemented Reality (AR) is a relatively new technology, performing evaluations without the users could be less reliable and less valid compared to evaluating a more established technology since there is less knowledge about such systems. Furthermore users might not have any previous experiences with AR to base their expressions and opinions on, which can cause problems in regards to the validity of evaluation involving users.
Since only a prototype will be developed in this project, a final summative evaluation will not be conducted. However, starting from next weeks exercises formative evaluations will be performed.
Usability testing through experiments was discussed during the seminar and the group concluded that such a method of evaluation will not be performed as it usually is done in a later stage of the development process. Analytics, where user traffic through a system will not be performed due to the same reasons. We won't have a fully functional system and enough users to test this.
Inga kommentarer:
Skicka en kommentar