Difference between revisions of "Running the usability test"
m (→Low participation) |
(→User performance) |
||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
===Session programme=== | ===Session programme=== | ||
For each session we ran through the steps listed in the test protocol. In brief these were: | For each session we ran through the steps listed in the test protocol. In brief these were: | ||
| − | + | # Welcome and introduction. | |
| − | + | # Pre-test questionnaire (on skills) | |
| − | + | # Test the map-based computer interface. | |
| − | + | # Post-test questionnaire (on 3) | |
| − | + | # Spend up to 15 min. filling in the conventional paper questionnaire as send out by [http://www.niacro.co.uk/ PBNI]. | |
| − | + | # Post-test questionnaire (on 5) | |
| − | + | # Group discussion on usability of 3 and 5. | |
===Low participation=== | ===Low participation=== | ||
| Line 20: | Line 20: | ||
===User performance=== | ===User performance=== | ||
| − | We had to help the ex-offenders at times. For example, one needed help entering the comments on the map. Otherwise, there were few difficulties with the map. All needed help in reading the consultation questionnaire (at times it used phrases that were more complicated than the language used in tabloid newspapers), and two had difficulties filling it in (one only ticked the boxes, the other had to get a research assistant to write down the free text answers). | + | We had to help the ex-offenders at times. For example, one needed help entering the comments on the map. Otherwise, there were few difficulties with the map. All needed help in reading the [http://www.pbni.org.uk/annex-a-questionnaire.pdf consultation questionnaire] (at times it used phrases that were more complicated than the language used in tabloid newspapers), and two had difficulties filling it in (one only ticked the boxes, the other had to get a research assistant to write down the free text answers). |
Latest revision as of 19:29, 13 January 2008
Session programme
For each session we ran through the steps listed in the test protocol. In brief these were:
- Welcome and introduction.
- Pre-test questionnaire (on skills)
- Test the map-based computer interface.
- Post-test questionnaire (on 3)
- Spend up to 15 min. filling in the conventional paper questionnaire as send out by PBNI.
- Post-test questionnaire (on 5)
- Group discussion on usability of 3 and 5.
Low participation
On 13 April we set up the software on a number of machines at NIACRO.
As this was the Thursday before Easter Friday, many trainees did not turn up for the session. We were left with one ex-offender in the morning, and one ex-offender and one non-offender in the afternoon. As they were at different stages of the NIACRO training, their familiarity with computers and the Internet differed.
As only three people turned up before Easter, we left copies of the forms and instructions at NIACRO , so that other trainees could be offered the chance to test the software after Easter. But not one trainee did so.
A possible explanation is that non-offenders do not know anything about probation offices, and probationers are less willing to help the PBNI (or do not trust that their comments will be anonymous). We are looking at ways of following up this preliminary study by designing geographical tasks that young offenders would perceive as more interesting and less threatening.
User performance
We had to help the ex-offenders at times. For example, one needed help entering the comments on the map. Otherwise, there were few difficulties with the map. All needed help in reading the consultation questionnaire (at times it used phrases that were more complicated than the language used in tabloid newspapers), and two had difficulties filling it in (one only ticked the boxes, the other had to get a research assistant to write down the free text answers).
