Summary report on the MVP usability test
The second WizardMaker usability test is complete. 8 evaluators worked with a minimum viable product version of the code. But, truthfully, the code was not nearly good enough to be called a minimum product. But it does work and does produce wizards. In summary:
- The app tested well with the exception of the Calculation function. 3 of 8 evaluators needed help using this function.
- Otherwise evaluators could use the app and produce wizards.
- Evaluators rated the usability as 4.1 on a 5 point scale where 1=not very usable and 5 is very usable. I would call this rating good but not great. Usability can be improved
- But evaluators rated usefulness 4.4 on a 5 point scale where 1=not very useful and 5=very useful. This is good but more encouraging is that 7 of the 8 evaluators rated it useful or very useful. See the chart below
- The test uncovered a number of bugs and opportunities to improve usability. Evaluators also suggested future functions. These are being sorted and prioritized.
I believe the results are encouraging enough to continue the project by using the present tool to create some wizards to improve instructions for real tasks. I will have to make a number of improvements, however, based on the test results, before starting this phase.
Thanks Xerocraft and Code for Tucson for their help by providing both guidance and facilities for the project.
