...
If we were to do this project again, we would like to conduct earlier computer prototype user testing, especially with the uploading interface. During GR6 user testing we discovered that there are deficiencies in the current interface that only music directors could spot. Our fellow classmates were not well acquainted with the WMBR workflow, and failed to identify some areas of improvement (such as the FCC obscene word marking feature). Furthermore, we should have, as a team, prioritized our tasks better and made more conscious decisions regarding the design. This would have allowed us to address the most important issues first (uploading, editing), and focus our efforts on components that are central to the purpose of the KaJaM! application.
Finally, we discovered that user testing can be very challenging because users often feel pressured to "do the right thing", rather than identifying usability issues. There were several instances where the user would become withdrawn, uncommunicative, and frustrated that he or she could be complete the scenario tasks. It was an important cue for us to be more patient with the users, and keep re-assuring them that the problems lie with our design, not their competence. Sometimes it's easy to blame mistakes on the user, but we learned to extract lessons from the users in order to improve our interface design.