Anchor | ||||
---|---|---|---|---|
|
Video of the final implementation:http://www.youtube.com/watch?v=R0NJUoRmfBk
(Use 1080p)
Design Description:
| Logging in | ||
| My Uploads | ||
| My Uploads: Dragging Files | ||
| My Uploads: Dropped Files | ||
| My Uploads: Upload Progress | ||
| My Uploads: Uploaded |
| My Uploads: Uploaded |
| My Uploads: Deleting Album | ||
| My Uploads: Editing Album Details | ||
| My Uploads: Release Date | ||
| My Uploads: Adding Genre | ||
| My Uploads: Editing Track Name | ||
| My Uploads: Album Approval | ||
| My Uploads: Searching Uploads | ||
| Reporting | ||
| Reporting: Filtering | ||
| Reporting: Export to Excel |
...
With respect to uploads, limitations in HTML5 and HTTP prevented the "pause" button dictated by our earlier feedback from behaving as expected (pausing the upload). At the moment, it is currently a placebo that does not actually effect affect the upload, as the only other alternative is to cancel the upload entirely and restart it when unpaused, which seems equally undesirable. Given the original use-case justifying the need for the "pause" functionality (i.e. pause would be clicked before "Delete Upload" which should cancel the upload in any case, it seems that a placebo effect would not have significant downsides and would nevertheless improve learnability by "having a button in an expected place" with some understandable behavior.)
...
Finally, space limitations from the standard HTML table layout algorithm resulted in the cramping of the "Play Count" columns, which may impede readability and understanding of the durations over which play counts are aggregated.
Evaluation
User Population
All users are Music Directors at WMBR and fall directly into our target user population. We connected with these users through a group member who is a DJ at the station, but not a Music Director (hence satisfying the project requirement that none of the group members fall into the target user group).
The 4 users are within the age range of 20s - 60s, with varying levels of technical proficiency. Three are female and one is male. All had a need for a music importing system such as KaJaM! Some use the uploading feature more while others are more concerned with the reporting function. Each Music Director is typically in charge of one single music genre. Some music genres deal with more digital content than others, hence usage of the KaJaM! application is expected to differ across users.
Conducting User Tests
User testing was conducted at the WMBR Radio Station located on MIT campus, lasting on average 30 minutes in length. We briefed the users by explaining the scope of our application (limited to importing music, not playing or managing the library), and our hypothetical scenario. The briefing is kept consistent across users by showing them the same instruction sheet. We also explained that we are interested in how users naturally interact with the interface, and assured them that there is no right or wrong way to use the application.
...
Track # | Track Name | Artist | Album | Label | Release Date | Genre |
---|---|---|---|---|---|---|
1 | While I'm Dead | Starmarker | Killer Kilometer | Polyvinyl | 2013-02-20 | Electronica |
2 | Sand Beauty | Starmarker | Killer Kilometer | Polyvinyl | 2013-02-20 | Electronica |
3 | Silver Lining | Starmarker | Killer Kilometer | Polyvinyl | 2013-02-20 | Electronica |
Usability Problems Observed
"Add Genres" button is not conspicuous, it is easy to miss the fact that an album has not been assigned a genre. (Major)
...
Music continues to play even after the uploaded album is deleted. (Catastrophic)
- This is a major problem because if a user plays a track while editing the details and decides to delete the album (upon discovering that the album has already been uploaded previously), the music continues to play despite the removal of the entire album.
Potential solutions:
- This needs a bug fix that checks for currently playing music when a track or an entire album is deleted. If the track or album playing is deleted, stop the music right away.
"Add Genres" button is not conspicuous, it is easy to miss the fact that an album has not been assigned a genre. (Major)
- Currently, unlike other album details such as "Album Name" or "Release Date", it is not obvious when an album has not been assigned a genre. It is easy for a music It is easy for a music director to approve an album without a genre right now, since the "Add Genres" button is quite small in size.
...
- Insert a blank field labeled in red "Missing Genre" in order to warn the music director that no genres have been added to the album.
- Increasing the size of the "Add Genres" button and make it more conspicuous by adjusting the color to be brighter/more saturate.
"FCC Clean" toggle Filtering by genre is not comprehensive enough for the music director to identify where exact obscene words are found in a music trackintuitive on the reporting interface. (Major)
- Currently, users can filter the reporting interface by genre through adding and remove genre tags to the "Current Displaying:" field of the interface.
- Many found adding genre tags to be intuitive, but removal non-intuitive.
- If more than one genre is displayed, users will tend to click on one genre tag to filter by that genre only
- Music directors currently have to record manually, on each album cover, which tracks contain inappropriate words and what/when words appear.
- "FCC Clean" toggle on our application allows directors to mark tracks with obscene words, but does not give more details beyond that.
Potential solutions:
- Allow a Make the "FCC" comment field to be associated with each track, so that music directors can type in information regarding what and when obscene words appear in the track.
- Display a track progress bar (representing the duration of the track), that allows music directors to drag the cursor and place specific markers along this progress bar indicating when and what inappropriate words are in the song.
- X" beside each genre tag more conspicuous (perhaps changing its color to red?). This will prompt the user to notice the removal feature of the genre tag.
- Clicking on an already displaying genre tag will filter the reporting interface by that genre only.
Clicking on "Add Genres" button Clicking on "Add Genres" button after typing in custom tag does not actually add the custom tag to the album (only pressing "Enter" works). (Minor)
...
- Add functionality to the "Add Genres" button, so that if the custom tag field is populated upon clicking the tag field gets saved.
- Add a prompt for the user so that after typing in the custom tag, a small tooltip pops up to remind the user to press "Enter".
Specific track details missing from the "album details" view. (Minor)
...
- Adding commonly used track details (duration, size) beside the track name.
- Complete track details could be viewed by right clicking on the track and displaying a "Get Info" option to invoke a separate pop-up window with full track details.
What Users Liked
- The "Add Genres" function allows any number of tags to be added to the album, so a single album can be tagged with multiple genres.
- The "Add Genres" function allows custom tagging, so music directors can enter their own genre tag (if it does not already appear on the list).
Reflection
"FCC Clean" toggle is not comprehensive enough for the music director to identify where exact obscene words are found in a music track. (Minor)
- Music directors currently have to record manually, on each album cover, which tracks contain inappropriate words and what/when words appear.
- "FCC Clean" toggle on our application allows directors to mark tracks with obscene words, but does not give more details beyond that.
Potential solutions:
- Allow a "FCC" comment field to be associated with each track, so that music directors can type in information regarding what and when obscene words appear in the track.
- Display a track progress bar (representing the duration of the track), that allows music directors to drag the cursor and place specific markers along this progress bar indicating when and what inappropriate words are in the song.
"FCC Clean" toggle is not conspicuous. (Cosmetic)
- Users noted that the "FCC Clean" toggle functionality is not immediately obvious.
- Users tried to append "FCC Dirty" to each track name instead of using the "FCC Clean" toggle button.
Potential solutions:
- Use the familiar FCC icon with the "poison" sign, this maintains external consistency.
- Use a bigger icon that is simply labeled "FCC" instead of any graphic icons.
What Users Liked
- The "Add Genres" function allows any number of tags to be added to the album, so a single album can be tagged with multiple genres.
- The "Add Genres" function allows custom tagging, so music directors can enter their own genre tag (if it does not already appear on the list).
- Date picker for "Release Date" field is very useful - user noted "that's so nice!"
- Entire interface is very clean and intuitive. No messy cluttering of information, controls, or menu items.
Reflection
One thing we realized early on is that exploration contributes to a better final product. When brainstorming for project ideas we pitched more than a dozen in total, pursuing some to the extent of writing up short interviews we had with owners of various stores (bookstores, video game stores, music stores) such as this one which never saw the light of day. All of the brainstorming culminated in a final direction that we were all satisfied with, and later we would see the payoff of exploration again by using multiple paper prototypes instead of a single one.
Overall, we learned that prototyping early and going through multiple rounds of user testing is very helpful in increasing the learnability of the final prototype. Finding usability problems early in the paper prototyping stage allowed us more flexibility when designing the computer prototype. Due to the fact that we had conducted multiple rounds of user tests (totaling over 7 users) with the paper prototypes, we were quite successful with user testing for the computer prototype - no major implementation changes were required for the computer prototype. Users specifically noted that we had taken their earlier suggestions during computer prototype user testing.
In addition, having multiple paper prototypes enabled us to request feedback on each one, combine the benefits of each, and form an ultimately more user-friendly application interface. Some users noticed that we combined the best of all paper prototypes in designing the computer interface. On the other hand, paper prototypes failed to indicate the complexities of implementation issues - many features we drew up quickly during the paper prototyping stage in fact takes much longer to implement during the computer prototyping stage. For instance, the overlay feature of "Drag and Drop" was easily prototyped using transparencies and highlighters, but required major time commitment to code in Javascript/CSS. On the other hand, this fact also was informative in so far as it reminded us that a good design is not simply a matter of putting together existing UI components. Thought and care must be taken during the design process to allot time to develop complex, but ultimately easier to use interfaces.
If we were to do this project again, we would like to conduct earlier computer prototype user testing, especially with the uploading interface. During GR6 user testing we discovered that there were minor deficiencies in the current interface that only music directors could spot. This is partly because fellow classmates are not familiar with the needs of WMBR music directors (such as marking tracks as containing obscene words with the FCC flag). Furthermore, we could have done better task prioritization, focusing on key components of the system earlier (uploading files and editing details) as they are central to the KaJaM! application.
Finally, we discovered that user testing can be challenging because users often feel pressure to "do the right thing", rather than identify usability issues. There were instances where users became less communicative as they became frustrated with completing a scenario task. It was an important cue for us to be patient and re-assuring them that the problems lie in our design, and not their competence. We learned to accept criticism objectively and recognize that "the user is always right".
Back to the topDiscuss what you learned over the course of the iterative design process. If you did it again, what would you do differently? Focus in this part not on the specific design decisions of your project (which you already discussed in the Design section), but instead on the meta-level decisions about your design process: your risk assessments, your decisions about what features to prototype and which prototype techniques to use, and how you evaluated the results of your observations.