You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 18
Next »
Prototype Photos
|
v1.0 of user-friendly implementation
The user has drag/dropped two files from the desktop onto the interface and the files have begun uploading to the system. |
|
v1.0 of user-friendly implementation
The user has clicked on one of the uploading albums and sees the detailed album view with cover-art. Each field on this page is editable (the field highlights on a mouse hover and turns into a text-box on click). |
|
v1.0 of high-efficiency implementation
The main screen that shows up on loading. The "+" button at the bottom manually brings up the list of uploading albums and previously uploaded. |
|
v1.0 of high-efficiency implementation
An album (starmarker.zip) has completed uploading and is ready to be approved (and filed) into the playback system. |
|
v1.0 of reporting interface (both aforementioned v1.0 implementations use the same reporting interface)
Currently with no filtering selected, all albums are being shown. |
|
One of the user testing sessions at the WMBR studio. |
|
Some of the interface widgets and task cards used. |
|
v2.0 of our merged implementation
Notice the pause button by each upload progress bar, the clear approve/delete buttons for the album (and the removal of the trash bin icon previously in the top right corner), and the re-wording on the upper left tabs for clarity. Changes not seen include a screen hover on dragging files over the interface (an entire gray-out screen blankets the screen and says "upload"), a highlight on hovering over any editable fields (including the tracks, which then allow editing of artists on individual tracks), and other minor changes. Other forthcoming changes include being able to delete single tracks (also using a hover over track affordance) and a clear visual cue that uploading albums can be clicked on to see specific album information. |
|
A view of the testing session on Monday March 18th. |
|
v2.0 of reporting interface
Notice the Piazza-like tagging for genre filtering (allowing flexible genre additions as well as multi-selection filtering), release date range filter, and additional playback count columns (for easy sorting between commonly used date ranges). Note that there were several transparencies made for both versions of the reporting interface to reflect changes in filtering and when clicking on one of the playback count headers (which sorts by play count in descending order). |
Briefing
KaJaMi Participant Briefing
Thank you for taking the time to help us test the prototype of our system.
You will be acting as the “user”, our goal is not to test you, but to test our system and find flaws or inconsistencies that will improve the final implementation.
One person from our group will act as a “computer” who will control the experiment and provide tasks that we would like you to perform using the interface.
The other group members will act as “observers”, and will be taking notes on the experiment.
We will be asking you to perform tasks that relate to your current music director duties, but using our interface instead of what you are normally used to. At a high level these tasks will include importing digital music, previewing music and getting CMJ reporting data. We ask that you do not ask interface related questions during the test itself (as this will better help us find faults in our interface) but we can answer anything after the test is complete.
Thanks and have fun!
Scenario Tasks
Scenario |
Task |
Imagine you are a music director, Lana, and you wish to upload some albums to the digital library via the KaJaM! interface |
Open KaJaM! and log into the system |
You have downloaded 2 albums onto your computer: Starmarker.zip and KaJaM.zip and wish to import them to the library |
Import Starmarker.zip and KaJaM.zip into the digital library |
While KaJaM.zip is importing, you wish to preview one of the tracks |
Preview (play) a track in the KaJaM album |
The track from the KaJaM album sounds familiar, and you quickly realize you have already imported the album and don't need it again |
Delete the currently importing KaJaM album |
The Starmarker.zip file finishes importing, and you wish to make sure all the track details are correct |
Inspect track details* |
You find incorrect and incomplete track details you want to fix |
Edit track details to reflect the correct information** |
You wish to approve the album to officially file it in the digital library |
Approve the album |
Before you leave, you wish to complete College Media Journal reporting for the month |
Take a look at the reporting data in the digital library |
You notice the reporting data is displaying _the Blue Dot _genre, but you want to look at "Electronica/RPM" |
Filter the reporting data to show only "Electronica/RPM" |
Now all reporting data is on "Electronica/RPM" only, but it is not sorted by play count in the last month |
Sort the reporting data by play count in the last month, in descending order |
Everything looks good, but you still want to make adjustments to the reports based on physical CD play count before submitting them |
Export the reporting data to Excel file format for further editing |
Now that you are all done, you wish to go home |
Done! |
*The album contains tracks with pre-tagged information, but some are incorrect or incomplete:
Track # |
Track Name |
Artist |
Album |
Label |
Release Date |
Genre |
1 |
While I'm Dead |
Starmarker |
Unknown |
Polyvinyl |
|
|
2 |
Sand Beauty |
Starmarker |
Unknown |
Polyvinyl |
|
|
3 |
Silvre Lining |
Starmarker |
Unknown |
Polyvinyl |
|
|
**The facilitator assumes Lana Googles the album information, so facilitator provides all the correct information to the user on a separate sheet of paper:
Track # |
Track Name |
Artist |
Album |
Label |
Release Date |
Genre |
1 |
While I'm Dead |
Starmarker |
Killer Kilometer |
Polyvinyl |
20/02/2013 |
Electronica/RPM |
2 |
Sand Beauty |
Starmarker |
Killer Kilometer |
Polyvinyl |
20/02/2013 |
Electronica/RPM |
3 |
Silver Lining |
Starmarker |
Killer Kilometer |
Polyvinyl |
20/02/2013 |
Electronica/RPM |
Observations (Importing Tasks)
Prototype Iteration 1 |
User |
Import Files into the Library |
Preview Song Tracks |
Delete Importing Album |
Inspect and Edit Album/Track Details |
Approve Album |
Music Director #1 |
- User found the drag and drop interface to be intuitive and easily learnable, but isn't familiar with the fact that file start importing as soon as the mouse button is released. Instead, user searched for an "OK" button to start importing officially. This is a tradeoff we made to achieve more efficiency, but sacrifices some safety because the user may inadvertently drop the wrong file on the interface.
|
Learnability
- User recognized the play button beside the track right away
Efficiency
- User's single click on the play button starts playing the track right away
Safety
- If user clicked on play accidentally, a pause button appears in place of the play button to stop track
|
Learnability
- On the user-friendly interface, the user had some trouble locating the trash can because it was placed far away from the user's line of vision
- On the high-efficiency interface, User quickly found the "X" delete button beside the uploading album
Efficiency:
- High-efficiency interface requires very little mouse movement to reach the "X" button, whereas the user has to move the cursor all the way across the screen in the user-friendly version of the interface.
Safety:
- User prefers that the user-friendly interface gave a confirmation warning before deleting album
|
Learnability
- User found the both interfaces to be easy to understand in terms of what information is being displayed
- Both interfaces lack affordances in terms of what is editable and what isn't, user had to experiment by single clicking on the fields
Efficiency
- User liked how both interfaces showed all the album and track information on one screen
- User noted the directly editable fields are very convenient
Safety
- User noted a mistake in adding the genre can be easily fixed by clicking the "x" beside the genre tag
|
- User was confused about how to "approve" the album on both interfaces because he did not associate approval with the "checkmark" button (learnability issue)
- Again, a tradeoff was made between efficiency and safety: single click on the "checkmark" button will approve the album immediately (efficiency). User prefers a confirmation message (safety).
|
Music Director #2 |
Learnability
- User tried to unzip all files first then drag and drop the content directly onto the KaJaM interface
- Our interface did not make it explicit that users are to drop zip files directly
Efficiency
- User noted that he will want to drop multiple files at a time
Safety
- User also noted that there doesn't seem to be a way to cancel a file dropped accidentally
|
Learnability
- User was confused that the right side of the screen was completely blank, and instead clicked on "recently uploaded" tab to look for the tracks within currently uploading album
- The tabs are not labelled clearly to communicate what it is really for
Efficiency
- Quickly found the play button to preview each track
|
Learnability
- Found the trash icon quickly due to its red color
- Trying to kill the progress bar (to stop it from uploading)
- User wants a feature that allows for stopping the import but not delete it (pause it for now)
- Want to drag and drop the tracks onto the trash can to delete instead of clicking
Efficiency
- Had trouble deleting all 3 separate tracks quickly, just deleting one at a time
- Repetitively delete everything is a concern: no expedient way to delete everything
Safety
- Don't need confirmation message, especially if it acts like a recycle bin like on Windows*
|
Learnability:
- Quickly decided to double click on the song track name, then figured out the single click is better
- User suggested offering more affordances for single click because he is a "double-click" guy (learnability and efficiency)
- He got that "Unknown" is the album name rather quickly
- Don’t know what unknown date is (import date or release date?). Also English styled date is not good
Efficiency
- What if there are different artists in each album (compilations are very frequent), want the ability to change the artist name for each track versus for the album (efficiency versus customizability)
- Various artists for the entire album, but separate artist name for each song
- User wants to potentially change the genre for each track
- User does not value visual album art as much and prefer to have everything displayed as he considers himself to be a database guy
Safety
- No issues with safety
|
Learnability:
Efficiency:
Safety: |
Music Director #3 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
"Elf" |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Prototype Iteration 2 |
User |
Import Files into the Library |
Preview Song Tracks |
Delete Importing Album |
Inspect and Edit Album/Track Details |
Approve Album |
Student User #1 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Student User #2 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Student User #3 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Observations (Reporting Tasks)
Prototype Iteration 1 |
User |
Switch to Reporting Mode |
Filter View by Genre |
Sort View by Play Count |
Export Reporting Data to Excel File |
Music Director #1 |
- User found switching modes via the tabbed interface to be easy and intuitive (learnability)
- Single click on another tab switched the mode immediately (efficiency), and user noted he can easily switch back if he accidentally clicked on another tab (safety)
|
Learnability
- User struggled with understanding the "filter" button and what it means - he thought it brings up another "filter" window
Efficiency
- User did not like how selecting a genre from the drop down menu did not filter the genres right away
- Not efficient to require 2 user clicks every time a genre needs to be filtered
Safety
- Requires user to confirm genre choice by explicitly clicking on "Filter", but user did not like this
|
Learnability
- User did not know how to sort the rows (no affordances offered to suggest that clicking on the header row sorts it)
- User noted that having an arrow displayed beside the header would really help to indicate the sort function
Efficiency:
- Single click on the head column sorts the table in descending order, second click sorts the table in ascending order. User thought this was convenient
Safety:
- User did not know how to "clear" the sort, but eventually just noted that he could just click on another head row to sort by another row instead
|
- User found the export button very quickly and no troubles with this task (learnability)
- User liked that the file started downloading right away without prompting him to confirm (efficiency versus safety)
|
Music Director #2 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Music Director #3 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
"Elf" |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Prototype Iteration 2 |
User |
Switch to Reporting Mode |
Filter View by Genre |
Sort View by Play Count |
Export Reporting Data to Excel File |
Student User #1 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Student User #2 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Student User #3 |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Learnability:
Efficiency:
Safety: |
Prototype Iterations
Design |
First Iteration |
Second Iteration |
|
|
|
|
|
|
|
|
|