GR3: Paper Prototyping

Prototype Photos

Hosts: set up

First Prototype

Initial uploading view.

File browsing dialog.

Reviewer categories selection.

Reviewer grouping privacy settings view.

Second Prototype

Art uploading view.

Reviewer grouping privacy settings view.

Hosts: viewing feedback

First Prototype

Host feedback view.

Host comment review.

Commenters: giving feedback

Second Prototype

Commenter view.

Briefing

As detailed in GR1, two user classes (hosts and commenters) interacts with our interface.

Briefing for Hosts

"You are requesting feedback about a digitized visual art work that you have been working on. You use ArtBark to collect tangible, actionable feedback to improve your art piece. This comprises two stages that are separated in time: 1) uploading the work and requesting the customized feedback from specific individuals and 2) browsing through the feedback after it has been received."

Briefing for the Commenters

"Your feedback about a visual art work is being solicited. You want to help the requester improve the art piece you are about to see." 

Scenario Tasks

Tasks for Hosts

Host Task 1 (Set up):

Upload the digital visual work ("Countryside Landscape v3.0") you want to get feedback on. This an updated version of one of your existing art piece (Project "Countryside") you've previously requested feedback on.

Host Task 2  (Set up):

You want to direct the type of critique you get. This art piece is another iteration of your previous work, and at this point, you are only interested in feedback about Technique and of Emotional nature (in addition to general comments). You wish to get feedback from your peers Meelap and Katrina, and from one of your mentor, Rob. However, you don't want feedback from your peers to be visible to the mentor(s). 

Host Task 3 (Feedback Review):

You got a notification that feedback that feedback was entered for your latest version and go to ArtBark. First, find out what are the comments (not specific to an area in your art-piece), coming only from your peers: you are interested in both general (non-categorized) comments, and those about "Technique". Then, given what you read, you find out all comments (coming from all reviewers) that are specific to the tree in your art piece

Host Task 4 (Feedback Review):

One of your mentors, Haoqi (who you knew would be too busy to review your updated art piece this time around) had an interesting comment on a previous version, that you feel you have ignored, but you are not sure what it was. Find out all comments coming from your mentor(s), on the Feb 22 version of your art piece.

Task for Commenters

Commenter Task 1:

You get an email request for feedback from your peer and clicking on it opens up the corresponding art work. Now, enter a comment stating that you disagree with the other reviewer's comment (Meelap) on the right. Make it clear that your comment is of "Emotional" nature. Then, rate this art piece accordingly.

Commenter Task 2:

You want to enter a comment regarding the "Technique" used, specifically for the Foilage of the Tree. Make sure the artist can easily identify where on the art piece this comment is relevant. Oops! You actually meant to have the comment regarding the Foilage be about "Context" (there are no leaves in the winter season!). Edit the type of comment, as well as its wording.

Commenter Task 3:

This piece reminds you of another digital art work you can find the URL for online. Let the feedback requester know about it. 

Observations

Detailed Notes from User Testing

Usability problems for Hosts

Setup:

• Hosts have issues with the upload (Learnability, Efficiency)
• Hosts are unclear about the meaning of "private" and "public" groups (Learnability, Safety)
• Hosts need to define list of people for a group (Learnability, Efficiency, Safety)

Feedback review:

• Hosts expects the timeline to be draggable to view different versions (Learnability)
• Hosts may want to filter comments and annotation from more than one (but less than all) groups, rather than toggle with tabs (Efficiency) 

Usability problems for Commenters

• Commenters wanted to edit/change their comments and annotations, as well as the category of feedback for these (Safety)
• Commenters are confused about the difference between annotations and general comments, and with the ways to create annotations - by clicking and by dragging (Learnability)
• Commenters can be unsure which category to select for their comments/annotations, forced choices (Efficiency)
• Commenters want to move their annotation if they did not pin it in the right place (Safety)
• Commenters would like a way not to have the annotations clutter the picture if they don't hover over it (Efficiency, Safety)

Prototype iteration description

Hosts: Setup

• Simplified the navigation buttons so it was easier to see how to make progress in the interface.
• Users thought that the upload button would upload an image dragged onto the page, but it opened the browse dialog. That button was removed, and replaced with a more clearly labeled button inside the dashed boundaries of the drag region.
• Removed the "Unused" option in the feedback grouping page, so it was clearer that users need to select between public and private groupings.

Hosts: viewing feedback

• Removed the slider bar for the timeline and simply used thumbnails with dates to indicate other versions
• Renamed the "comments" section on the right to "overall comments"
• Annotated comments also appeared in the "overall comments" section, in addition to on top of the image

Commenters: giving feedback

• Removed all timeline functionality -- commenters can only see the most recent version
• Removed sidebar for selecting annotation type and replaced with on-the-fly selection at each new annotation
• Merged comments and annotations into the same stream with annotations as a subset of comments (comments with a picture tag)
• Removed "post" button and allowed users to edit and delete comments that have already been sent to the artist