QuickPick GR3 Analysis

Brief

You just completed your freshman year at MIT, and declared 6-3 as your major and Psychology as your humanities concentration. It is now time to choose your classes for next semester. In order to ensure that you can take all the electives you want in addition to the courses required for your degree, you decide to map out an academic four-year plan. 

Scenario Tasks

First Iteration Paper Prototype

Usability Test Notes

User 1, Iteration 1

Task 1: 

• Wonders if 7.012 can be offered in the spring, we blank out the ineligible semesters. 
• Spends time looking through her classes, 
• User noted "This is Fun!" 
• "Can I add multiple electives at the same time?" -- currently? No. Consider changing. 
• "Are Prerequisites are strict?" Consider how this affects schedule. 
• Selects a few specific AUS/Labs, but doesn't assign some of them. Likes the flexibility. 
• "Is there an easy way to know that 813 is an AUS/LAB?" -- currently? No. Coming in future iteration. Need a way to indicate multiple requirement fulfillment.

Task 2:

• There is a conflict between two classes.  She would like to keep it; doesn't attend lectures.  That should be allowed; is realistic for how some people pick their classes.
• Uses radio button to put in class recitations.  Would like to see recitations even though they may conflict with a class.
• Wants an indication in the class lists that displays which ones are completed and those that have the recitation still need to be decided.
• Wants a save or done button from the current semester schedule; ensure that it saves as she transitions but yet would like can transition without saving.
• For the conflicts, she would like to see conflicts in the four-year plan view for the current semester.  From there she would like to quickly see the conflict and see if she wants to fix it or not.
• If there is a conflict that she must change, would go to search for a new class, move it to class list, then put in the recitation if necessary.
• Would like to see a modal screen of the four-year plan in order to rearrange that in case of conflict.  And those changes reloaded into the current view and list of classes.

Task 3:

• Knows how to see friends schedule by clicking her name; would like to see the schedule in the four-year plan too.
• Would like to see comments of the classes from friends and only those that are useful.  Would want to see comments up-vote and down-vote to arrange comments.
• Would care more about friend's four-year plan over the current semester.  To know who she can do homework with, does not care so much when they are taking their classes.  Acknowledges that other people may want that information. 

User 2, Iteration 1

Task 1: 

• No questions about briefing or task 1
• Not immediately obvious that classes are draggable, first instinct was to click.
• "This is fun!"
• Easy and straightforward to drag the classes that are explicitly represented in the boxes at top
• Wonders how he will know which classes are only offered in spring/only in fall-->answer: unavailable semesters will be grayed out.
• Because they were a different color, assumed that the blue "AUS" or "Department Lab" tags could not be dragged, only clicked. This happened to work out because clicking is an option, but there is also the option to drag.
• Interacted well with the pop-ups for choosing AUS/Labs/Course 9 electives, etc. 
• First placed all of the classes that were listed explicitly, then moved on to blue tags.
• Placed HASS classes last. 
• "I'm a little bored"
• Reacted positively when we told him that you can, for example, drag the generic "HASS D Category 1" onto the schedule and choose the specific class later.
• Questions: "Now that I've created this schedule, what can I do with it?" "How do I know if I have the prerequisites to take class x in semester y?" <--(we didn't explain it)

Task 2:

• Make sure that things that can be dragged look much different from things that can only be clicked

Task 3:

• Immediately knew to click the friend's name in order to have her schedule overlaid.

Comments:

• I don't imagine myself doing this in one sitting; need a way to save
• I wouldn't want to do the four-year plan and plan the current semester at the same time
• Would be cool if the software generated a schedule (with labs and recitations) for me, and then just allowed me to change if I didn't like certain of the choices made
• Maybe focus on the four-year plan and scrap the scheduling option, the four-year functionality is cooler
• Be careful with how you present restricting options by graying out, be clear about why this option is taken away
• Important to present information on each of the courses (pop-up), double click isn't necessarily the most intuitive

User 3, Iteration 1

Task 1:

• Is not Course 6, does not know pre-requisites or requirements.
• Looks at the list of requirements and starts to drag and drop the courses into his four-year plan.  (Picks based on the course number).  Also tries to balance classes between Course 6 and HASS classes.
• Goes in order by semester (Sophomore Fall, Sophomore Spring, Junior Fall, etc.).
• Puts class in Fall semester although it is not offered; blocking out was not done; an easily evident way has to be shown for actual site.
• "It would be cool to have the class ratings."
• Successfully filled out the four-year plan with generic classes.  Did not know how to put in specific classes.  Had to be explained how to pick specific Lab courses and AUS's.  Not intuitive because some are clickable and others are not.
• Would like to see a sum of the workload (units) per semester.

Task 2:

• Quickly understands to pick a class in the class list and clicks the radio button to pick a recitation.
• Would like to see all the options (Lectures, Labs, and Recitations) even those that may conflict.
• May want to have a next button that would save the current settings and move to the next class down the list.
• Wants to see the classes grayed out after they pick the recitation to show completion.

Task 3:

• Sees that no classes are shared; does not care too much.
• Does not really use friends to help pick classes; finds them distracting during class.

Comments:

• Wants course evaluations to decide courses, generally does not ask friends.
• Would like course evaluations to deciding on balancing of courses between hard courses and easy courses.
• Did not plan a four-year plan; went semester by semester.  Does not see reason to plan four-year plan.
• "It would be kind of nice if it could extract the information from evaluations to see the ratings of the professors and the workload."
• Would like to see the exam schedule throughout the semester.

Second Iteration Paper Prototype 

Changes: 

• Added a counter of the units each semester. 
• Adding data from the course evaluations as to how many hours per week of work each semester to see how heavy of a term has been selected
• Added the ability to schedule conflicts on the semester schedule 
• Added indications of conflicts at the four year plan view for the current term. 
• Added number of finals in term. 
• Added the ability to search classes and save them in the persistant search box. 

Usability Test Notes:

User 4, Iteration 2

Task 1:

• While adding a class to her Sophomore Fall (current semester), noticed that a conflict occurs.  She wants to click on it in order to see if she cares and if she should try to fix it.
• “Who teaches 6.034 in the Spring.  Is he good?”
• Would like to see who generally teaches a class in a semester; acknowledges that it may not be the same per year.

Task 2:

• “Oooo, looks like an ugly Google Calendar.”
• Saw that two classes conflicted.  Fixed it by switching one of the classes.  Asked to make sure it would be saved in the four year plan.
• Would like to see the different combinations that the recitations may fit into her schedule.  Instead of having to go through all of them to see the possibilities.
• Should pre-add working recitations (with no conflicts), then she can see if she would like to change it or not.

Task 3:

• Said the schedule may get too cluttered.  Would like a way to see friend schedules by itself, like temporarily remove own schedule to clearly see friends schedules.
• Has no idea (not intuitive) how the Friend list is populated.  No clear way to add someone.

Comments:

• Good system, but it seems like there are a lot of things going on.  (Us as computers point out every single change.)
• Acknowledged that paper prototype does not easily show the differencing between what is clickable, draggable, double-clickable.  

User 5, Iteration 2

Task 1:

• User concerned that the Prerequisite/Not Offered is unclear. (Hard to do on Paper Prototypes).
• Also asked about having professor information for classes (For Example, 6.034 with Winston is usually preferred to 6.034 without Winston)
• User asked about Double Majors, Minors. Current format doesn’t allow that, consider modularizing to include this? [SCOPE QUESTION: ARE WE FOCUSING ONLY ON 6-3? ARE WE ALLOWING OTHER MAJORS?]

Task 2:

• User wanted to know what recitations his friends were in (Informed him that’s Task 3)
• User wanted indications that he had selected all the class times needed for the classed (add some sort of check mark to indicate).
• (Also, add a conflict tag is there are conflicts at the schedule level, not just the 4 year plan level
• Does this register him for the classes (No. Likely will not do this in final implementation either)

Task 3:

• User does not care about Katy Perry (Informed him she is a placeholder)
• User wants “match my schedule to someone else’s” functionality (Will consider it, seems limited).  From there, he can make adjustments.

Comments:

• Likes system. Has lots of questions about functionality.
• Spend time discussing paper prototype, how it would look in the real system.
• Likes Dragging feature, would like to see more of that. (Should we add Dragging on the Semester/Calender view?)

User 6, Iteration 2

Task 1:

• User is confused about what is clickable, what is draggable (considered printing out little cursors, but it is late. Real webpage will afford this)
• User is concerned about lag times (Explained this is paper prototype, made fake loading icon. User is amused) .
• User tries to click classes, frustrated. (Give hint as to drag).
• Would like to add “unavailable/busy times like my work” and see conflicts with that.

Task 2:

• User remembered Drag paradigm from Task 1 and tries to apply in Task 2. This does not work (THIS IS A COMMON PROBLEM, inherent to paper prototype. MAKE SURE HIGHER FIDELITY PROTOYPE DOES NOT HAVE THIS PROBLEM.
• User asks if this works for classes later than 5pm (the latest time shown on our calendar), (user is informed this is a paper constraint. User not amused)
• User tries to browse for classes outside of the task we specified. (We do not have screens for this, WE NEED TO MAKE SOME). User wants to know more information about the classes he’s adding to the calendar. User would like to know class ratings, professors, etc. (We can add this)

Task 3:

• User does not make semester calendar with friends, User would not use social feature.
• User comments that this is similar to Spotify (the social bar. Yes, this was the original inspiration for it). User likes Spotify.
• User would like to export schedule to people not in the system (consider adding this)

Comments:

• Search option is not fully shown.  Does not entirely know what can be done after a class is searched and how to add it.  In both the four-year plan and the current semester schedule.
• No way to browse classes.  In order to search for electives, would have search for a specific number which would require needing to know a class. Would instead like to browse class, like using the subject listings page.