Table of Contents
Briefing
Thank you for volunteering to test our prototype for 6.813/6.831 User Interface Design. Our website is a tool designed for parents of school-aged children to coordinate carpooling for school and after-school activities. Our goal is to create an easy-to-use interface that makes it easy to set up carpools, helps users keep track of commitments, allows for scheduling flexibility, and ensures the safety of the children.
Scenario and Tasks
We have created three roles in which you will play the parts of the various parents participating in the carpool.
First Role
Your name is Jane, you have a son, Bob, who has signed up for Underwater Basket Weaving, and you want to carpool with other parents. You live at 1234 Fake St., Bakersfield, CA 93203. You also need to keep in mind that your family is going on vacation from 4/22 to 4/29.
- Task 1: Visit getyourride.com to find and join a carpool for your son’s activity. After joining a carpool, find the group under the pending groups.
You have a feeling your turn to drive is coming up, but you aren’t quite sure when.
- Task 2: Get the next date/map for your next drive and confirm your availability. Out of curiosity, you also take a look at your schedule for the month.
A few weeks later, you have an unexpected death in your family on 3/26, but it is your turn to drive. You will need to reschedule.
- Task 3: Swap one of your dates for a new one.
Second Role
Your name is Vladimir, one of the other parents in Jane’s basket-weaving carpool. Jane has proposed to swap dates with you, and you need to accept her proposal to complete the swap.
- Task 4: Agree to swap dates with Jane.
Third Role
Your name is Alyssa, another one of the other parents in Jane’s basket-weaving carpool. It is your turn to pick up the kids, but the other parents want to know that their kids are safe. Luckily, we have a mechanism for letting them keep track of where you are on the pickup route.
- Task 5: Use the mobile app to allow the other parents track your drive.
First Iteration
Prototype Photos
(Upload photos.)
Observations from User Tests
To protect anonymity, we will refer to our three testers for this round as User A, User B, and User C.
User A
Task 1
- The user enters “Underwater basket weaving, Bakersfield, CA,” hits tab, and presses submit. He mentions that he would have expected the cursor to be in the text field by default.
- He clicks on the first class.
- He clicks on the button for entering his address.
- He likes seeing that Alyssa and Vladimir are nearby. He comments that this motivates him to go further. He asks how far the class is from his home, and notes that the interface should display that information.
- He then clicks the on the button for adding himself to the carpool but feels confused because he wants to know more about the people in the carpool first. He wants to click on their names and see a profile. This is a safety issue; the interface is not providing the adequate information prior to setting up a carpool.
Task 2
- The user correctly selects the "Next Date" tab and clicks “confirm.” Afterwards, user is able to quickly identify the view next schedule option.
- The user remarks that he does not know how to make page options go away after completing the task.
Task 3
- The user clicks “Swap Dates” from the "Next Date" tab, which leads the user to the “My Carpools" tab already loaded with information about the Underwater Basket Weaving group. He selects the swap arrow on the date he wants to remove and selects another arrow to complete the task. The user ignored the cancel date column of selections.
Task 4
- The user selected the “My Carpools” tab immediately upon seeing a notification.
- Following the page load, the user selected the “Underwater Basket Weaving” group.
- The user remarks that he would ordinarily “tab out to view his calendar and tab back to confirm the swap date.”
- He remarks that clicking the final "OK" would make the "My Carpools" schedule re-update with the revised dates after reading the message.
Task 5
- The user remarks that “Track Ride” is a little confusing because he wants to track his ride, not track another parent’s. However, he was able to quickly run through all the steps.
User B
Task 1
- The user enters, “Underwater basket weaving, Bakersfield, CA”. He feels that the field is too generic and would have preferred to see a “Location” field in addition to a description field.
- He clicks on the first class.
- He strongly resists going further because he doesn't want to carpool with people he doesn’t know, for the safety of his children.
- The user clicks the button to enter his address.
- Upon seeing that Alyssa and Vladimir are close to him, the user wonders whether they are close to him in the direction of the class or another direction. He suggests putting a map on the page.
- The user tries to select Alyssa and Vladimir, but doesn’t understand why there are no checkboxes and fails to see the button to add himself to the carpool.
- Upon seeing that button, he clicks it, signs up, checks the boxes for Alyssa and Vladimir, and proceeds.
Task 2
- The user promptly selects the "Next Date" tab.
- Upon selecting the "Next Date" tab, the user re-reads his task description. The user seems a little confused after selecting confirm. The facilitator tells the user that there currently is no feedback at this time.
- He is able to print route directions and get his schedule for the month instinctively.
- Afterwards, the user remarks that he was initially tempted to select the “My Carpools” tab.
Task 3
- User recalls seeing something about swapping in “next date” and selects the “next date” tab.
- Once there, he selects “swap” to get to the my carpools tab.
- User selects the date he wants to swap and the new date to swap with. The user was confused with the language “you” or the option to swap with yourself.
- User remarks that the swapping is very tricky and needed facilitator guidance to complete the task.
Task 4
- The user selects “My Carpools” and remarks that the notification was catching his attention.
- The user selects “I accept” quickly after viewing the pop-up.
- On the following pop-up screen, he initially clicks “cancel” because he isn’t sure which dates were his, indicating he is not able to understand the date selection.
- The user is confused because in task 3 he only selected one date to swap, not two. He remarks that it is not clear in task 3 that the user is supposed to select as many dates as possible.
Task 5
- The user quickly selects “Underwater Basket Weaving” and then “Track Ride.”
- The user remarks that there is confusion with the vocabulary “Track Ride” since he would be doing that to track someone else’s ride, not his own ride.
User C
Task 1
Task 2
- The user feels confusion between selecting the "Next Date" tab or the "My Carpools" tab.
- He views the full schedule.
- He successfully confirmed his date.
Task 3
- The user navigates to the "My Carpools" tab.
- He forgets which date was next, so he navigates back to his next date tab to view the date.
- He selects a swap date button to initiate the swap.
- Initially, the user only selects a single date. After receiving an error message, he then immediately selects another date to swap with.
Task 4
- The user notices the notification and navigates to the “My Carpools” tab.
- He notices the notification and navigates to the "Underwater Basket Weaving" tab.
- He makes sure he does not have conflicts on either of those days.
- The user notes that the pop-up display during the swap is slightly confusing, and that there should be a more clear indication of which date he is swapping to and which date he is swapping from.
Task 5
- The user quickly completes the task, but like the other two users, notes confusion over the wording.
Usability Problems and Changes to Prototype
Learnability
- Because some users mistakenly looked around in "My Carpools" before noticing the "Next Date" tab, we decided to highlight the tab to make it more obvious.
- Some non-native English speaking testers were confused by the wording on the "My Carpools" tab. We had referred to the user as "You" when assigning pickup dates on the schedule, which could be misconstrued as a person's name in some languages. In this new prototype, we decided to simply refer to the user by their name instead.
- Originally, we didn't want to include instructions because, as discussed in class, a good user interface does not require much explanation. However, swapping dates is not a regular function, and all of our testers had trouble with that task. We decided to include more descriptive instructions for the swapping interface, sacrificing efficiency for the sake of learnability.
- Users had a lot of trouble figuring out how to swap dates. We decided to scrap our original design altogether and add a separate tab specifically devoted to date swaps so that the function could be more easily accessed (also ties in with efficiency).
- Because all three users complained about the wording for the ride tracking interface on the mobile app, we changed "Track Ride" and "Untrack Ride" to "Enable Ride Tracking" and "Disable Ride Tracking," respectively, to make the button labels more intuitive and improve learnability.
Efficiency
- Some users wished that the date were displayed somewhere on the interface. We chose to add a date display after "Welcome,_______."
- It was noted that the calendar would be more useful if it weren't limited to a single month. We added the option for the user to browse between months.
- Some users thought that it would be helpful for additional information to be displayed on the full schedule. We decided not to go forward with this suggestion because we wanted the interface to be as simple as possible, providing on the relevant information.
- Users wanted to be able to view their schedules before agreeing to a swap, so we included an option to allow them to view their full carpooling schedules on the same page, improving efficiency through anticipation.
Safety
- Although we attempted to address safety in tasks 2 (having the responsible parent to confirm, so that other parents would know their children hadn't been forgotten) and 5 (allowing other parents to track the responsible parent's drive), we failed to address safety considerations in task 1, the initial group formation. Users were concerned about the safety of their children and the privacy issues of entering their information to the site. We decided that by having a teacher or coach give out a code in order to sign up for carpooling on the site, we could significantly lower the chances of encountering people with questionable intentions.
- Some users were frustrated with the lack of undo options on both the calendar loading and date swapping interfaces. We added the option to toggle the calendar between expanded and contracted states. We changed the date swapping interface from a pop-up screen to its own tab, so that users would be able to navigate away and return at will.
Second Iteration
Prototype Photos
(Upload photos)
Observations from User Tests
To protect anonymity, we will refer to our three testers for this round as User D, User E, and User F.
User D
Task 1
Task 2
- The user selected the "My Carpools" tab instead of the "Next Date" tab because he was reading from left to right and saw "My Carpools" first.
- He then viewed his full schedule and realized that he needed to check his next date, so he navigated to the next date tab.
- He thought that something like the next date feature should also have been included in the "My Carpools" tab as well.
- He remarked that the "Next Date" tab seemed very intuitive to him.
Task 3
- The user found the swap date radio buttons confusing because he had not previously seen the carpooling schedule under "My Carpools." He found the wording confusing because he didn’t understand exactly who he was swapping with, suggesting that the interface should include the name of the driver under the swap dates.
Task 4
- The user thought that there was redundancy when agreeing to swap first and then choosing the specific date afterwards. He noted that although changing the interface may raise some safety issues, it may become slightly more intuitive.
Task 5
- The user found the interface very intuitive but had questions about how we would implement it. He was simply asking out of curiosity, rather than offering criticism.
User E
Task 1
Task 2
- The user did not notice that the task had mentioned confirming the date, so it took him a significant amount of time in order to locate the confirm button. However, the user thought the interface was very intuitive otherwise.
Task 3
- The user selected the "Swap Dates" tab to complete the task. He only had issues deciding between which of the dates to choose.
- He commented after the task that he would like to mark dates as unattendable when setting the schedule. For example, he said that because of the vacation constraint from when he initially set up the carpool, he would not have had to have that as a scheduled date (one of the dates to swap was 4/22, which was included in the original vacation constraint).
Task 4
- The user really enjoyed the notification tabs. He thought, especially from a parent’s perspective, that the notifications easily guided him to the important task at hand. It reminded him of Facebook, he commented.
Task 5
- The user found the interface intuitive, and did not have much to say about what could be improved here.
- He thought that there could be more information displayed at all times. Although we wanted to keep the interface simple in order to communicate the information well, we may choose to add more navigable activities.
User F
Task 1
Task 2
Task 3
Task 4
Task 5
- Blah Blah Blah