Session 1 (Original Interface)

• User 1
  • Task 1: Find a tour
    • Tapped on the general area of MIT, but there was no response
    • Tapped "View Tours", but there was no response
    • Tapped on a landmark (Killian Court), and the info popped up
    • Thought that he was searching for tours, but the text "Add Tours" makes it seems as if he was creating a tour
    • Said there was not enough visibility on the original screen of what's in the database (i.e. display something on the map)
    • Should grey out the "View Tour" button if it's not active
    • If there's 1 tour with the landmarks chosen, should it go straight to the tour details instead of the list view?
  • Task 2: Follow a tour
    • The "Begin Tour" button is not visible (wanted to click on the landmarks to start the tour). Consider moving to the top?
    • Keep scale in mind - will the list of landmarks be scrollable, etc.
    • Why can't I start the tour where I am? Or at another place of my choosing?
    • How can I reorder the landmarks on the tour?
    • Thought the arrows would change the view to show different maps/tours
    • There's a problem in the mental model of the arrows between left/right and up/down
    • Maybe we should highlight the nearest landmark
    • When do you click the arrow, there is no feedback in the list to show that it has advanced
    • Maybe if you embed unique icons into the map, users would see a relationship between the list and the map
  • Task 3: Create a tour
    • Don't see any way to exit the current view, except the standard Android back button. Users don't like to use that if they're deep in an app
    • Maybe add a "modify tour" button so users can just alter a pre-existing tour
    • Take advantage of the mobile app - maybe allow the user to make a tour as they're walking around to each landmark
    • Same "Add to Tour" text as when finding a tour, but a different effect - confusing
    • Added landmarks to the tours in the wrong order, at first unsure how to reorder
    • "If I want the tour to backtrack... how do I do that?"
    • Liked the list interface for reordering the tour
    • Consider combining the list and map views onto one page, although you may have to drag landmarks far (and that would be inconvenient if the screen was split)
    • "I don't know estimated time", maybe we should provide distance/time/stops
    • Also could provide distance/time/stops feedback on the screen as the user is building the tour
• User 2
  • Task 1: Find a tour
    • At first, wanted to select an area on the map (by dragging an area with multitouch) to define where the tour was going to take place
    • When that didn't work, tapped directly on map and added landmark to tour
    • Didn't understand what "adding" a landmark to the tour did until he saw the help text
    • Pressed "View Selected" to see what it did, realized that it was to edit what he had already selected
    • Once the 1 tour was returned, he knew the arrow meant to click it to select it
    • "All the things listed are in the tour"
    • Wanted to remove things from the tour - it included landmarks he hadn't selected
  • Task 2: Follow a tour
    • Found the "Follow Tour" button easily
    • Clicked arrows immediately... didn't like the result, but he knew how to undo it
    • Confused by what the arrows mean in general
    • "I walk up to the Media Lab... what happens?"
    • Wanted to see an arrow leading him to the start point of the tour
  • Task 3: Create a tour
    • Hit the "Back" button repeatedly until he saw the home screen
    • Clicked on the landmarks he wanted to add, seemed familiar with the interface
    • "I'm familiar with the campus so it's easy to locate" landmarks
    • Very averse to typing or using voice to search, would much rather click on places
    • "This isn't the shortest path", tried to drag the path to modify it
    • Saw the "Save Tour" button when he wanted it, and clicked it
    • It might make sense to put the map/list view on the same page
• User 3
  • Task 1: Find a tour
    • Clicked "Find a Tour"
    • Initially looked at the map a long time, looked unsure what to do
    • Later commented "I was hoping to see landmarks to choose from"
    • After selecting two landmarks, he hit "Find Tour"
      • We asked him what he expected to see, he said he expected to see a list of tours that include those two locations (help text probably assisted on that one)
  • Task 2: Follow a tour
    • Found and clicked "Begin Tour" immediately
    • Expected a path from current location to the beginning of the tour, or "wherever I'm supposed to go"
    • Touched the Killian Court list item because he wanted to go there, did not have the expected effect
    • "I walk to Killian... then I follow the path to Kresge"
    • Only interested in the landmarks he chose, did not want to have to stop at the others
    • "I would expect it to tell me where to go" (as in specific instructions)
    • Not sure what the arrows are, maybe there are more/other landmarks to look at
    • You could also show other interesting stuff on the way to a landmark, and show more info about the landmark when you get close to it
  • Task 3: Create a tour
    • "Keep hitting back until I see the home screen"
    • Didn't know where Burton-Conner was, but he knew to search for it
    • We asked what he would do if he wanted to change the order, he said he would try to drag the path, or look to the bottom for an "edit" button next to "save"
    • When he went to the list view, he realized he could drag the order around

Session 2 (Revised Interface)

• User 1
  • Task 1: Find a tour
    •  "I want to include things on MIT's campus"
    • Clicked on Killian, Stata, and Kresge to add them
    • "I want my tour to have 3 places"
    • Saw the text that said 1 tour was found, but he misinterpreted it. "I assume this now says 3... oh, I misread it"
    • Clicked view tours, and then on the MIT tour
  • Task 2: Follow a tour
    • Clicked follow tour immediately, then began to narrate what he would do
    • "I will go outside and orient myself." "I walk down Memorial Drive" "I follow the green line to Kresge"
    • Had a good understanding of what he should do, which was not present before the revisions
    • Wondered if he could reorder the path while following the tour
  • Task 3: Create a tour
    • Did NOT use the "create a tour" button on the home screen, but instead went back to the MIT tour and clicked "modify"
    • Removed all landmarks in the tour
    • Searched for the dorms because he wasn't sure exactly where they were, but he did not realize he could just click on them
    • Confused about the blank time boxes... perhaps they should be autopopulated with something

• User 2
  • Task 1: Find a tour
    • First, he asked to understand the phone interface: what do the Android buttons at the botton do?
    • Described what he's viewing and remarks that he understands what he's seeing
      • "there's a map that knows where I am by geolocating"
      • "lots of pins" "pins are landmarks"
    • He selected three landmarks
    • It made sense and he pressed "View Selected" to see the tours 
      • claims that this app helps understand the city better, gives an "inverted sense of city"
  • Task 2: Follow a tour
    • Found the "Follow Tour" button easily
    • He said that he was in an "interesting predicament" when he first started following tour, closer to another stop, but tour "wants me to go to Kresge first"
      • He asked himself, what should I do "follow the app or disobey?"
    • He decided to follow the tour, which is easy to do
    • Clearly understood steps of following a tour
    • Confused about how to go back to home screen?
      • There is no easy way other than pressing the back button multiple times
  • Task 3: Create a tour
    • Finally he hit the "Back" button repeatedly until he saw the home screen
    • Seemed familiar with the interface
    • Added Baker, dismissed Baker, and added Burton-Connor to the tour because he did it in the wrong order
    • After he added Burton-Connor, he remarked that he now sees that he could've rearranged them and that its clear
    • Saw the "Save Tour" button when he wanted it, and clicked it

• User 3
  • Task 1: Find a tour
    • Comments that it "geo-locates me"
    • Initially confused by all the landmarks. 
      • Clicks on the list options button expecting to see a list view
      • Asks for a list view where he can just check all the landmarks he wants
      • Gives example of NYC and says would just want to check off "Sears Tower, Empire State Building, etc"
    • After selecting two landmarks, he hits "Find Tour"
  • Task 2: Follow a tour
    • Found and clicked "Begin Tour" immediately
    • Wanted to start somewhere else then what told by tour
      • Said he wouldn't follow tour if it didn't make sense to him, but he would not take the time to modify tour either
      • He would just follow what he wanted and would want the app to follow along with him and keep track of where he's going
  • Task 3: Create a tour
    • "Keep hitting back until I see the home screen"
    • "how big is the description bubble on the phone?"
    • When adding landmarks, he wanted to add his own descriptions for the stops