...
In this section we will highlight the different aspects of the interface, and comment on our reasoning for making the choices we did.
Login / Create an Account
Figure 1: Login
The first thing the user sees when opening BucketList is a plain bulletin board with a large piece of paper asking them to log in or create an account. We always planned on having the initial landing page be simple, and there were no problems with it during testing, so this part did not change very much based on user feedback.
Main Page - Bulletin Board
...
We made sure that each of the users who participated in final user testing use to-do lists on a regular basis and have a need to keep track of group projects, thus they all fit perfectly into our target user population. Since BucketList targets such a wide range of users, we also made sure our test subjects came from varying demographics with respect to age, location, gender, education, and technological expertise, so as not to limit ourselves to other MIT students who think too similarly to us. Many users in our evaluation were MIT student (by far the easiest to find), but we also included professionals and high-school students (found by speaking with friends and family) who we believe would benefit from BucketList.
Briefing
The following short briefing was given to each test subject before we began the evaluation:
"BucketList is a shared task-management application, allowing users to easily create group to-do lists.
Once you have an account, you can create "Buckets" - categories to put your tasks in. You can then add tasks to your existing buckets. This application is different than most task-management applications you've probably used in the past, because you can also share buckets with your friends. So, for example, you might create a "Final Group Assignment" bucket, which you will share with the rest of your group. You can then assign each person in the group individual tasks, like "do research" or "outline presentation", and monitor your progress, as a group, towards completing the project. You can also write and share notes about each task, to make sure you're all on the same page, and you can even send alerts to make sure your friends don't miss important notes.
We are going to describe a scenario for you, and ask you to use BucketList to help you accomplish your goals. This shouldn't take more than 10-15 minutes. Do you have any questions before we start?"
We decided not to do a demo as part of the briefing, as we really wanted to see if users would be able to figure out how to accomplish key tasks, so we didn't want to show them first. Our application is simple enough that users can figure it out themselves, without needing to see others use it first.
Tasks
Instead of giving users specific tasks to accomplish, we decided to give them a scenario with less guidance, and observer how they would use BucketList to help organize themselves. This allowed us to see which features are more important, and which features users don't attempt to use - something that would not be obvious if we specifically prompted them to use each feature. We structured the scenario in such a way that it would require the use of the entire system.
...
- Bucket Metaphor
- Sevierity - Minor
- Explanation - Most of the users didn't not know what a bucket was, it had to be explained to them.
- Possible Solution - We could revert to something more common like categories
- Long Names
- Severity - Cosmetic
- Explanation - Some users seem to use long titles in their tasks and did not like the fact that it showed a scroll widget after 2 lines. They wanted it to be symmetric with the short named tasks
- Possible Solution - We could truncate to single line and have ... at the end. This decreases visibility, but opening a task will show the full name again
- Draggables
- Severity - Major
- Explanation - Sometimes, some draggable items on the screen do not get released and follow the mouse indefinitely. This annoyed a lot of the users
- Possible Solution - More work on the JavaScript.
- Creation of Buckets
- Severity - Minor
- Explanation - Because the bucket metaphor failed, most users didn't create buckets for each classes in the task, they just added the tasks in one of the two pre-made buckets.
- Possible Solution - Demo video or quick interactive instructions after login.
- Task Collaborators
- Severity - Minor
- Explanation - Assigning tasks to collaborators was misunderstood by people. Most of the users failed to realize that a collaborator in a bucket isn't the same in a task. When asked to assign a person to a task, they would single click the task, then check a collaborator in the bucket view
- Possible Solution - Explain to them - again, demo video or quick interactive instructions
- Notes Vs Tasks
- Severity - Minor
- Explanation - Even thought users loved the ideas of having notes and tasks, they weren't sure when to uses a note or make a task, or if other people would see the notes
- Possible Solution - Explanation, demo video, or quick interactive instructions.
- Enter to complete
- Severity - Minor
- Explanation - A few users weren't sure how to commit their typed tasks, this is done by pressing enter. They were searching for a done or OK button. But after a while, it was learned. One user asked how to enter a task in.
- Possible Solution - Either put a done button, which could decrease efficiency but increase familiarity. OR explain to users. Adding both is an unnecessary redundancy.
- Note Edit
- Severity - Cosmetic
- Explanation - Most users expected that clicking in a note would edit it. They didn't actually notice the pencil edit icon on the bottom right corner.
- Possible Solution - After explaining the reason for that was because of the dragging feature, they were ok with it.
Quotes
"How do i access my other bucket again"
"What is a bucket?"
"How do i do that?" <- After being asked to complete task 1
"You gotta fix this drag issue"
"Oh wow, looks like a bulletin board, nice"
...