...
The first user never seemed to realize the concept of deleting, whether it be a user or a keyword. When he messed up the OR input, he actually just decided to start from scratch and re-enter all the information. In fact, he eventually directly input the phrase from the card to get the intended output. His only variance was the addition of parenthesis. He completely skipped the task of deleting users, because he kept selecting them and couldn't figure out what to do with them. We eventually had him skip the task and continue. He was the only person who experienced any difficulty with this feature.
User B:
This user experienced issues figuring out to make an OR. He eventually figured out that entering the entire phrase worked properly and went with that. He experienced no issues with hiding users, unlike the previous user.
User C:
This last user has quite a few issues figuring out an OR, and eventually asked us (both computer and observer) for hints. The hints were limited to things like "how would you say it?" No other major issues after figuring that out.
Overall Takeaways:
None of our users even attempted to drag and drop the tags together to create an OR. Similarly, they all had extreme difficulties with adding OR inputs.... they just didn't know what the expected behavior was.
Another issue was the ability to hide or remove users. The "X" in the upper right of each user card was difficult to see, so we decided that we need to make it more visible and make it's effects more clear. The solution is to remove the "X" and add a "Hide Student" button next to the view profile information. We also are going to remove the bottom left "View Hidden Users" button in favor of moving it up to the upper right next to "Create New Search." This change will move it closer to the "Undo" message that gets shown.
Iteration 2
User A:
User B:
User C:
Overall Takeaways:
...