UX Systemwide Assessment
...
2011
This document articulates the UX objectives and implementation plans for the FY11 2011 systemwide assessment.
Updated 129/31/1011. (Also see UX FY11 Goals for UX, which are local goals, separate from the systemwide assessment.)
Steps to meet Assessment FY11 goals
1. Finalize objectives submitted for systemwide objectives
2. Agree on measures; set targets
3. Consider tools; look for partners in tools
4. Implement
...
2011 UX Objectives
The list below are the objectives that we have agreed to pursue. As of 11/23/10, these measures are not final.
ETHNOGRAPHY/ASSESSMENT
Systemwide Objective: Understand our Users
1. UX objective: Make recommendations about which services to discontinue (graveyard), based on what we’ve learned about user needs from current and past studies.Explore how new technologies and formats are having an impact on how MIT scholars find, use, and share information for their study, research, and publishing.
Measures:
- Report of user study that describes how new technologies and formats are having an impact on how MIT scholars find, use, and share information for their study, research, and publishing.
- Tool: Digital scholarship study
- List of areas to explore in future studies and/or library surveys
- Tool: Digital scholarship study
- Measure 1: Number of services recommended for discontinuation based on user data indicating lower value; number of services that are discontinued (shows support of our recommendations, support of data-driven support by leaders in the organization)
- Measure 2: Number of changes implemented or planned due to results of user studies
The next item is both for the above objective and this one:
SPACE
Systemwide Objective: Transform library spaces
2. UX objective: Gather baseline data about how our spaces are currently being used and how well they meet our users’ needs.
- Measure 1: Number of space programming changes made due to new data about how our spaces are currently being used
- Measure 2: Number of changes implemented or planned due to results of user studies
- Measure 3: Inventory of space equipment, square footage, etc.
.
Measures
- Analysis of users' activities in the Libraries.
- Analysis of use of specific equipment and spaces in the Libraries.
- Identification of 2 most desired times to extend open hours.
- Identify 2 priority areas to align services, spaces, or equipment to better support these.
- 1 Heat map for each library showing how spaces are currently used.
- Space inventory of equipment and furnishings that are in our spaces
- Tool: Space study
- Tool: Space study
- Tool: Space study
Possible Measures
- Service/Assistance
- total square footage allotted to this kind of space
- # of desk stats
- # door count?
- # hours spent staffing within service/assistance spaces
- # of staff per hour in service/assistance spaces
- Social/exhibits space
- total square footage allotted to this kind of space
- # of attendees to exhibits and events
- # exhibits per year
- demographics of people attending exhibits
- # of events held per year in our spaces
- # of exhibit locations
- total square footage of space allotted to social needs of users
- # of users who use library for social/networking
- Reading rooms
- total square footage allotted to this kind of space
- # seats
- # soft seating
- # of rest rooms near reading rooms
- percentage of reading room space allotted to stacks/browsing collections
- Collections
- total square footage allotted to this kind of space
- total # bays of print materials
- % of collection circulating at any one time
- # of sub-collections (browseries, new books displays, Sanborn maps, DVD collections, etc.)
- Instruction spaces
- total square footage allotted to this kind of space
- # of instruction spaces
- # seats allotted to instruction; # of seats in DIRC
- list of equipment allotted to instruction
- Equipment
- # of machines by type
- Reliability indicator (e.g., # of fix-lib tickets for machine X, Y, Z)
- # of public computers; ratio of public to MIT-only computers
- list of equipment by owner; id non-Libraries equipment
- # of electric outlets and locations
- Study rooms (individual and group)
- total square footage allotted to this kind of space
- total # of seats in all study rooms
- # of large screens available
- Storage
- total square footage allotted to this kind of space
- # of bays
- # of boxes
- % of collections in storage; total, books/journals/other
- # of storage locations
- cost of storage per square foot (or other?)
...
VIRTUAL
Systemwide Objective: Improve infrastructure for locating and accessing digital products
13. UX objective: Improve the Vera interface to help students find and use more and better resources to inform their library research.
- Measure 1: Percent of users reporting success through use of Vera?
- Measure 2: Percent of checklist (used for heuristic study last spring) that is now successful?
- Tool: Usability study of mockup of new Vera site?
- This section needs input from Darcy and/or UIG on what actual measures will show success or progress toward the objective.
Working with AMPS, create a new web portal to the video collections at MIT that highlights the excellence in teaching and the student learning experience at MIT.
Measures
- 5% increase in number of views on selected videos which were on TechTV last year (comparison of views from November 2010 to November 2011).
- Tool: Tech TV stats
- 200 unique visitors to siteper month
- Tool: Google Analytics
- Positive feedback from donor.
- Tool: any feedback from donor
- 5 twitter stories, news blog stories, etc.(amount of PR generated by new site)
- Tool: PR searches
42. AMES/LDLC/UX objective: Improve the DSpace@MIT user interface.
Measures
- 3 usability improvements implemented
- LDLC list of possible user interface improvements to DSpace@MIT
Other units’ objectives that may potentially impact UX
Other units may require use of our tools to measure their objectives, or their work may impact our work. Draft objectives that units submitted that may potentially impact UX are listed here; not all objectives that were submitted are listed here. (For comprehensive list of up-to-date objectives, see FY11 Objectives.)
green - may become part of the usability or user needs studies
pink - may require UIG resources (other than usability)
...
1. Understand our users
...
- AMES objective: Understand how are users are getting to e-content that is accessible by way of Barton and other discovery interfaces.
- ID&LA (plus others) objective: Evaluate user behaviors to inform hours planning.ID&LA (plus others) objective: Evaluate user behaviors to inform space programming.
...
2. Improve customer service
...
- CSM objective: Develop patron-driven monograph-acquisition pilot.
- ID&LA objective: Improve customer service offered at ID&LA service points (physical and virtual).ID&LA objective: Develop uniform branding for request services, with fewer starting points, better cross promotion of services, and improved request management.
- M&C objective: Standardize marketing materials at service desks to provide clear, consistent and relevant information to our users that corresponds with established Libraries’ design standards.
...
3. Increase awareness
...
- IRS objective: Develop connections between undergraduates and library resources and services through their classes (in person instruction, course pages, other types of tutorials, stellar).
- LDLC objective: Increase the community’s awareness of their librarian.
4
...
- OSPL Objective: Improve tools and methods that enable flexible reuse rights for authors.
...
5. Transform library space
...
- ID&LA/CSM objective: Realign the role and locations of tangible collections in our facilities.
...
. Improve infrastructure for locating and accessing digital products (advisor = Mat)
- AMES objective: Improve off-campus access to e-books.
Preplanning for 11/22/10 meeting of "UX assessment leadership team" LS/NH/LRH: UX Assessment Plan 2011