UX Systemwide Assessment
...
2011
This document articulates the UX objectives and implementation plans for the FY11 2011 systemwide assessment.
Updated 129/31/1011. (Also see UX FY11 Goals for UX, which are local goals, separate from the systemwide assessment.)
Steps to meet Assessment FY11 goals
1. Finalize objectives submitted for systemwide objectives
2. Agree on measures; set targets
3. Consider tools; look for partners in tools
4. Implement
...
2011 UX Objectives
The list below are the objectives that we have agreed to pursue. As of 11/23/10, these measures are not final.
ETHNOGRAPHY/ASSESSMENT
Systemwide Objective: Understand our Users
1. UX objective: Learn about the relative value of our services from our users' perspectives, identified by community of practice. (See attached Services by Type for specific services.)
- Measures possibilities:
- Space & Equipment
- $ value assigned by users
- # seats and hours used
- # of group study rooms and seats
- list of other preferred study spots on campus, compare value?
- Online/intermediated service
- $ value assigned by users
- Increased # of Ask Us queries over time?
- # uses of all online/intermediated services
- In person services
- $ value assigned by users
- # uses of all in person services
- Increased # of research consultations over time
- % of each librarian's time spent face to face with users
- Delivery services
- $ value assigned by users
- # of users of service/ % of active users
- # of pdfs requested from LSA
- # books requested through BLC
- # books requested by faculty
- growth over time (of # of people or things borrowed)
- # of bookpage pick-ups vs. abandoned
- comparison of office delivery vs. library?
- Collections
- $ value assigned by users
- # circs plus in-house use (print materials)
- growth in database usage; list of most used databases
- # of e-journal accesses (SFX stats)
- Web/self-service
- $ value assigned by users
- # of visits to libguides and other tutorials
- # of views of video tutorials; growth
- Specialized collections and services
- $ value assigned by users
- # of GIS consultations; growth over time
- # of data services consultations; growth over time
- Circulation services
- $ value assigned by users
- % of user satisfaction with circ and reserves
- Space & Equipment
Explore how new technologies and formats are having an impact on how MIT scholars find, use, and share information for their study, research, and publishing.
Measures:
- Report of user study that describes how new technologies and formats are having an impact on how MIT scholars find, use, and share information for their study, research, and publishing.
- Tool: Digital scholarship study
- List of areas to explore in future studies and/or library surveys
- Tool: Digital scholarship study
The next item is both for the above objective and this one:
SPACE
Systemwide Objective: Transform library spaces
2. UX objective: Gather baseline data about how our spaces are currently being used and how well they meet our users’ needs.
Measures
- Analysis of users' activities in the Libraries.
- Analysis of use of specific equipment and spaces in the Libraries.
- Identification of 2 most desired times to extend open hours.
- Identify 2 priority areas to align services, spaces, or equipment to better support these.
- 1 Heat map for each library showing how spaces are currently used.
- Space inventory of equipment and furnishings that are in our spaces
- Tool: Space study
- Tool: Space study
- Tool: Space study
Possible Measures
- Service/Assistance
- total square footage allotted to this kind of space
- # of desk stats
- # door count?
- # hours spent staffing within service/assistance spaces
- # of staff per hour in service/assistance spaces
- Social/exhibits space
- total square footage allotted to this kind of space
- # of attendees to exhibits and events
- # exhibits per year
- demographics of people attending exhibits
- # of events held per year in our spaces
- # of exhibit locations
- total square footage of space allotted to social needs of users
- # of users who use library for social/networking
- Reading rooms
- total square footage allotted to this kind of space
- # seats
- # soft seating
- # of rest rooms near reading rooms
- percentage of reading room space allotted to stacks/browsing collections
- Collections
- total square footage allotted to this kind of space
- total # bays of print materials
- % of collection circulating at any one time
- # of sub-collections (browseries, new books displays, Sanborn maps, DVD collections, etc.)
- Instruction spaces
- total square footage allotted to this kind of space
- # of instruction spaces
- # seats allotted to instruction; # of seats in DIRC
- list of equipment allotted to instruction
- Equipment
- # of machines by type
- Reliability indicator (e.g., # of fix-lib tickets for machine X, Y, Z)
- # of public computers; ratio of public to MIT-only computers
- list of equipment by owner; id non-Libraries equipment
- # of electric outlets and locations
- Study rooms (individual and group)
- total square footage allotted to this kind of space
- total # of seats in all study rooms
- # of large screens available
- Storage
- total square footage allotted to this kind of space
- # of bays
- # of boxes
- % of collections in storage; total, books/journals/other
- # of storage locations
- cost of storage per square foot (or other?)
VIRTUAL
Systemwide Objective: Improve infrastructure for locating and accessing digital products
3. UX objective: Working with AMPS, create a new web portal to the video collections at MIT that highlights the excellence in teaching and the student learning experience at MIT.
Measures
- 5% increase in number of views on selected videos which were on TechTV last year (comparison of views from November 2010 to November 2011).
- Tool: Tech TV stats
- 200 unique visitors to siteper month
- Tool: Google Analytics
- Positive feedback from donor.
- Tool: any feedback from donor
- 5 twitter stories, news blog stories, etc.(amount of PR generated by new site)
- Tool: PR searches
Improve the Vera interface to help students find and use more and better resources to inform their library research.4. AMES/LDLC/UX objective: Improve the DSpace@MIT user interface.
Measures
- 3 usability improvements implemented
- LDLC list of possible user interface improvements to DSpace@MIT
Other units’ objectives that may potentially impact UX
Other units may require use of our tools to measure their objectives, or their work may impact our work. Draft objectives that units submitted that may potentially impact UX are listed here; not all objectives that were submitted are listed here. (For comprehensive list of up-to-date objectives, see FY11 Objectives.)
green - may become part of the usability or user needs studies
pink - may require UIG resources (other than usability)
...
1. Understand our users
...
- AMES objective: Understand how are users are getting to e-content that is accessible by way of Barton and other discovery interfaces.
- ID&LA (plus others) objective: Evaluate user behaviors to inform hours planning.ID&LA (plus others) objective: Evaluate user behaviors to inform space programming.
...
2. Improve customer service
...
- CSM objective: Develop patron-driven monograph-acquisition pilot.
- ID&LA objective: Improve customer service offered at ID&LA service points (physical and virtual).ID&LA objective: Develop uniform branding for request services, with fewer starting points, better cross promotion of services, and improved request management.
- M&C objective: Standardize marketing materials at service desks to provide clear, consistent and relevant information to our users that corresponds with established Libraries’ design standards.
...
3. Increase awareness
...
- IRS objective: Develop connections between undergraduates and library resources and services through their classes (in person instruction, course pages, other types of tutorials, stellar).
- LDLC objective: Increase the community’s awareness of their librarian.
4
...
- OSPL Objective: Improve tools and methods that enable flexible reuse rights for authors.
...
5. Transform library space
...
- ID&LA/CSM objective: Realign the role and locations of tangible collections in our facilities.
...
. Improve infrastructure for locating and accessing digital products (advisor = Mat)
- AMES objective: Improve off-campus access to e-books.
Preplanning for 11/22/10 meeting of "UX assessment leadership team" LS/NH/LRH: UX Assessment Plan 2011