Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

President's Report - FY10

...

Q4

  • Metrics Accomplishments
      • Metrics Issues and Trends

          FY10 Q3

          FY10 Q2

          ...

          Oliver Thomas's email reply to Robert Smyser's email listed below to Mary Ziegler, cc: P. Sheppard and E. Aufiero (dated 1/2122//2010)

          Thanks Rob! Taking the summary sentence about Quickstations out is fine.

          Cheers,

          Oliver


          Oliver Thomas
          Information Services and Technology
          Massachusetts Institute of Technology

          +1 617 253 9682
          +1 617 835 9682 /m
          othomas@mit.edu

          On Jan 21, 2010, at 10:16 AM, Robert W Smyser wrote:

          Robert Smyser’s email (dated 1/21/2010) to Oliver Thomas:
          Athena updates to RE: CSS Q2 Report Draft
          Hi folks,
          I’ve updated the tables and prose in the attached metrics section of the report.
          • The 1/4/2010 update from Jon Reed didn’t include any workstation numbers, as Oliver observed, so I’m glad Oliver caught that one. With Oliver’s change, Personal/DLC workstations drop to 76% of the total workstation installations, still a big ratio.
          • The Quickstation change would say that logins there are in proportion to their % deployment, but by the same token, there are seven times as many student computing lab machines that account for only twice as many logins. Is this explained by the different session lengths expected of the high-turnover quickstations vs sit-and-stay lab machines? We probably need deeper analysis about session length to see if there’s anything interesting to say. Given that, perhaps we should take the Quickstation sentence out (but leave the dialup sentence in).
          • Student Computing Labs substituted for Cluster in the tables and text.

          The tables needed me to repast them as bitmaps from the Excel original, and they probably won’t change again in this report. Additional changes to the text can be done by Pat / Elaine up to the moment the report goes in.
          Rob

          From: Oliver Thomas
          Sent: Wednesday, January 20, 2010 5:59 PM
          To: Robert W Smyser
          Cc: Oliver Thomas; css-managers@mit.edu Managers; Elaine Elizabeth Aufiero; Patricia Sheppard
          Subject: Re: CSS Q2 Report Draft

          Hi Rob,

          A few quick corrections to the Athena and printing metrics:

          • In the summary, the total number of Athena workstations is 1472 (not 2434). In the table, the number of Personal/DLC-owned Workstations is 1113. Jon had sent a correction back in early January that didn't make it into the final version.
          • Can we take out the "A relatively large" in "A relatively large 14% of total Athena logins..."? They're actually 12% of all of our publicly deployed machines (cluster + quickstations) so 14% of logins on them is pretty normal, especially since they encourage higher throughput (of users).
          • Can we replace "Cluster Workstations" in the table with "Student Computing Labs"? It seems like we're moving to that more generic terminology in the president's report, so might as well keep it consistent. The fact that they're Athena workstations is covered by the column heading.

          It looks like the utilization data didn't make it in the QR, which is okay, but Jon asked me to follow up to see if it was a formatting issue (no graphs allowed) or if there was some other reason.

          Thanks!

          Oliver


          Oliver Thomas
          Information Services and Technology
          Massachusetts Institute of Technology

          +1 617 253 9682
          +1 617 835 9682 /m
          othomas@mit.edu

          On Jan 12, 2010, at 2:25 PM, Patricia Sheppard wrote:

          Hi all,

          As discussed in our meeting earlier today, we have some time to review and revise our Q2 report before submitting to Marilyn’s office. Attached is the first draft from which to work from. The narrative has been heavily edited to accommodate space restrictions, and the teams have been pulled out and accomplishments listed by service. Also, new metrics are being piloted, and we will need to do some editing in either the analysis or particular metrics we report as well to reduce it to two pages.

          Ideally, we would like to have your feedback by this Friday (Monday at the latest). Please note what you think is missing in your feedback to Elaine, Rob and I - we want to make sure we are representing all the great work that is happening across CSS and IS&T. Thanks so much!

          Patricia Sheppard
          Business Manager
          Client Support Services
          Infrastructure Software Development and Architecture
          MIT Information Services & Technology
          617-253-3179http://ist.mit.edu
          <CSS FY2010 Q2 Draft.docx>

          10)
          RE: accessible version of CSS FY2010 Q2 Report draft 5 with embedded excel tables and interspersed comments.doc

          Mary,
          I embedded all the tables the same way. But some were modified after the embedding by opening them, removing or inserting some rows, and closing them again. I’d find it very informative to sit with you and see the screen reader in action. Not today though… 
          Rob

          -------
          Rob Smyser, Sr Business Analyst
          MIT Information Services & Technology
          77 Massachusetts Ave #n42-240t, Cambridge MA 02139
          617.253.1358 w

          _________________________________________________________________________________________________
          Mary Ziegler's email to Robert Smyser, cc:  Patricia Sheppard and Elaine Aufiero (dated 1/22/10)

          SUBJECT: Accessible Version of CSS FY2010 Q2 Report draft 5 with Embedded Excel Tables and Interspersed Comments.doc

          Hi Rob,

          Thanks for pulling together an accessible version of this document on such short notice. I think this version is good to go for this Quarter.

          However, sometime before the next iteration I’d like to see if we can tweak the tables in this document to make them slightly more accessible: while all are readable with a screen reader, some of the tables are easier to read than others in the sense that they are announced to the screen reader as being there (while other tables could be easily skipped over if not announced). It could be that the table properties are different, but I can’t see any difference. So, I’m going to pass this on to other members of my team to see what I may be missing. Before I do that, one question: did you follow the same procedure going from Excel to this document for all embedded tables?

          Appreciatively,
          Mary

          From: Robert W Smyser
          Sent: Thursday, January 21, 2010 3:06 PM
          To: Patricia Sheppard; Elaine Elizabeth Aufiero
          Cc: Mary J Ziegler; Robert W Smyser
          Subject: accessible version of CSS FY2010 Q2 Report draft 5 with embedded excel tables and interspersed comments.doc

          ______________________________________________________________________________________________

          Robert Smyser’s email to Patricia Sheppard and Elaine Aufiero, cc: Mary Ziegler (dated 1/21/10)

          SUBJECT: Accessible Version of CSS FY2010 Q2 Report Draft 5 with Embedded Excel Tables and Interspersed Comments.doc
          Pat,
          After Mary Ziegler told us embedded excel tables are the most desirable way to handle accessibility, I rejiggered the metrics section, attached. The document is in two sections – the first three pages are like previous reports, with all the metrics and all the text. Now, pages 4 to 5 are a two-page version of the report. It leaves out a few inconsequential metrics from Call Center and Repair Center, and drops ITSS (because Tim volunteered). Somehow, magically, it fits on 2 pages.
          Hoping this helps.
          Rob

          P.S., Mary, let us know if the new version fails accessibility in some way… I was even able to enlarge the text a little. Screen magnification works wonders though, another reason to go paperless whenever possible.

          _______________________________________________________________________________________________
          Oliver Thomas's email reply to Robert Smyser's email listed below (dated 1/21//2010)

          Thanks Rob! Taking the summary sentence about Quickstations out is fine.

          Cheers,

          Oliver


          Oliver Thomas
          Information Services and Technology
          Massachusetts Institute of Technology

          +1 617 253 9682
          +1 617 835 9682 /m
          othomas@mit.edu

          On Jan 21, 2010, at 10:16 AM, Robert W Smyser wrote:

          Robert Smyser’s email (dated 1/21/2010) to Oliver Thomas:
          Athena updates to RE: CSS Q2 Report Draft
          Hi folks,
          I’ve updated the tables and prose in the attached metrics section of the report.
          • The 1/4/2010 update from Jon Reed didn’t include any workstation numbers, as Oliver observed, so I’m glad Oliver caught that one. With Oliver’s change, Personal/DLC workstations drop to 76% of the total workstation installations, still a big ratio.
          • The Quickstation change would say that logins there are in proportion to their % deployment, but by the same token, there are seven times as many student computing lab machines that account for only twice as many logins. Is this explained by the different session lengths expected of the high-turnover quickstations vs sit-and-stay lab machines? We probably need deeper analysis about session length to see if there’s anything interesting to say. Given that, perhaps we should take the Quickstation sentence out (but leave the dialup sentence in).
          • Student Computing Labs substituted for Cluster in the tables and text.

          The tables needed me to repast them as bitmaps from the Excel original, and they probably won’t change again in this report. Additional changes to the text can be done by Pat / Elaine up to the moment the report goes in.
          Rob

          From: Oliver Thomas
          Sent: Wednesday, January 20, 2010 5:59 PM
          To: Robert W Smyser
          Cc: Oliver Thomas; css-managers@mit.edu Managers; Elaine Elizabeth Aufiero; Patricia Sheppard
          Subject: Re: CSS Q2 Report Draft

          Hi Rob,

          A few quick corrections to the Athena and printing metrics:

          • In the summary, the total number of Athena workstations is 1472 (not 2434). In the table, the number of Personal/DLC-owned Workstations is 1113. Jon had sent a correction back in early January that didn't make it into the final version.
          • Can we take out the "A relatively large" in "A relatively large 14% of total Athena logins..."? They're actually 12% of all of our publicly deployed machines (cluster + quickstations) so 14% of logins on them is pretty normal, especially since they encourage higher throughput (of users).
          • Can we replace "Cluster Workstations" in the table with "Student Computing Labs"? It seems like we're moving to that more generic terminology in the president's report, so might as well keep it consistent. The fact that they're Athena workstations is covered by the column heading.

          It looks like the utilization data didn't make it in the QR, which is okay, but Jon asked me to follow up to see if it was a formatting issue (no graphs allowed) or if there was some other reason.

          Thanks!

          Oliver


          Oliver Thomas
          Information Services and Technology
          Massachusetts Institute of Technology

          +1 617 253 9682
          +1 617 835 9682 /m
          othomas@mit.edu

          ________________________________________________________________________________________________

          Robert Smyser’s email (dated 1/19/2010)

          Subject: CSS FY2010 Q2 Report draft 3 with interspersed comments.doc

          SPECIAL NOTE:  See page two of this document – it is the document that was attached to this email.

          Pat,

          Here is the latest version of the quarterly report metrics section.  It has Chris Lavallee’s edits including another row of DDM data and the column that adds this-Qtr/last-Qtr comparisons.  No little charts.  I amended the call center text to reflect the new numbers after taking the non-working weekdays out of the picture.   This has all been checked over with Jozsef a little while ago.  Cheers, Rob

           Summary of Strategic Metrics

          CSS maintained high levels of call center performance in Q2, with Client Satisfaction only slightly below its 4.5 goal, and Abandon Rate well below its goal of 10%.

          Repair Center and Telephone Help satisfaction scores show steady improvement over the year and are now above target for the last two quarters.  Telephone Analog and ISDN orders are high from requests to remove such phones.  Telephone Help kept its recent gain in % of tickets resolved in Tier 1, up 15% this year.

          Ticket Topics are assigned by a largely automated process using keyword matching and hinting.  Adding User Accounts to the pool for the first time greatly increased volume in the Accounts topic and contributed to the 35% increase in Email tickets, otherwise caused by Exchange-related tickets created in the Call Center.  The Backup topic was impacted by the annual cleanup of mostly inactive TSM accounts.  Two other lower volume topics – Security and Services -- showed large % increases related to phishing and malware, and increased use services like wikis, respectively.  Business tickets are down by nearly half compared to a year ago, and Hardware tickets down by 22%.   In those areas, newer hardware and easier-to-use software have a positive impact on our clients’ computing environment.

          As a consequence of adding User Accounts, Service Desk ticket volume nearly doubled over last year.  Over 8300 total tickets, or 126 tickets per day, were created by more than 4700 unique IDs in a roughly 3:2 ratio of employees to students. 

          Training offered 14% more classes and attracted 8% more attendees than a year ago.  A third of the training taken in Q2 was about Exchange.  Attendees are pleased with their training, as client satisfaction scores remain high.

          Accessibility delivered 39% more Adaptive Technology consultations to the community, and showed the same increase in student users of the 24x7 lab.  Software Usability consultations nearly doubled over last year as well.

          DDM’s Preventative Maintenance visits and Desktop Deployments have surged over last quarter even as DDM looks to revamp the program later in the year.  Declines in MDS metrics across the board are consistent with recent DLC belt-tightening. DCAD shows sustained gains in the SLA business, while new projects are down compared to a year ago but rising steadily in the last three cycles.  The DS PLUS reporting is new this quarter and shows a 42% increase over last year in activities related to supporting its 72 client individuals.   

          Athena  and Printing metrics are new this quarter. Athena Workstations by Type reveals that 85% of the 2434 known Athena installations are not in our clusters but are privately owned or in DLCs.  A relatively large 14% of total Athena logins occur on the 43 high-turnover Quickstations, while just 8 dialup servers account for 28% of total logins, likely from Windows and Macintosh machines running terminal software and an X client.  The 27 public Athena printers seem heavily used at over 91000 pages per quarter altogether, but 55% of the pages printed were in paper-saving duplex mode. 

          Finally, DMCA notices were in a year-long decline until Q2, up 100% over Q1 and 57% over Q2 of FY2009.

          Please see refer to the attached document for the metrics tables that were listed with this document:

          https://wikis.mit.edu/confluence/download/attachments/58241539/SmyserEmailToSheppardAufieroCSS+FY2010+Q2+Report+draft+3+with+interspersed+comments011910.doc

          ________________________________________________________________________________________________

          Robert Smyser’s email to Barbara Goguen, Patricia Shepaprd and CSS Managers (dated 1/19/2010)

          RE: CSS Q2 Report Draft

          Folks, 

          Looking more deeply into the ACD data, it was found that the non-working weekdays --- Columbus day, Veterans day, thanksgiving, 4 days around xmas and New Years, etc. – were still in the worksheet, registering as days of zero calls offered, zero agents on the phone, etc., These zeros dragged the averages down, especially so in December.    

          Removing the zero days from the data drove Calls Offered back up to 84, and Agent Availability back up to 37 (the same as a year ago).   Some of the other ACD numbers like wait time, had also been reduced by the zeros and so they went up a bit.   

          As a result, in the report, the affected numbers will be a little different than in the first draft, and the text will change a little too.

          I’ve added this little gotcha to the checklist of such things for the future.

          Rob 

          _________________________________________________________________________________________________

          On Jan 12, 2010, at 2:25 PM, Patricia Sheppard wrote:

          Summary of Strategic Metrics
          CSS maintained high levels of call center performance in Q2, with Client Satisfaction only slightly below its 4.5 goal, and Abandon Rate well below its goal of 10%.
          Repair Center and Telephone Help satisfaction scores show steady improvement over the year and are now above target for the last two quarters. Telephone Analog and ISDN orders are high from requests to remove such phones. Telephone Help kept its recent gain in % of tickets resolved in Tier 1, up 15% this year.
          Ticket Topics are assigned by a largely automated process using keyword matching and hinting. Adding User Accounts to the pool for the first time greatly increased volume in the Accounts topic and contributed to the 35% increase in Email tickets, otherwise caused by Exchange-related tickets created in the Call Center. The Backup topic was impacted by the annual cleanup of mostly inactive TSM accounts. Two other lower volume topics – Security and Services – showed large % increases related to phishing and malware, and increased use services like wikis, respectively. Business tickets are down by nearly half compared to a year ago, and Hardware tickets down by 22%. In those areas, newer hardware and easier-to-use software have a positive impact on our clients’ computing environment.
          As a consequence of adding User Accounts, Service Desk ticket volume nearly doubled over last year. Over 8300 total tickets, or 126 tickets per day, were created by more than 4700 unique IDs in a roughly 3:2 ratio of employees to students.

          ...

          _________________________________

          Steve Winig's email to Chris Lavallee, Patricia Sheppard and CSS Managers and cc:  E. Aufiero and robert Smyser

          RE: CSS Q2 Report Draft

          note regarding the Metrics contribution that was submitted by Rob Smyser.

          ...

          ________________________________________
          From: Chris Lavallee lavallch@MIT.EDU
          Sent: Wednesday, January 13, 2010 9:47 AM
          To: Patricia Sheppard; CSS Managers
          Cc: Elaine Elizabeth Aufiero; Robert W Smyser
          Subject: Re: CSS Q2 Report Draft
          Hi all-
          I had a discussion yesterday with Rob re: the metrics tables and analysis and would like your take on this idea.

          ...

          Finally, DMCA notices were in a year-long decline until Q2, up 100% over Q1 and 57% over Q2 of FY2009.

          To view the metrics tables attached to this document, please view the attached document: 

          https://wikis.mit.edu/confluence/download/attachments/58241539/SheppardEmailToSmyserAndAufieroCSSQ2DraftReport011110.docx

          _______________________________________________________________________________________________

          ...