Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Added IDEALS info for 2020 Climate Study Executive Summary Report

Mission Statement

Project-wide strategic planning, policy development, evaluation and assessment, and organizational improvement in support of sustaining an effective and productive virtual organization.

Goals, Metrics, KPIs

Metrics

Metric

Key Performance Indicators (KPIs)

Project Level KPIsTargetSubgoal
  • Percentage of recommendations addressed by relevant project areas

    • intentionally does not measure “implementation” of recommendations due to the many factors that may impede implementation (e.g. timelines, funding, capacity, etc.)

    • track this metric with new tools currently being implemented in XSEDE, namely JIRA and Confluence. The team intends to upload evaluation reports to Confluence and copy recommendations to JIRA for tracking.
(Target 90%) 
  • Average rating of staff regarding how well-prepared they feel to perform their jobs

    • obtained by staff self-report via the Annual XSEDE Staff Climate Study conducted by the external evaluation team. Staff responses to a set of Likert Scale items measured on a scale of 1 (Strongly Disagree) to 5 (Strongly Agree) and relating to staff preparation are combined to determine a mean index score.
(Target 4 out of 5) 

KPIs

KPITarget
  • Will be assessed to determine best ways to qualify innovation

    • Number of strategic or innovative improvements

      • measures innovative actions directly

    • Ratio of proactive to reactive improvements

      • a measurement of organizational maturity and agility
 

Grand (aggregate) mean of XSEDE User Survey awareness items regarding XSEDE resources and services (1-5 point Likert scale)

3.7 of 5/yrDeepen & Extend Use - Raising Awareness

Grand (aggregate) mean of XSEDE User Survey satisfaction items regarding XSEDE technical support services (1-5 point Likert scale)

3.5 of 5/yrAdvance - Enhance the Array of Technical Expertise and Support Services 
Mean rating of importance of XSEDE resources and services to researcher productivity (1-5 point Likert scale)4.4 of 5/yrSustain - Operate an Effective and Productive Virtual Organization
Percentage of users who indicate the use of XSEDE-managed and/or XSEDE-associated resources in the creation of their work product80%Sustain - Operate an Effective and Productive Virtual Organization
Percentage of Project Improvement Fund funded projects resulting in innovations in the XSEDE organization70%/yrSustain - Operate an Innovative Virtual Organization
Mean rating of innovation within the organization by XSEDE staff (1-5 point Likert scale)4 of 5/yrSustain - Operate an Innovative Virtual Organization


L2 KPIsTargetSubgoal

Percentage of recommendations addressed by relevant project areas within 90 days

 90%/yrSustain — Operate an effective and productive virtual organization 
Grand (aggregate) mean of Staff Climate Study satisfaction items regarding content and accessibility of the XSEDE Staff Wiki (1-5 point Likert scale)3.5 of 5/yrSustain — Operate an effective and productive virtual organization 
Number of staff publications50/yrSustain — Operate an innovative virtual organization 
Grand (aggregate) mean of Staff Climate Study awareness items regarding inclusion in XSEDE (1-5 point Likert scale)4.1/yrSustain — Operate an innovative virtual organization 
Grand (aggregate) mean of Staff Climate Study awareness items regarding equity in XSEDE (1-5 point Likert scale)4.0/yrSustain — Operate an innovative virtual organization 

Team Members

Julie Wernert
NameInstitution
Ron Payne, ManagerNCSA
Leslie Froeschl, Project ManagerNCSA
Lizanne DestefanoDeStefanoGeorgia Tech
Lorna RiveraGeorgia Tech
Nick BerenteUniversity of Georgia
Ian FosterArgonne
Craig StewartIndiana
Craig StewartUIUC
Julie WernertIndiana
Claudia CostaIndiana
Tonya MilesIndiana
Harmony JankowskiIndiana

Communication & Meetings

Biweekly starting 5/3/2017 at 2pm Central | 3pm Eastern

Meeting Coordinates

WBS 2.6.5 - SP&E Google Drive: https://drive.google.com/drive/u/2/folders/0B16f9Te7wFwmOVZXM3JRQ29WUHM

Meeting Notes

https://drive.google.com/drive/u/0/folders/0B716DDks-5UkTGl3RzhfQUhpUjQ

XSEDE Return on Investment (ROI) Team Page

Important Dates

  • User Survey final results due in May
  • Climate Survey final results due in September

New Staff Orientation

  • Under development
Public Evaluation Reports
  • New staff onboarding occurs at the home institution. All new staff are encouraged to read the XSEDE New Staff Guide

Public Evaluation Reports and Summaries