Skip to end of metadata
Go to start of metadata

KPIs :

KPIUnit reportedSourceNotes
Mean Satisfaction with Services1-5, average, include n observationsUsually we ask the people we have worked with in a quarter to report. Sometimes we get survey info (such as August IPR time) — Superseded by always using the survey and only reporting this number once a year.This number is combined w/ RACD's satisfaction for overall XCI satisfaction (averages weighted by n responses from each team)
Number of non-XSEDE partnerships with XCIOngoing partnership w/ institution or organizationSite visit recipients, engagement recipients, cooperation with orgThis number is added together with RACD
Mean time to issue resolutiontime to resolve, n ticketstickets.xsede.org query CRI queue for the quarterThis number is combined with RACD's TTR (average weighted by n responses)


 Metrics:

INCANDESCENTLY HEALTHY REPORTING YEAR 6
MetricSourceTarget

RP1 / IPR15

May-July: A suffusion of Rose

RP2 / IPR16RP3 / IPR17RP4 / IPR 18
Total number of systems that use one or more CRI provided toolkitsGlobus users + XCBC installs + XNIT subscribers700 by end of RY22419 = 2196 + 223 Globus


User Satisfaction with CRIDirect questions or User Survey (August)4 out of 5User Survey InfoNA, Annual onlyNA, Annual onlyNA, Annual only
Aggregate number of TeraFLOPS of cluster systems using CRI toolkitsCluster builds (including JS clusters)1000TF by end of RY5(1121 at end of PY 5)


Number of repository subscribers to CRI cluster and laptop toolkitsEric checks XNIT subscribers and other users150123





Number of partnership interactions between CRI and SPs, national CI organizations, and campus CI providersSite visits, engagements, collabs at meetings, etc12

+Langston
+SWOSU
+UCO
+Bentley
+SGCI Workshop?
+USD





Toolkit updatesEnhancements to toolkits4/yr+1 VC Scripts improve + Docker



New Toolkits releasedBrand new capabilities2/yr



Average time to issue resolutiontickets.xsede.org<14 days1 n = 1



GLORIOUS REPORTING YEAR 5
MetricSourceTarget

RP1 / IPR12

May-July: The Interminous Node

RP2 / IPR13

Aug-Oct: The Lacrimae Interval

RP3 / IPR14

Nov-Jan

RP4 / IPR15

Feb-Apr

Total number of systems that use one or more CRI provided toolkitsGlobus users + XCBC installs + XNIT subscribers700 by end of RY22196=1999+197 Globus2373=2196+177 Globus2540 = 2373+167 Globus

2693=2540+153 Globus

User Satisfaction with CRIDirect questions or User Survey (August)4 out of 5User Survey infoNA, Annual onlyNA, Annual onlyNA, Annual only
Aggregate number of TeraFLOPS of cluster systems using CRI toolkitsCluster builds (including JS clusters)1000TF by end of RY51020
+10 DR-COV19
+10?? Samy (This was actually Y4RP4... and has GPUs! Maybe re-calc the FlOp/s )
1020 +
34 UCO (27 CPU, 6 GPU)
10 lrose
27 Langston (18 cpu, 11.2 GPU)
______
1091
1091 +
10 AMP Gateway
10 Geogateway
10 DELTA Portal
_______
1121

Number of repository subscribers to CRI cluster and laptop toolkitsEric checks XNIT subscribers and other users150114 Y4RP4
+1 Samy
+1 DR-Cov19? (DR=Distant Reader, new project)
+1 Langston?
________
117

117
 + UCO
 + Langston
 + lrose gateway
_______
120


120
+ 3 AMP,GeoGateway,DELTA
VCs
______
123

Number of partnership interactions between CRI and SPs, national CI organizations, and campus CI providersSite visits, engagements, collabs at meetings, etc12

7 interactions

  • Beckman Institute
  • Bentley
  • Dartmouth
  • GMU
  • Langston U
  • Morehouse
  • UCO


interactions

  • ASU
  • GMU
  • UCO
  • Langston

interactions

  • ASU
  • GMU
  • Langston
  • UCO
  • ORU
  • UT Dallas
  • Bentley
  • GMU
  • Langston
  • Bentley
  • Rhodes
  • Vassar
  • UMMC
  • NCGAS
  • SWOSU
Toolkit updatesEnhancements to toolkits4/yr+1000 Mike Renfro XCBC Updates
+1 GPUs in the VC
+ XCBC bugfixes
+ ???
Call it 3 for the quarter
At least 3 for the quarter
2 major VC updates
1 major XCBC update (xCAT)
in addition to bugfixes
Bugfixes to VC, XCBC
Changes to the CTL?
Openstack docs background work?

2 Openstack updates

1 openstack doc update


New Toolkits releasedBrand new capabilities2/yrContainer Template


Average time to issue resolutiontickets.xsede.org<14 days10.5 (n-=2)12 n =13 n=16 n=3


REPORTING YEAR 4
MetricSourceTarget

RP1

May-July

RP2

Aug-Oct

RP3

Nov-Jan

RP4

Feb-Apr

Total number of systems that use one or more CRI provided toolkitsGlobus users + XCBC installs + XNIT subscribers700 by end of RY21388=1210+(178 Globus)1558=1388+170 Globus1762=1558+204 Globus

1999=1762+237 Globus

User Satisfaction with CRIDirect questions or User Survey (August)4 out of 53.8 (User Survey)


Aggregate number of TeraFLOPS of cluster systems using CRI toolkitsCluster builds (including JS clusters)600TF by end of RY3972=927+(45 ORU)995 (+18 Bentley update +5 JStopa JS Cluster)9951000
(+5 TopPIC JS Cluster?)
Number of repository subscribers to CRI cluster and laptop toolkitsEric checks XNIT subscribers and other users150112 (from last RP)112112114 (+2 Jstopa and TopPIC gateway users)
Number of partnership interactions between CRI and SPs, national CI organizations, and campus CI providersSite visits, engagements, collabs at meetings, etc126 = Brown + PEARC Panel + GMU + Doane + Bentley + PEARC Tutorial?4 = SIU + Bentley + CAU + Clarkson?4 = (all support)
Binghamton
S Wheat
Jwells
UCinci
4 support
UCinci
JWells
Binghamton
Clarkson
Toolkit updatesEnhancements to toolkits4/yr3 (XCBC & Cluster_monitor & JS Cluster)3 (XCBC & JS Cluster & JS Tutorial?)2 (JS Cluster, Tutorial/class toolkit)1 JS Cluster
New Toolkits releasedBrand new capabilities2/yr01 Virtual Cluster workshop automation toolkit00
Average time to issue resolutiontickets.xsede.org<14 days2 (n=2)8 (n=3)NA (n=0)1.5 (n=2)

Notes for Reporting Year 4 (superscript numbers in table = regular numbers here)


REPORTING YEARS 3 AND EARLIER (HERE THERE BE DRAGONS):

 

Area Metric

Target


Jul – Aug 2016

Sep - Oct

2016

Nov 2016 -Jan 2017Feb - Apr 2017

RP1

May-Jul

2017

RP2

Aug-October 2017

RP3

Nov 2017 - Jan 2018

RP4

Feb '18- April 2018

RP1 - PY3???
May-Jul 2018

Aug 2018-Oct-2018

 

Nov 2018-Jan 2019Feb 19-April 2019May 2019 -July 2019

Sub-goal Supported

Total number of systems that use one or more CRI provided toolkits

450

377

512563594628

643

(540 Globus Transfer + 103 subscribs/XCBC)

608 = 503 globus transfer + 105 subscribs707 = 601 globus trans + 106 subscribs724 = 627 Globus Trans + 107 subscribs813=702 Globus+111 subscribs964 =add 150 Globus + 112 subscribs1210 = add 246 Globus subscribs

Advance - Create an open and evolving e-infrastructure (§2.2.1)

User satisfaction with CRI services4/5*5na54.315  55na

 

Number of repository subscribers to XCRI cluster and laptop toolkits

150

52

919599102103 (No change XNIT, +1 XCBC @ SRU)

105 (No change XNIT, no site visit; though

new XCBC @ Bentley) +2 for JS clusters

(official SEAGrid prod, Ultrascan Prod)?

Is that legal? JS clusters are absolutely legal - Knepper

106

-1 XNIT; +2 JS (Murat Maga, NSG); +0 XCBC

107
+1 JS (InterACTWEL)

Galaxy is using part of our stuff too! Can add +1 if you approve. (RK Approves, +1)

111
(+1 XCBC - Doane, +1 XNIT downloaders?! +2 JS cluster - ng-thermdb, and EPW gateway)
112
(+1 XCBC UCinci)
112

Advance - Create an open and evolving e-infrastructure (§2.2.1)

Aggregate number of TeraFLOPS of cluster systems using XCRI toolkits

1000

100

532532732742752 (+10 SRU)764 (+12 from JS)

794
+15 GPU from Bentley

+15 from JS

800
+ new JS cluster (bigger nodes!)
812
+~10 from 2 new JS clusters (smaller ones)
+~1.6 from Doane
927
+ 101 from UCinci CPU + 14 GPU
927972 + Oral Roberts...

Advance - Create an open and evolving e-infrastructure (§2.2.1)

Number of partnership interactions between XCRI and SPs, national CI organizations, and campus CI providers

12

2

1 (EGI) + 4 (unallocated SP contacts) + 6 SP

checklist coordination meetings

 38 +6 (jecoulte)

+ 8 (jecoulte; support for SRU, SIU, Bentley)

 

+8 or (9 with Tutorial)
Support for SIU (x2), Bentley (x1), Tutorial?, JS Cluster users (x4 - support interactions!), Stephen Wheat (x1), Marshall (x1)   (RK: We'll call it 9 since Tutorial well attended and successful)

+7?

Doane (tempted to call this +2 w/ time outside of site visit)

U Mich meetup

Other interactions:
+1 Gateways tutorial
+1 Bentley support
+1 Rutgers Support
+1 Marshall Support
+2 JS cluster build interactions
+1 JS cluster support (for both Ultrascan and Murat Maga...) currently +1 in the total above

+10 old way
+5 new way?
+2 Ucinci?
+1 SRU Support

+1 Bentley Support
+1 Doane Support
+1 Bulk SC Collab Interactions?
+1 George Mason plannin'? (small)
+1 JS Cluster support? (ongoing for Ultrascan,  Murat Maga and InterACTWEL)
+1 XCRI Talk at SC

+1 VC Lightning talk at that EDU workshop at SC

+4

Advance - Create an open and evolving e-infrastructure (§2.2.1)

Toolkit updates

4/yr*2169 

+3 (XCBC updates, ClusterMon-ganglia

update, JS_Elastic massive improvements)

+3 (XCBC GPU, ClusterMon XDMod!, XCBC Slurmdbd)+3 (XCBC maintenance & gpu playbook churn, JS improvements, ClusterMon improvements) Count as 4? (RK: I count 4 parenthetical items, therefore 4)+1 XCBC updates (pull req from that one guy, updates from pre-Doane visit bugtesting)
+1 VC Updates (fix for OS Failure issues...)
+3
(XCBC Updates, ClusterMon updates, VC Updates for JS charging scheme)
+1
Advance - Create an open and evolving e-infrastructure (§2.2.1)
New Toolkits released2/yr**101 000 (RK: yikes we need to make some progress here)100
Advance - Create an open and evolving e-infrastructure (§2.2.1)

Percentage of XSEDE recommended tools that are adopted by allocated systems where the tools are appropriate

RETIRED

5

*

5na5 

 

     

Advance - Create an open and evolving e-infrastructure (§2.2.1)

Notes: 

  • system toolkit users: (294 Globus) (21 iso downloads) (10 site visits/verified installs) (52 US XNIT subscribers)
  • total XNIT subscribers worldwide: 70
  • Level 1 systems: Victor has pointed out that we need to probably change this to the number of non-allocated SP's installing tools, since level 1 SP's need to install the software set in order to be level 1. I concur, since that's a more meaningful measure.
  • Darter ended service August 31st
  • "Partnership Interactions" includes SP and unallocated SP coordination (RDR reporting meetings)
  • No labels