Child pages
  • WBS 2.3.2 RACD Meetings 2017-06-29 Agenda and Minutes
Skip to end of metadata
Go to start of metadata

Date

Attendees

Goals

  • Share XSEDE program general updates
  • Share requirements analysis and capability delivery planning activities
  • Share capability integration activity status

Discussion items

TimeItemWhoNotes
~10minGeneral UpdatesJP & Shava 
~10minUse Case and Capability Delivery Plan UpdatesLee 
40minActivity Status UpdatesShava 

 

General updates

Annual Review

Prepared Panel Report Responses

  • Components at risk due to XCI capacity: Job prediction (Karnak), CSR, Globus Toolkit transition

Action items:

News and Announcements

  • XCI has been renamed to XSEDE Cyberinfrastructure Integration
  • Next IPR due in early August
  • Globus impact analysis, Information Services RESTfull API doc, and two PEARC papers (CSR, DUO @ PSC) were submitted for the staff newsletter
    • ACTIONS
      • JP Navarro will email Dave, Craig, and Victor about mentioning the Globus impact analysis on the SMT and SP forum calls.

Engineer practices

We need to instrument and track usage for new components


Use Case and Capability Delivery Plan Updates

  • IAAS use cases related to publishing and re-using VM images in a VM library will be reviewed in a BOF at PEARC17. This could result in tweaks.
  • Currently working on proposed group management use cases based on earlier user needs study.
    • Lee Liming to consolidate (ideally combine a few) group management use cases
  • New "Guided Resource Discovery" SPI-02 use case from XRAS
    • JP Navarro is coordinating XRAS and relevant implementation teams on "Guided Resource Discovery"
  • ACTIONS:
    • JP Navarro will create use case for CSR user forums under CI use cases
  • Reminder: Please forward all ideas/suggestions for new features from all sources

Activity Status Updates

Delivered and deployed

XCI-17 Update GSI-OpenSSH for OpenSSL 1.1  (Venkatesh Yekkirala)

  • Testing completed on  ; handed off to Victor but pulled back to address double free memory vulnerability (XCI-139)


Pending deployment

In Testing

XCI-6 New SP Resource Integration Testing (Christopher S Irving)

  • Goal: Run the the new SP and new resource integration process and recommend areas of improvement
  • Working closely with Victor in CRI
  • Will be tested by Christopher S Irving
  • Victor mentioned case where SP wanted to know if they build their own versions of XSEDE components, where they can find the list of required features
    • Lee suggested use cases; capability is there now but not filled in
  • TRR completed on 
  • Frontend is installed; Working on package installs now
    • CA certificate package installed with fetch-crl
    • Posted module template for CUE package
    • Working on Globus packages published few issues already
    • Question about what resource id to use for xdresourceid package – Christopher will submit help ticket
    • Found xdusage package has not been updated to the latest release – fixed and then unfixed – Eric will take a look – Christopher will post other xdusage related comments
    • Working with XCDB team to get resource id – will re-use comet
    • Getting package conflicts with globus-client
    • Also documentation assumes everyone knows what and how to generate grid-mapfiles – Jim commented that XCI-36 will address grid-mapfiles for GSISSH and could be generalized
  • ACTION:

XCI-21 Fix and enhance IPF software publishing (Eric Blau)

  • Derek Simmel and Peter Enstrom are testing
  • Derek able to fix update issues and new certificates – should be done soon
  • Deb has been emailing with JP and Maytal about how to display usage information – need to come to consensus and discuss with SPs and possibly open a new activity
  • Peter finished his testing today and will send his log to Derek for reference
  • Derek finished testing
  • ACTIONS
    • Eric Blau will push doc changes to dev server
    • Derek Simmel will create Eric an account on the info.psc.edu server to figuring out why slurm jobs are not being published for Bridges

XCI-139 Update GSI-OpenSSH to address double free memory vulnerability (Venkatesh Yekkirala)

  • Agile activity
  • Waiting on packages – Galen and Peter will test

In Development

SDIACT-159 Enable subscribing to XSEDE monitoring information from Inca and Nagios (Shava Smallen)

  • Code completed and testing integration with Information services
  • Pending test plan
  • Waiting on deployment of Nagios plugin 
  • Inca publishing data now; test plan next
  • Inca messages have been updated to have a Valid timestamp so can more easily be cleaned from the warehouse

SDIACT-226 Assist software provider to deliver Kepler workflow support on XSEDE (Shweta Purawat)

  • Kepler has been installed on VM; developer working on setting up some Bio apps they need for users.
  • Received VM from IU and migrated to Comet
  • kepler.xsede.org VM is now being hosted on Comet with DUO and RSA enabled
  • Install doc completed
  • Working on user doc and test plan

SDIACT-244 Upgrade and transition JIRA for XSEDE2 (Shava Smallen)

  • JP Navarro got mysql replication working between primary and backup servers
  • Gary has also setup Confluence
  • Added new notification plugin for PM team
  • JIRA 7.3 was recently released
  • Gary is working on service containers to make it easier to backup and restore
  • PM team wants to setup staging and development servers – looking into it

XCI-36 Enable L3 resource logins via XSEDE using login allocations (Jim Basney)

  • Will provide grid-mapfile setup instructions that can be referenced by other components (e.g., gridftp)
  • Waiting on project to be inserted into XCDB – Derek and Terry currently blocked
  • ACTIONS
    • JP Navarro Invite XRAS folks to Thurs call next week to discuss schedule and implementation plans, had a cross-area teleconference instead

XCI-2 Document how Science Gateways can use XSEDE Identity Management (Lee Liming)

  • Two documents are now available.
    1. User authentication service for XSEDE science gateways
    2. Technical overview of public XSEDE authentication services
  • Next step is to "publish" the documents (so they can be referenced in the test plan) and move the activity to testing.
    • Q: How do we make these docs available in the CSR?
      • JP suggested that the "technical overview" doc should be made available via the CSR "installable software components" area where other design docs and materials are provided. How does this work?
      • What about the "use authentication service" doc? Do we have a recommended public place to publish documents for developers?
    • Lee Liming figure out how to make docs available in CSR
    • Lee Liming draft test plan and move the activity to testing

XCI-19 Implement Initial XSEDE Community Software Repository and Information Services (JP Navarro)

  • At https://software.xsede.org/
  • In Agile development
  • Alpha testing the ability to register software capabilities manually for gateways and one software provider
  • Discussing store front and graphics
  • Presented resources status views and APIs to the science gateways group and recorded improvement requests in JIRA

XCI-27 Incremental Resource Description Repository (RDR) fixes and enhancements (JP Navarro)

  • Setting up failover server
  • Dave Hart and JP will be contacting the RDR folks to get a better idea of their roadmap for PY7
  • Failover server is almost complete - tested failover on Wednesday.  Had some SSL issues that should be resolved now.  Will test again soon.
  • Start on RDR to XDCDB acct schema integration next week.  This will be helpful when level 3 providers start "allocating" resources for XCI-36

XCI-44 Incremental Pub/Sub (RabbitMQ) fixes, enhancements, and support

XCI-127 Impact Analysis: Support for open source Globus Toolkit will end as of January 2018

  • ACTIONS
    • JP Navarro prepare news announcement to inform XSEDE staff and community that we are working on this
    • JP Navarro forward announcement details to Dave to share with SMT and to Victor to share with SPF and SP admins  

In Design

SDIACT-207 Adapt INCA to information services changes (Shava Smallen)

  • Launched on  
  • CentOS 7 migration of SDSC server finished
  • Almost wrapped up with changes – need to document

XCI-7 Review and improve Confluence and JIRA authorization configuration (Warren Raquel)

  • Warren recommended creating a staff and WBS group and a few other admin suggestions
  • ACTION(S)
    • Shava Smallen to assess document and possible solutions for identified issues
    • JP Navarro: Start DSR (Deb volunteered to be a reviewer)

XCI-45 Prepare initial Group management requirements, use cases, and plans (Lee Liming)

  • See use case status above.

Launch

 

In Planning 

XCI-43 XSEDE-UIUC/campus infrastructure information services federation pilot

  • During the Fall of 2016 we exchanged information about our existing capabilities and needs
  • Draft collaboration plan almost ready for management review and approval
  • OK from John to proceed as long as not a lot of effort on XCI side – still waiting to hear back from NCSA

New Activities from CDPs: