(back to the list of all DMLT meeting minutes)

Location

Browser

Room System

Phone Dial-in

https://gemini.zoom.us/j/93625401560?pwd=cjdFb1ZWeGx1eVJGSVBUVmpMRUg5UT09


Meeting ID: 936 2540 1560 

password: 161803

Dial closest IP: 162.255.36.11 (east coast) and 162.255.37.11 (west coast) Then use the Zoom meeting ID 936 2540 1560 as the dialing extension. For example: 936 2540 1560@162.255.37.11 or: 162.255.37.11##936 2540 1560 Password: 161803

Dial-in numbers:

+1 346 248 7799 (US Toll)

+1 669 900 6833 (US Toll) Meeting ID: 936 2540 1560 International numbers available: https://gemini.zoom.us/u/adcUNrbXzS

First post break DMLT

Time

10:15am PT

Attendees

Frossie Economou (Chair)

Regrets

Discussion Items

ItemWhoNotesMintues
Notes
last time
Monthly report
Due this week - please fill in by Aug 18th. https://docs.google.com/document/d/1_LPZbmOZlBdiQELEu-xrN_DPAmnKn86AZGYy9FQhfKA/edit#heading=h.m2nv7zs59upm
Project Updates

Frossie Economou

  • CD4 (DOE final funding) camera review upcoming, select attendance (SK)
  • Still no charge for the JDR (3 weeks away). Est 1.5 days of mgt 1.5 days of tech breakout (SK)
  • We can submit our change of schedule for the rebaseline even in advance of the recosting (VK)
  • End of June data for the EVMS surveillance for the reviews
  • DM can re-use its rebaseline review materials but with a different focus (progress rather than replan)
  • Oil-bearing system commissioning team (SKF) in quarantine in Santiago 
  • Tucson office reserved parking spot complaint (AB)
  • Concern about aggressive schedule and lack of projects a rookie can just walk in and take over
  • Camera expects to have refrigeration answers by the JDR, big lift tomorrow, 2 week cooldown
  • accomplishments through June for JDR
JDR/JSR

JDR2021/JSR2021 — JDR Sept 7-9.


DEI


See  #inclusion and https://www.lsst.org/about/dei

Community link: https://community.lsst.org/c/eji/45


SLURM TransitionKian-Tat Lim

We currently have batch nodes split into two approximately equal SLURM and HTCondor clusters.  It would be more effective to have them all in one.  BPS/Gen3 at NCSA works best with HTCondor, I believe. 

  • If so, when can we convert the SLURM nodes to HTCondor?
  • Does it depend on whether SLAC chooses SLURM as a batch system for USDF?

It looks like the current SLURM users are Science Pipelines reprocessing (needed until Gen2/Gen3 parity has been fully demonstrated) and Commissioning uses that have not yet been transitioned to Gen3.

  • Yusra: Science pipelines is running regular gen2 processing and will need all the slurm nodes they have for the next three months
  • Robert: Trying to get commissioning (Merlin) off of gen2 eminently
  • Robert: Do we need more slurm nodes?
  • Yusra: We could add nodes back from the HTCondor cluster (not preferable).  The other option is to clear people off the slurm cluster
  • Ian Sullivan to talk to Andy Connolly about moving Chris S. work off of the slurm cluster  
  • Frossie Economou will talk to Tony Tyson about coordinating Adam Snyder work on slurm cluster  
  • Robert Lupton will bring up general usage of slurm in the CAP meeting to see who can move off gen2 and leave the slurm cluster for reprocessing  
Review of Project Milestones



Level 2 Milestones


See also LSST Verification & Validation Documentation and docsteady.lsst.io.

Test Plans due in the next 45 days

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh

Milestones due in the next 45 days

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh


Risk Review



Next risk meeting AUG 31 please review

Risk items needing review

Key Summary T Created Updated Due Assignee Status days since review
Refresh

Overdue risks (obligation date passed)

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh

Risk mitigations due at the end of this month

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh

Overdue risk mitigations

 

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh


DMLT Travel & Availability this week


Yusra will have unreliable connectivity Tue-Fri
Any Other Business




TCAM Stamdup

Frossie Economou

as needed
  • If pods get scheduled on the ingress node of the k8s cluster at NCSA the networking doesn't work.  There is this ticket, but it also happens on the prod cluster 
Action review




RFCs

Overdue

Key Summary Reporter Assignee Created planned end
Refresh

Due this week

Key Summary Reporter Assignee Created planned end
Refresh

Action Items

Confluence Quick Tasks

DescriptionDue dateAssigneeTask appears on
  • Frossie Economou Will recommend additional Level 3 milestones for implementation beyond just the DAX-9 Butler provenance milestone.   
15 Mar 2022Frossie EconomouDM Leadership Team Virtual Face-to-Face Meeting, 2022-02-15 to 17
  • Kian-Tat Lim Convene a meeting with Colin, Tim, Robert, Yusra to resolve graph generation with per-dataset quantities (likely based on Consolidated DB work).  
18 Mar 2022Kian-Tat LimDM Leadership Team Virtual Face-to-Face Meeting, 2022-02-15 to 17
  • Frossie Economou Write an initial draft in the Dev Guide for what "best effort" support means  
17 Nov 2023Frossie EconomouDM Leadership Team Virtual Face-to-Face Meeting - 2023-Oct-24
  • Convene a group to redo the T-12 month DRP diagram and define scope expectations Yusra AlSayyad 
30 Nov 2023Yusra AlSayyadDM Leadership Team Virtual Face-to-Face Meeting - 2023-Oct-24
11 Dec 2023Gregory Dubois-FelsmannDM Leadership Team Virtual Face-to-Face Meeting - 2023-Oct-24
02 May 2024Frossie EconomouDMLT Meeting - 2024-04-22
22 May 2024 DMLT Meeting - 2024-04-22
  • Richard Dubois USDF part in data facilities for PSTN-017 and distrib processing ? 
22 May 2024Richard DuboisDMLT Meeting - 2024-04-22
22 May 2024Fabio HernandezDMLT Meeting - 2024-04-22
  • Cristián Silva - section on summit/data acquisition  for PSTN-017  
22 May 2024Cristián SilvaDMLT Meeting - 2024-04-22
  • Tim Jenness - section on middleware for PSTN-017  
22 May 2024Tim JennessDMLT Meeting - 2024-04-22

DMLT-relevant Jira Tickets

Key Summary Reporter Assignee Created Due
Refresh