DM Leadership Team Meeting 2018-10-29

Wil O'Mullane

• A reminder that Leanne Guy is invited to the management meeting on Monday morning.
  • (But is not required to be there).

Wil O'Mullane

• One test spec overdue DM-16073 - Getting issue details... STATUS .

• Unknown User (mbutler) Follow up on test plan for LDM-503-08b; make sure DM-16073 - Getting issue details... STATUS . 05 Nov 2018 
• Wil O'Mullane Clarify whether Jira tickets refer to test specs or test plans. 05 Nov 2018 
  

• Need to take care to buy what we need (barely) so we have plenty for later.
• Do we need all the K8 Nodes?
  • The intention was that the would be used for running Dask.
  • Supporting e.g. 40 stack club folks.
  • Can be scaled back to support fewer users doing fewer things.
• Can we test Qserv at scale on Google?
  • In the short term, yes.
  • Longer term, there is risk exposure from not running on the system that would actually be deployed in operations.
• Leanne Guy asks: where should enthusiastic science collaboration users be given access?
  
  • Not clear how this fits into the hardware budget.

• Wil O'Mullane , Frossie Economou , Leanne Guy : Discuss hardware provision for science collaboration access to the LSP. 12 Nov 2018 

• 2018-11-05 DM SST F2F
• DM Leadership Team Face-to-Face Meeting, 2018-11-06 to 08
• Agenda available on both pages. Last minute updates to Leanne Guy (SST) or John Swinbank (DMLT).
• For problems with logistics, contact Yusra AlSayyad & John Swinbank .

• RFCs with "Planned end" past "now". (See query table below.)

• John Swinbank & Frossie Economou : Resolve RFC-537.  05 Nov 2018 
  

Tim Jenness

• Change requests of interest to DM
• HiPS image generation was approved, but then stumbled over costing; should now be resolved.
• Kian-Tat Lim aiming to get header service LSE-400 this week.
  
  • Will include explicit header appendix (hooray!).

Wil O'Mullane

Leanne Guy/ Colin Slater/ Unknown User (xiuqin)

• Walked through the LSP FDR charge, leading to submission of RFC;
• Walked through User DB Workspace issues; Leanne asked to provide formal set of use cases; must be digested into design in time for the review;
• Reviewed authorization architecture alternatives; rejected "pure capabilities-based" architecture as poorly suited to needs, at least with our resources; KT to write up memo with BvK on the pure-identity and mixed models discussed, with pure-identity, group-membership-based auth'z'n as an initial phase;
• Reviewed new plan for internal and external use of IVOA standards (see DMTN-090); Gregory will RFC as a change to LSP Design, LDM-542;
• Adopted CADC TAP service Java code base as the core of our planned TAP service (following Christine's nice demo); Fritz to document this and describe the development required to fully adapt/extend it to our design (edited)
• Examined demo of Dask integrated with Jellybean; discussed Dask, Spark, and other "next-to-DB" issues
• Looked at demos of closer Firefly-JupyterLab integration and of Firefly LSST detection footprint browsing

(The above are lifted from Gregory Dubois-Felsmann on Slack)

• Progress working through A&A issues.
  • There will be a memo forthcoming from Kian-Tat Lim et al on this.
  • This will be at a level which enables detailed costing.
• There are action items on the meeting page; immediate aim should be to address those.

Wil O'Mullane

• John Swinbank in the UK all week; available but seven hours shifted.
• Wil O'Mullane in Chile traveling back Wednesday night (so not really available Wednesday Tucson working time).
• Margaret Gelman at LBNL for DESI operations review