Dept-provided Coffee in Grand Central (no food) Yusra AlSayyad

Leanne Guy

Robert Lupton

Robert Lupton is not happy with the Source and DIASource tables (see SST meeting 2018-08-24). The goal of this session is to review these tables, understand the contentious issues and propose (if necessary) a revision to put to LCR

Preparation (all)

• SST SC liaisons should discuss with their science collaboration to understand what they are expecting
• QA (Simon Krughoff ) should think about what is necessary from a QA PoV. What information is needed in the Source table?

Notes

• We need to define SNR
• Photo-Z : Do we need all the photo-z parameters? There is a lot of space reserved. How do we accomplish the photo-z measurements?

• Robert Lupton and Leanne Guy — review all columns in the Source & DIASource table and decide whether to remove or move to a different table. The decisions on justification should be recorded in these tables. Proposed changes will be reviewed at a future SST meeting before going to LCR. Update 2022-02-09: Meeting to resolve this on 2022-02-21 28 Feb 2022 
• Leanne Guy , Jim Bosch — Organize SST session to determine who will do image processing for shear measurements . 2022-02-08 update:  The project will run shear measurements but  will work closely with some DESC people to develop the code.
  
• Robert Lupton Clarify the meaning of time in the object table. 1 sentence description in sdm_schemas, can link to a short DMTN.  Update 2022-02-09: Meeting to resolve this on 2022-02-21 28 Feb 2022 
• Colin Slater Ask Melissa about the size requirements for photo-z samples 21 Dec 2018 
  

Colin Slater Gregory Dubois-Felsmann

• Status of work of Brian van Klaveren  on a formal lang for data types.
• Presentation from Colin Slater / Yusra AlSayyad on work on Science Data Model standardization (previously DPDD-ification)
• Feedback from CADC on our analysis of trying to map the CAOM2 model to LSST (Moved to the DMLT main meeting)
• Next steps and deliverables

Notes

• N2DB Slides
• Colin will follow up with Brian VK on changes and updates to the Felis tool
• Wil: Support inheritance in the SDM schema files, so pipelines teams can create a "subclasses" with extra data (e.g. for debugging) beyond what will be delivered to users
• Bitpacking: if we do bitpacking, we need to decide where the source of truth is for what bit is what (i.e. at the DPDD-like level or the schema-like level). Jim suggests it might be in the standardization.
• Recommend that felis support hierarchical (at least one layer) descriptions, i.e. for supporting Avro or column groupings, which can then be flattened.
• Jim: Standardization functors should be able to return column groups, e.g. for covariance transformations. Would be enabled by the hierarchical model.

• • Gregory Dubois-Felsmann — complete DMTN-067  (Catalog data model) to be completed and put to RFC 14 Dec 2018
  • Colin Slater — present this proposal for the SDM  to DMLT in this meeting.    
    
    

Colin Slater

Simon Krughoff

Michael Wood-Vasey

Robert Lupton

The DESC SRD are more stringent that those of the project.

• The DESC Science Requirements Document
• DM-9046 - Getting issue details... STATUS
• PST-68 - Getting issue details... STATUS

Notes

• Robert Lupton and Leanne Guy — formulate a response to the PST on DESC photometric calibration requirements PST-68 - Getting issue details... STATUS  
• Robert Lupton Update the SST on plans for FGCM and Metacal 22 Feb 2019 Update: 2021-08-31: This was satisfied as part of the algorithms workshop, 2019
• Robert Lupton Update the PST on plans for FGCM and Metacal 29 Mar 2019 Update: 2021-08-31: This was satisfied as part of the algorithms workshop, 2019

Michael Wood-Vasey

Leanne Guy

We are planning to have a first version of LDM-639 available at the end of November. At the last F2F meeting we made a start on:

• Science pipelines performance requirements flowdown:
• LSP & DAX use cases: Catalog data query use cases
  

We will review these and plan work for S19

Notes:

• Gregory Dubois-Felsmann — organise a 1 day working meeting to complete the DAX/LSP use cases in the week of 10 December 07 Dec 2018
• Michael Wood-Vasey — organise a day in January to compete the flowdown of the performance requirements 21 Dec 2018
  • Performance requirements were reviewed at the DM-SST vF2F meeting on 2021-02-22. For now, no further performance requirements will be flowed down.
•  Leanne Guy — review pipelines characterization reports and provide summary update to PST focusing on any significant changes, improvements or degradations in scientific performance
• Leanne Guy Michael Wood-Vasey Define a set of "prerequisite states", e.g. "a data release has been produced", or "images are available to run pipelines" 01 Feb 2019 

• Jim: When writing a test script, one needs to identify how to do something at a detailed level, but back off a bit in detail for the spec itself so it's not too tied to details that might change.
• Jeff Carlin will start working on flowdown from requirements to test specs, and Andres Plazas will start on this for calibration tasks.
  

Melissa Graham

Leanne Guy

Discussion of SST S19 projects and priorities. See proposed list of SST studies page

• Melissa Graham will present (via BJ) 3 SST studies for S19 (click here to see slides)
• Zeljko Ivezic : Moving variable star: a bias in motion due to flux=const.? (see science case for moving variable stars above)
  
  

We should provide an ~ 10 min presentation on the plans for the SST at DMLT.

Notes:

• Three proposed studies accepted and will be carried out in S19
• Proposed studies on 'AP on real data at scale' and 'jointcal astrometry' are part of the regular pipelines development and are not SST studies and so were removed
• 'QA' is not an SST study - also removed

• Melissa Graham and Leanne Guy — put a plan in place for each 21 Dec 2018 
• Leanne Guy — present these SST projects to the PST - explain what we can do vs what we promised we would do

Leanne Guy

Review all open and (over)due tickets on DM Science

Review all open LIT tickets of interest to DM Science