Logistics

Date  , 9:00 - 17:00 PT

Teleconference coordinates: https://bluejeans.com/507894076

Location:  University of Washingtonm ,The Petersen room

Attendees

Regrets

Agenda

TimeTopicChairNotes
9:00-9:10Welcome

Leanne Guy

  • Review agenda and plan for the day
  • Sign John's food sheet
9:10 - 10:30Science pipelines test plan

Leanne Guy

  • Collaboratively write the science pipelines test plan. The idea is to first plan the document structure together and then break out into smaller working groups .
  • Relevant documents:
    • Data Management System (DMS) Requirements: LSE-61
    • LSST Level 1 System Test Specification: LDM-533
    • LSST Level 2 System Test Specification: LDM-534
    • LSST Science Platform Test Specification: LDM-540
    • DM Science pipelines key performance metrics: LDM-502
10:30-11:00Break (Refreshments Provided)
11:00 - 13:00Science pipelines test planAll
12:30-13:30Lunch (Provided)
13:30-15:30Science pipelines test planAll
  • Collaboratively write the science pipelines test plan

Actions from the LSP working group:

  • Robert Gruendl to get access patterns from DES   
  • Leanne Guy get the access patterns for Gaia following DR1 and DR2  

15:30-16:00Break (Refreshments Provided)
16:00-16:30Review open items

Leanne Guy

  • Review all open tasks, RFCs and tickets & change requests of interest to DM-SST

  • Gregory Dubois-Felsmann to create a ticket with DMLT tag to reschedule the work to clarify interface between science platform and batch system. The previous action item dated 2017-08-25 'to convene meeting(s) to understand the state of and clarify LSP ↔ batch interface (maybe a WG?)' to be closed when complete   - Done: DM-14873 - Getting issue details... STATUS
  • Gregory Dubois-Felsmann to dig out existing SUIT use cases (LDM-244)and review the list with Leanne Guy for any that may be missing. This action supersedes the previous action assigned to Mario dated 2017-08-25  
  • Leanne Guy to schedule formal review of the Science Platform. This action supersedes the previous action assigned to Mario to do the same, dated 2017-07-28.  
  • Propose how to balance ProductOwner/SST Studies/Validation time for Science Leads (Leanne Guy, Wil O'Mullane). This action supersedes the previous same action assigned to Mario dated 2017-04-07  
  • Actions assigned to Mario dated 2017-04-07 to 1) to make sure we organize an effort to understand the feasibility of creating a specialized (stellar) crowded field data product and 2) formulate and post consensus description of the current crowded field policy have been superseded by the crowded fields study


 

16:30 - 17:00SST planning

Leanne Guy

  • Discussion and brainstorming of future SST projects and priorities. We should provide an ~ 10 min presentation on the plans for the SST during F18 at DMLT on 2018-05-24

17:00 -SST project updates

Colin Slater

  • Status update and report on current DM-SST projects. (if time permits)
17:00Close

Other possible agenda items:

WhoWhatDescription

Simon Krughoff

QA data products

It's becoming increasingly clear that we will need transformed, on disk, data products that are persistent and used in multiple QA contexts.

Examples are columnar representations of the catalog data, like parquet, and hierarchical image partitions for large scale and full sky image analysis. HiPS is an example for the latter.

Discussion could involve what data products to generate and persist, impact on sizing, and whether we should rethink what we consider as the primary data products.





Pre-Brainstorming for Future SST Projects:

WhatSuggested byDescription
detection efficiencies for transient rates analyses
Melissa Graham

Detection efficiencies for transient rates analyses: do we need injected fake sources? This is JIRA issue DM-12584. The official requirements on DM to produce detection efficiencies have been added to the text of that ticket, and the comments describe a path forward for this project. DM-SST should decide whether MLG's time should be spent on this.

variability characterization parameters

Melissa Graham

At some point, DM will have to select which variability characterization parameters (VCP) are included in the source catalogs (Prompt and DRP). This will depend on what is needed by the science community and by the mini-brokers, and what can be computationally supported by the DM system. Regarding the former, the TVS has a task force to evaluate which VCPs are needed for their science goals which should conclude around the end of 2018. It is anticipated that a similar selection process for VCPs as e.g., photo-z, will be needed.
documentation of photometric calibration

Melissa Graham

Produce user-facing documentation for LSST's photometric calibrations that are derived from Robert Lupton's documents: easy and hard.

jointcal astrometry

Robert Lupton


AP on real data at scale. 
Robert Lupton

QA
Robert Lupton



List of SST tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Robert Lupton Clarify the meaning of time in the object table. 1 sentence description in sdm_schemas, can link to a short DMTN.  Update 2022-02-09: Meeting to resolve this on 2022-02-21  
28 Feb 2022Robert Lupton2018-11-05 DM SST F2F Agenda and Meeting notes
  • Gregory Dubois-Felsmann check if SDM standardization is adequately represented in project documents, and whether DMTN-067 should be required.
31 Mar 2022Gregory Dubois-Felsmann2022-02-14 DM-SST Virtual F2F Agenda and Meeting notes
  • Steve Ritz Work with DM and Camera to develop plans for delivering a shutter position-vs-time model  
16 May 2022Steve Ritz2022-03-14 DM-SST Agenda and Meeting Notes
  • Gregory Dubois-Felsmann  / Leanne Guy Create a TN that outlines the science use cases and options for compressed PVIs from AP. Present the issue at DMLT VF2F and then the PST.   
13 Jun 2022Gregory Dubois-Felsmann2022-05-09 DM-SST Agenda and Meeting Notes
  • Eli Rykoff Report on what information DES used for their decision on using compression?  
25 Jul 2022Eli Rykoff2022-06-06 DM-SST VF2F Agenda and Meeting notes
  • Melissa Graham to draft a proposal for including pz in alert packets  
12 Sep 2022Melissa Graham2022-08-15 DM-SST Agenda and Meeting Notes
26 Sep 2022Steve Ritz2022-09-12 DM-SST Agenda and Meeting Notes
  • Gregory Dubois-Felsmann  start a technote to write down the details for science end user interface to SED corrections in catalogs  
31 Oct 2022Gregory Dubois-Felsmann2022-08-22 DM-SST Agenda and Meeting Notes
31 Dec 2022Leanne Guy2022-06-06 DM-SST VF2F Agenda and Meeting notes
28 Feb 2023Leanne Guy2023-01-23 DM-SST Agenda and Meeting Notes
  • Leanne Guy talk to Steve R about presenting plans for the ShearObject table to PST and SciCollab chairs   
20 Mar 2023Leanne Guy2023-02-27 DM-SST Agenda and Meeting Notes
31 Mar 2023Jim Bosch2023-02-27 DM-SST Agenda and Meeting Notes
  • Leanne Guy  talk to Gregory Dubois-Felsmann to review the original intent of the AFS-related Portal requirements before deciding on a course of action  
29 May 2023Leanne Guy2023-05-01 DM-SST Focus Meeting - Brokers in Commissioning
  • Leanne Guy Prepare to consult the PST on the question of providing compressed PVIs for AP outputs, to cover the period before the data become available in a DR.  
02 Jun 2023Leanne Guy2023-03-27 DM-SST Agenda and Meeting Notes
  • Jim Bosch Incorporate 30-60 day period for raws on disk into the strawman proposal and present to KT  
26 Jun 2023Jim Bosch2023-05-08 DM-SST Agenda and Meeting Notes
  • Parker Fagrelius Patrick Ingraham  how long will it take to do a scan as described? No need to scan the whole WL range but will require additional points outside nominal lambda range.  
30 Jun 2023Parker Fagrelius2023-03-27 DM-SST Agenda and Meeting Notes
31 Jul 2023Colin Slater2023-07-10 DM-SST Agenda and Meeting Notes

Open DM SST RFCs 

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh


Open DM SST LITs 

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh


Overdue DM SST JIRA Tickets

(JIRA DM tasks with label "dm-sst")

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh