Logistics

Date , 10:00 PT

BlueJeans (note the new number): https://bluejeans.com/583102117

Attendees

Regrets

Weekly meeting of the DM-SST to discuss scientific aspects of the Data Management System

Discussion items


ItemWhoNotesConclusions and action items
Alerts Key NumbersMelissa Graham

Melissa has a proposed final drafts for the RFC and DMTN-102 for the alerts key numbers document:

https://confluence.lsstcorp.org/pages/viewpage.action?pageId=94765182

  • Reached final stages. DMTN-102. Checked with Eric.
  • SST should look at this draft, confirm it's complete and not incorrect. Next: send to some part of the Science Collaboration Chairs to check they're not missing something  
  • Eric Bellm Create ticket to add multiple estimates of alert packet size. Min/max, single-detection alerts vs long histories.
  • Eric Bellm Add reference in LDM-612 to this document.   
  • Gregory Dubois-Felsmann Melissa Graham Create ticket to work on RFC (e.g. how exactly to define OTT1). Melissa and Gregory will alert the SST when it's ready for SST comments.  


Treatment of cosmic rays

Simon Krughoff

Summary of the meeting held this week and next steps

  • DESC is ramping up DC2, involves "putting eyes on images"
  • They're investigating whether we are undermasking/overmasking/etc. Hard to do without the uninterpolated pixels.
  • Naive solution is to do one processing with interpolation turned on, one with interp turned off. Heavy-weight solution.
  • Better solution is to persist heavy footprints that contain the uninterpolated pixels, that could be swapped into the image on demand.
  • How do we get that work done? Robert "promised" it, but we need a formal route to make it happen.
  • Jim: Krzysztof is working on how we store data in exposures, should do it as part of that work. (Make exposure more like a container than a struct)
  • Robert G: Could we just save an intermediate image? It would be a faster route.
  • Michael: What does commissioning want?
  • Jim: Robert G's route is the quickest, should just do that.
  • Simon: If we're not making this Krzysztof's work, how do we do this? Jim: 2 story points, just need to make sure it doesn't get lost.
  • Jim Bosch will file a ticket to produce interpolation-diff image in processCcd — DM-17471 - Getting issue details... STATUS   
  • Jim Bosch Brings up the interpolation-diff image ticket at sprint planning.  
DM-19382 - Getting issue details... STATUS
  • MWV: still need a writeup, as evidenced by the confusion over what "mask" means.
  • Discussion about DESC effort vs. Commissioning effort.
    • Colin Slater Schedule discussion with Simon KrughoffLeanne Guy on commissioning tooling —
    • Tuesday commissioning meetings are probably best venue for discussing possible ways DM and com could collaborate on tooling. Informal discussion/check-in would be useful feedback.
    • Frequent requests from commissioning are searchable metadata (Gen3) and SQL access to catalog data products. Need to evaluate our plans for live access to catalogs during the night, and for comparable access during precursor work (like bootcamps).
  • JDS: bring up commissioning tooling needs to DMLT non-f2f if there's a proposal or any big hole
Overdue or undated DM Science Team tickets

Colin Slater

See list below - still 34 unreviewed and undated tickets
Open actions

Colin Slater



AOB



List of SST tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Robert Lupton Clarify the meaning of time in the object table. 1 sentence description in sdm_schemas, can link to a short DMTN.  Update 2022-02-09: Meeting to resolve this on 2022-02-21  
28 Feb 2022Robert Lupton2018-11-05 DM SST F2F Agenda and Meeting notes
  • Gregory Dubois-Felsmann check if SDM standardization is adequately represented in project documents, and whether DMTN-067 should be required.
31 Mar 2022Gregory Dubois-Felsmann2022-02-14 DM-SST Virtual F2F Agenda and Meeting notes
28 Feb 2023Leanne Guy2023-01-23 DM-SST Agenda and Meeting Notes
  • Leanne Guy talk to Steve R about presenting plans for the ShearObject table to PST and SciCollab chairs   
20 Mar 2023Leanne Guy2023-02-27 DM-SST Agenda and Meeting Notes
31 Mar 2023Jim Bosch2023-02-27 DM-SST Agenda and Meeting Notes
  • Leanne Guy  talk to Gregory Dubois-Felsmann to review the original intent of the AFS-related Portal requirements before deciding on a course of action  
29 May 2023Leanne Guy2023-05-01 DM-SST Focus Meeting - Brokers in Commissioning
  • Leanne Guy Prepare to consult the PST on the question of providing compressed PVIs for AP outputs, to cover the period before the data become available in a DR.  
02 Jun 2023Leanne Guy2023-03-27 DM-SST Agenda and Meeting Notes
  • Jim Bosch Incorporate 30-60 day period for raws on disk into the strawman proposal and present to KT  
26 Jun 2023Jim Bosch2023-05-08 DM-SST Agenda and Meeting Notes
  • Parker Fagrelius Patrick Ingraham  how long will it take to do a scan as described? No need to scan the whole WL range but will require additional points outside nominal lambda range.  
30 Jun 2023Parker Fagrelius2023-03-27 DM-SST Agenda and Meeting Notes
31 Jul 2023Colin Slater2023-07-10 DM-SST Agenda and Meeting Notes
  • Eli Rykoff , Leanne Guy  Develop a proposal for what calibration processing, hardware, data we actually need and what will be needed for DR1. This has implications for the ORR and for prioritisation of work in commissioning  
31 Jul 2023Eli Rykoff2023-01-30 DM-SST Agenda and Meeting Notes
  • Yusra AlSayyad will look to see if there is any effort to help on option 1  
28 Aug 2023Yusra AlSayyad2023-08-14 DM-SST Agenda and Meeting Notes
  • Jim Bosch  Provide a physical example of that a  up on cell table would look like fo the Colin Slater / DAX team to review  
31 Aug 2023Jim Bosch2023-02-27 DM-SST Agenda and Meeting Notes
  •  "What is the pathway to defining the data products that are required to meet DMS-REQ-0266" Jeffrey Carlin   
30 Nov 2023Jeffrey Carlin2023-10-23 DM-SST vF2F Agenda and Meeting Notes
30 Nov 2023Gregory Dubois-Felsmann2023-10-23 DM-SST vF2F Agenda and Meeting Notes
30 Nov 2023Leanne Guy2023-10-23 DM-SST vF2F Agenda and Meeting Notes
  • Jeffrey Carlin follow up with KT on DMS-REQ-0176 and DMS-REQ-0315 to update/disaggregate this for latest base/summit infrastructure split.  
30 Nov 2023Jeffrey Carlin2023-10-23 DM-SST vF2F Agenda and Meeting Notes


Overdue or Undated DM Science Team tickets

Key Summary T Created Updated Due Assignee Reporter P Status Resolution
Refresh

LIT tickets of interest to DM Science

T Key Summary Assignee Reporter P Status Resolution Created Updated Due
Refresh