(back to the list of all DM-SST meeting minutes)

Date & Time: 

2022-01-24, 11:00 PT

Location

BrowserPhone Dial-in

Short : ls.st/dmsst 

Zoom: https://noirlab-edu.zoom.us/j/97839121776?pwd=K1JPeUpSMXFvSXJSa2xORGkyVk5zdz09

Zoom Meeting ID: 978 3912 1776 
Zoom Password: 512314


If not joining audio from computer or mobile device, you may dial-in via phone:

    +1 253 215 8782 (US Toll) or +1 346 248 7799 (US Toll)

    Meeting ID: 978 3912 1776

    Password: 512314

    International numbers available: https://noirlab-edu.zoom.us/u/abyLUx8cga

Attendees

Regrets

Discussion items

 ​

ItemWhoPre-Meeting NotesNotes and  Action Items
Project/Science Updates

Leanne Guy

Welcome to 2022. First meeting of the year today is to catch up from 17 Jan MLK holiday. Next meeting is  

PST:

  • We have a new project scientist, Steve Ritz and a deputy Federica Bianco
  • PST web pages are being revamped: ls.st/pst
  • Minutes from meetings are at: PST Meetings
  • Calibration status talk given to PST by Robert on 12 Jan

  • Camera effects: 

SCOC phase 1 recommendations: 

  • LSST Document-38411  / ls.st/doc-38411 and a community post

  • Summarizes what was learnt from the community on the baseline cadence. Unhappiness has been successfully minimized

  • There are no dramatic chances  from the previous basline,but there are some specific questions, for example, do we want to get 2 visits in a pair in the same filter? how exactly is the main survey footprint defined?

  • A new set of cadence simulation will be coming over the next few months that will explore the remaining uncertainties in several aspects of the baseline cadence. 

  • Phase 2 report by end 2022, will enable all quantitative decisions about the baseline to be made and implemented. 
  • PST meetings link not available - Leanne to sort 
  • RHL - Camera - integration DM/Camera how do we transfer feature code from camera to DM  - need to decide how to put work on cam team to deliver the code that we can gen3-ify. 
    • non-linear xtalk correction code - who writes it
    • ...
    • how do we recertify - no DM code being run at SLAC. Mountain runnng uses camera code., where when, on mountain,  no DM code in camera testing .. 
    • KR very busy  (camera commissioning scientist). DM-Camera integration has a lot of open 
    • aaron, TJ, JC, SR - RHL 
    • CTS: Aaron's page - very interesting ... many new things. 
      • bootcamp  for anomolies 
      • merlin? 
      • need the long version - condense where we are now  ... 
      • define AR page to be all of it - need an LCR
    • GPDF -
      • xtalk sensor-senror / raft-raft? RHL: none
      • RHL: Convinved of NL in xtalk now 
    • Use vF2f to bing DM side up to speed 
      • RHL to wrk on the recertf
      • how do DM and camera work together
    • Education first - CTS? 


Gen3 middleware test plan

Leanne Guy 

  • Thanks to Austin, LDM-556 requirements are now in Jira.

PZ

Melissa Graham 

Last call for comments regarding the DM-SST response to the PZ LOR, I’ve drafted updates to DMTN-049 (branch tickets/DM-31945) and a series of Community Forum topic posts (and one thank-you message). Any/all would benefit from your review (and thanks Jim Bosch  for reviewing DMTN-049!).
Everything’s linked from  DM-31945 - Getting issue details... STATUS .

  • Final feedback ASAP to Melissa. 
  • Next step is to restart the virtual forums in a month or 2
Planning for 2022

Leanne Guy 

RHL: ComCam prob on sky early next year (nominally nov 2022) - need to be ready for processing large volumes data. 

    • HW at SLAC in June-ish - USDF will be supporting this. 
    • Push RC2 once /week. 
    • PDR2/3 once a month
    • Aim to demonstrate that reductions on PC data/results are good 
  • AuxTel data 
    • processing 1deg field /  gri this year.  Electro problems on the summit. 
  • CTS: clarify why ComCam on sky means want frequent HSC processing 
    • wants to demonstrate we can process real data
    • and use the same toolchain / people for the first ComCam data 
    • 600 ComCam data =  1 LSST field 
    • want to process 100 deg with ComCam
  • From Robert
    • USDF@SLAC is ramping up!  From Richard Dubois:
      • 500 k8s cores have arrived; to be installed shortly
      • 1000 Rome cores ordered - due in March
      • 5 PB disk ordered - due in Feb

We may be able to start using things as early as April.  Expect RSP and batch

  • JB: 
    • push frequent reprocessing / prople 
    • progress / bugs 
  • KB : +1 very important. More than about hardware. Training people, processes, exercising workflows.
  • EB: +1 concern: big RC2 reprocessing regularly. need to think about bringing this under a broad umbrella, so we don’t end up siloed and fractured
  • JB: year of switching data facilities for real, that is going to be disruptive. Going to be a lot of teaching people, going to take effort.
  • Revisit of LSE-79 (Commissioning Plan)
    • Campaign management in the sense of reprocessing coherent datasets in multiple ways.
    • Break down to well defined processing task. Define
  • KB: map from data acquisition / data taking, to one full chain of processing  through science verification. 
  • JB: automation of processing and QA effort - focus early on automation of both, maybe to the detriment of new features so that when we get to ComCam data so that then we can get back to feature development. Many people are split between both these. Middleware focus needed for automation. 
  • Focus on training USDF people
  • Many of the high-level planning / management tasks
  • Yusra: "yes please on translating goals into a crisp list"

MLG: 

  • data products related to detection efficiencies that we will provide - so that everyone does not try to do synthetic injection. MLG wants to pick this up 
  • Coordinate with SR / in-kind / commissioning effort
  • construction requirement to deliver efficiencies 
  • Synthetic Source Injection: two related LOIs, one on DiffIm  and one on DRP
  • KB to circulate list and provide a summary at a next meeting.  

MLG: 

  • DPDD - yes  we will address this year 
  • ticket on DPDD updates. 
AOB

Leanne Guy

Unless we have topics for next week, propose to cancel.




List of SST tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Robert Lupton Clarify the meaning of time in the object table. 1 sentence description in sdm_schemas, can link to a short DMTN.  Update 2022-02-09: Meeting to resolve this on 2022-02-21  
28 Feb 2022Robert Lupton2018-11-05 DM SST F2F Agenda and Meeting notes
  • Gregory Dubois-Felsmann check if SDM standardization is adequately represented in project documents, and whether DMTN-067 should be required.
31 Mar 2022Gregory Dubois-Felsmann2022-02-14 DM-SST Virtual F2F Agenda and Meeting notes
28 Feb 2023Leanne Guy2023-01-23 DM-SST Agenda and Meeting Notes
  • Leanne Guy talk to Steve R about presenting plans for the ShearObject table to PST and SciCollab chairs   
20 Mar 2023Leanne Guy2023-02-27 DM-SST Agenda and Meeting Notes
31 Mar 2023Jim Bosch2023-02-27 DM-SST Agenda and Meeting Notes
  • Leanne Guy  talk to Gregory Dubois-Felsmann to review the original intent of the AFS-related Portal requirements before deciding on a course of action  
29 May 2023Leanne Guy2023-05-01 DM-SST Focus Meeting - Brokers in Commissioning
  • Leanne Guy Prepare to consult the PST on the question of providing compressed PVIs for AP outputs, to cover the period before the data become available in a DR.  
02 Jun 2023Leanne Guy2023-03-27 DM-SST Agenda and Meeting Notes
  • Jim Bosch Incorporate 30-60 day period for raws on disk into the strawman proposal and present to KT  
26 Jun 2023Jim Bosch2023-05-08 DM-SST Agenda and Meeting Notes
  • Parker Fagrelius Patrick Ingraham  how long will it take to do a scan as described? No need to scan the whole WL range but will require additional points outside nominal lambda range.  
30 Jun 2023Parker Fagrelius2023-03-27 DM-SST Agenda and Meeting Notes
31 Jul 2023Colin Slater2023-07-10 DM-SST Agenda and Meeting Notes
  • Eli Rykoff , Leanne Guy  Develop a proposal for what calibration processing, hardware, data we actually need and what will be needed for DR1. This has implications for the ORR and for prioritisation of work in commissioning  
31 Jul 2023Eli Rykoff2023-01-30 DM-SST Agenda and Meeting Notes
  • Yusra AlSayyad will look to see if there is any effort to help on option 1  
28 Aug 2023Yusra AlSayyad2023-08-14 DM-SST Agenda and Meeting Notes
  • Jim Bosch  Provide a physical example of that a  up on cell table would look like fo the Colin Slater / DAX team to review  
31 Aug 2023Jim Bosch2023-02-27 DM-SST Agenda and Meeting Notes
  •  "What is the pathway to defining the data products that are required to meet DMS-REQ-0266" Jeffrey Carlin   
30 Nov 2023Jeffrey Carlin2023-10-23 DM-SST vF2F Agenda and Meeting Notes
30 Nov 2023Gregory Dubois-Felsmann2023-10-23 DM-SST vF2F Agenda and Meeting Notes
30 Nov 2023Leanne Guy2023-10-23 DM-SST vF2F Agenda and Meeting Notes
  • Jeffrey Carlin follow up with KT on DMS-REQ-0176 and DMS-REQ-0315 to update/disaggregate this for latest base/summit infrastructure split.  
30 Nov 2023Jeffrey Carlin2023-10-23 DM-SST vF2F Agenda and Meeting Notes
  • Jim Bosch Follow up on the possibility of investigating further the ability to process 2 collections in parallel.   
31 Jan 2024Jim Bosch2023-12-04 DM-SST Agenda and Meeting Notes
31 Jan 2024Jeffrey Carlin2023-12-04 DM-SST Agenda and Meeting Notes
Gregory Dubois-Felsmann2023-10-23 DM-SST vF2F Agenda and Meeting Notes