2019-08-23 DM SST Agenda and Meeting notes

Leanne Guy

• Dave Monet has started working for LSST at the 20% level. His time will be shared with DM and Commissioning validation work. He will focus on the astrometry. He is currently still on-boarding and will start by looking at the HSC reprocessed data.
• Algorithms workshop is now at SLAC 3 – 5 December 2019 
• If you are interested in attending a meeting at DM's expense, please be sure to express your interest in advance on the DM Conferences and Workshops pages  

• The DM Conferences and Workshops pages has been considered advisory in the past, the statement now is that no TR will be accepted unless it has been previously announced on this page. Wil is finding it difficult to coordinate/approve TRs  without knowing everyone who is interested. 
• Suggestion that we add a column to this table to indicate by when a decision is needed. In the past, people have not received feedback sufficiently in advance to make (cost effective) travel plans.

• Leanne Guy Ensure a mechanism to provide timely feedback on requests to attend meetings and conferences. 09 Aug 2019 

Colin Slater

Melissa Graham

Michael Wood-Vasey

Leanne Guy

Keith Bechtol

Several SST members ran sessions at the PCW, we will review the conclusions from the breakouts and future work for the SST

• Crowded fields (Colin Slater)
• DIA (Michael Wood-Vasey)
• Photo-z (Melissa Graham) 
• Science Validation (Leanne Guy, Keith Bechtol)

Crowded Fields

• In early 2019, the PST asked the SMWLV SC 1) what are the science cases for studying the galactic plane and 2) should the PST instruct the project to observe and process crowded fields more completely.
• SWLV said yes and delivered supporting science cases. 
• Jim Bosch and Robert Lupton put together a confluence page summarizing the current baseline for processing crowded fields ("best-effort"), and proposed direction forward 
• This was presented to representatives of the SMWLV SC at the PCW last week.
• One key difficulty has been around explaining why we cannot 'just run DAOPhot'. This is more of an integration problem with the rest of the LSST Stack, we want to build on top of our other data products,  to produce a consistent set of data products, and DAOPhot is not as automated as we need. 
• SC reps at the PCW seemed to be understanding 
• Historically, crowded fields processing has not been assigned the same priority as other science, it was assigned a lower priority as it was considered hard. It is probably in the top 5 hard things we need to do, but no harder than other hard things. It has now been assigned equivalent priority. 
• Estimations of scope, person-years, have not been done.  
• Jim Bosch will write a DMTN, 

DIA workshop 

• Lots of really good discussions and questions requiring further study and investigation came out of this workshop, e.g 
  • How many images needed for a good DCR template, what is the quality metric 
  • Real/Bogus training and everything considered to be hard, e.g. shift and stack, light echos, comets, etc - what needs to be in the real/bogus training 
  • Strong engagement from the AGN community, concerns about DCR corrected template made from a year of AGN observations.
  • AGN, Variable stars, Strong Lensing - are the DIA or Direct Image products better for the science? What are the validation tests?
  • DESC want surface brightness  at location of suspected transient - is this int
  • ... and many more interesting ideas that Michael Wood-Vasey will write-up in  a summary document 

Photo-z

• Summary notes from the photo-z session
• Melissa Graham proposed the following workflow:
  • Generating Photo-z (Beyond Year 1)
    • Community provides input on regions (spec-z surveys) to be used for training.
    • LSST generates DR photometry for a ‘pre-release’ training-set region (e.g., 10%).
    • Community trains the algorithm, builds the model.
    • LSST applies the model to full DR and estimates pz.
    • LSST & Community does science validation of the photo-z.
  • If issues with the LSST photometry are revealed, iteration would be needed.
• Michael Wood-Vasey is uneasy with this approach,  but there should be something built by DM that is independent of the Community? It is an Ops deliverable that depends on unpaid work
• Several updates made during and post the meeting to the linked summary notes above. 

Leanne Guy

Eric Bellm

Major changes are being proposed to the solar system processing and to the solar system data products in the DPDD. These have been discussed in detail with the SSSC already and are presented in 

The goal of this discussion is to ensure that the SST has reviewed this proposal, provided feedback and reached a consensus before moving to LCR

• Eric has read is and is broadly OK, with everything.

• K-T and  Mario did a detailed arch review and the arch team are happy

• It was developed with the SSSC so they are on board 

• Mario has stated that some stuff is not in the RFC that he wants to understand a little more, eg. 

• Mario wants dir of fast moving stuff from the trailed source - can you use adaptive moments now - wants this now. old time lines no longer valid

• Collin points out that details are missing about nightly changing MPC database. Colin Slater  will follow up with Mario Juric

• Colin Slater and add a note to the RFC that information about nightly changing database is lacking to inform the dm-ccb  26 Aug 2019 

Deadline for comments from SST people on RFC is COB27 Aug 2019 . 

Leanne Guy

DM-13098 - Getting issue details... STATUS

DM-14790 - Getting issue details... STATUS

DM-16716 - Getting issue details... STATUS

DM-16553 - Getting issue details... STATUS

Leanne Guy