DRP Metrics Monitoring 2021-09-13

Mondays 12pm - 12:50pm ET

Yusra's Zoom: https://princeton.zoom.us/my/yusra

Attendees: 

Agenda:

• Announcements:
• Review Action items from last week
• Review w_2021_34
  • What was noteworthy in this rerun?
    • Gen2
      • log outputs were being swallowed ( DM-31530 - Getting issue details... STATUS  fixed this, so won't be a problem for next run)
      • new LinAlgError coming from scarlet observed (see  DM-31477 - Getting issue details... STATUS ) and Fred Moolekamp alerted.
      • gen2/gen3 parity through SFM (no external calibrations) maintained

• • • Gen3
      • issue with step3 submission (tract ids were omitted). Resolved?
  • What changed? Annotate
  • What do we expect from w_2021_38? 
    • Changes toward Gen2-Gen3 parity:
      • Eli Rykoff has put in a significant fix towards gen2/gen3 parity ( DM-31505 - Getting issue details... STATUS )...fingers crossed.
      • It may be that we can't hope for parity with jointcal/fgcm without imposing a deterministic ordering of inputs in gen3 middleware, so  DM-31701 - Getting issue details... STATUS  was created.
    • What new metric can we expect next time
• Review DC2
  • w_2021_36
    • back to SFM parity   Can now use this run to probe any gen2/gen3 differences in vanilla coaddition
    • only processed tract 3829
    • an ArithmeticError was observed in scarlet,  DM-31713 - Getting issue details... STATUS  created and assigned to Fred Moolekamp to investigate.

• • Gen3 Pipeline for DP0.2
• AOB
  • Dashboard extravaganza?!  Dan Taranu and Lauren MacArthur have made updates to the dashboards and with the help of Unknown User (brendal4) and Simon Krughoff, we have dispatched with all the proper variables/timestamps set, so they actually seem to "make sense" (let's have a look https://chronograf-demo.lsst.codes/sources/2/dashboards?  Of interest are those titled:
    • DRP metrics monthly DC2 (Gen3/2to3, test-med-1)
    • DRP metrics monthly for DC2 (Gen2)
    • DRP metrics monthly Gen 2 (HSC RC2)

Action Items