DRP Metrics Monitoring 2021-03-29

Mondays 12pm - 12:50pm EST

Yusra's Zoom: https://princeton.zoom.us/my/yusra

Attendees:

Agenda:

• Review Action items from last week
• Review w_2021_10 
  • What was noteworthy in this rerun?
    • Gen2
    • Gen3
  • What changed? Annotate
• What do we expect from w_2021_14? 
  • New features
  • Changes toward Gen2-Gen3 parity:
    • DRP Gen2 to Gen3 Pipeline Migration Coordination
  • What new metric can we expect next time
• Review DC2
  • Last successful rerun was w_2020_04.
  • MatchedVisitMetrics only present for u,g,z,y. All visits. What does the tract=3828^3829 do? 
    • Hacked validate.py to ignore instrument: u_report.txt,  g_report.txt, z_report.txt,   y_report.txt
    • Do we need metrics for a DC2 instrument? https://github.com/lsst/verify_metrics/tree/master/specs/validate_drp
  • Gen3 Pipeline for DP0.2
• AOB

Updated scarlet sky source selection: see  DM-29087 - Getting issue details... STATUS

•  looks much better, but still a positive bias for aperture fluxes

Small change for next weekly related to brighter-fatter correction: see  DM-29280 - Getting issue details... STATUS

Really hoping to get this in for gen2/gen3 parity up to & including SFP (awaiting review):  DM-28936 - Getting issue details... STATUS

Matching to refer catalogs now being done to Gaia for astrometry, e.g. https://lsst.ncsa.illinois.edu/~emorgan2/w_2021_10_qaplots/HSC-I/tract-9813/visit-1228/plot-v1228-matches_raCosDec-psfMagHist.png

Still seeing photometric differences at visit level between reruns...expected? (Eli?!), e.g. https://lsst.ncsa.illinois.edu/~emorgan2/w_2021_10_qaplots/HSC-I/tract-9813/visit-1228/compareVisit-v1228-diff_base_CircularApertureFlux_12_0-sky-gals.png

Action Items