Mondays 12pm - 12:50pm EST

Yusra's Zoom: https://princeton.zoom.us/my/yusra

Attendees: Arun, Chris (Waters), Dan, Fred, Hsin-Fang, Jeff, Jim (Bosch), Josh, Lauren, Leanne, Lee, Morgan, Nate, Robert, Sophie, Yusra

Agenda:

  • Review Action items from last week
  • Review w_2021_18
    • What was noteworthy in this rerun?
    • What changed? Annotate
    • What do we expect from w_2021_22? 
      • New features:
        • debiased HSM moments
        • parquet ForcedPhotTable
      • Changes toward Gen2-Gen3 parity:
        • DRP Gen2 to Gen3 Pipeline Migration Coordination
        • a few lingering SFM differences revealed in w14 RC2 runs: see DM-29881 - Getting issue details... STATUS &  DM-30030 - Getting issue details... STATUS
          • LM: How do account for padding in raw vs jointcal wcs.  HSC default is 250. default default is 0. There are a bunch of places where padding is definded "pixelMargin" should be < 250 padding default. Proposal: set all the defaults to 250. Not a big deal for DC2. Might be for DECam.  
          • Want to be able to run faro on both gen2 and gen3 reruns of w_2021_18. Monika ran faro on the Gen3 repo. Haven't run the the gen2-gen3 converted repo yet.

          • Clare noticed a satellite trail is missing in the gen3 version that's still in the gen2 version. Get patch number from Clare: 9813, i-band, patch, '4,8'=76 

            • Generate a sky frames that are more similar to the ones that NAOJ are using (created DM-31401 - Getting issue details... STATUS ). Lauren MacArthur
            • Copy Lauren's Gen2 SkyFrames to the Gen3 repo (awaits decisions to be made on and execution of DM-31401 - Getting issue details... STATUS  which may moot this task if we opt to wait for post-Gen2) Jim Bosch
      • What new metric can we expect next time
  • Review DC2
    • w_2021_16:
      • DT: Surprising OK. We were missing configs so we definitely won't have parity between gen2-gen3 w16.  w20 SHOULD have the same parity that HSC does. 
        • Ran faro the gen3 w16 and started the gen2 w16. Noticed some patches are missing. Need to check if there's anything missing. 
        • There's a script that Simon wrote: "makeJobDoc" which will make the json. 
        • DT: how are we going to Manage all the dashboards. 
      • LM: If you see differences between gen2 and gen3 is probably configs. 
        • Go through dashboards and see if we can prune any or mark them legacy
    • Gen3 Pipeline for DP0.2
  • AOB


Action Items

DescriptionDue dateAssigneeTask appears on
  • Add a plot with fakes stats to the dashboard. Sophie Reed 
04 Sep 2020Sophie ReedDRP Metrics Monitoring 2020-08-07
  • Sophie to add field in metric definition to hold thresholds. DM-43364 - Getting issue details... STATUS : We need to talk about this when Sophie is back!
 DRP Metrics Monitoring 2024-04-22
  • Sophie to add field in metric definition to hold thresholds. DM-43364 - Getting issue details... STATUS
DRP Metrics Monitoring 2024-03-18
  • Clare: add analyzeMatchedVisitsCore to drp_pipe step8
 DRP Metrics Monitoring 2023-06-26
  • Sophie: make a new list for outstanding analysis_drp plots that require moving, send to Jim
 DRP Metrics Monitoring 2023-06-26
  • turn catchFailures on in calibrate. Add flag to indicate that deblender failed because PSF is bad. 
 DRP Metrics Monitoring 2022-10-31
  • Yusra AlSayyad Eric's account was deleted; we need to make sure he has all his logs. 
 Yusra AlSayyadDRP Metrics Monitoring 2021-06-14
  • Arun Kannawadi Modify rho stats in pipe_analysis  to use debiased moments (see  DM-30751 - Getting issue details... STATUS ). 
 Arun KannawadiDRP Metrics Monitoring 2021-04-19
Arun KannawadiDRP Metrics Monitoring 2021-03-01
  • Yusra AlSayyad Do a rerun with w50 PS1 refcat and one with shrunk refcat errors. 
 Yusra AlSayyadDRP Metrics Monitoring 2021-01-04
  • Jeffrey Carlin Add an absolute astrometry match-to-refcat metric to dashboard  DM-34153 - Getting issue details... STATUS
Jeffrey CarlinDRP Metrics Monitoring 2021-01-04