DRP Metrics Monitoring 2023-10-09

Mondays 12PT (3 - 3:50pm ET)

Yusra's Zoom: https://princeton.zoom.us/my/yusra

Attendees:

Regrets:

Agenda:

• Meeting recorder: Jim (last 6 meetings were:  Clare, Dan, Erfan, Lee, Robert, Arun) 

• Announcements
• Action items from last time:
  • Sophie sent list of outstanding analysis_drp plots that require moving...or did she?!  Jim and Colin do not remember, but Sophie says she has the receipts.
  • New action: put it somewhere public (didn't catch where Yusra suggested).
• Processing Status
  • Processing of w_2023_39 RC2 (Orion)
• Review the w_2023_39 rerun:
  • Recall what we expected:
    • MAYBE AA and AB
    • Eli may change the scale size scatter computation and cut. ( DM-40668 - Getting issue details... STATUS )
      • Did not make it for _39 (still needs to go into review).
    • scarlet lite as a standalone package AND the fix to conditionally skip sources that don't have enough bands.
      • Latter made it for _39, former did not (but is on main).
    • Updating the FGCM lookup table which we expect to change the photometric solution
      • Did not change the lookup table on main; we changed the logic instead.  Merged to main but did not make _39.
    • rho stats plots from analysis_tools are looking very similar to analysis_drp, so the latter is probably ready to be deleted.
  • How it went:
    • PanDA just got its own setup at USDF.  Many problems.
    • DM-41008 made things very slow and exacerbated PanDA issues.
      • Still trying to finish up step4.
      • Might need help coming up with workarounds/ticket branches needed to finish this off.
    • No other new pipeline errors.
    • Ran what analysis tasks we could with the state the processing got to.
      • No matched-visit metrics.
      • No obvious changes to coadd-based metrics.
    • Last DC2 run:
      • Got metrics from a few irrelevant tracts due to recent QG generation changes; need to filter those out.
      • No interesting changes.
  • Recall 2023 history:
    • w03: Issues with using finalize characterize PSFs downstream. 
    • w07: ip_diffim. Cannot find plugin (fixed on DM-38209) run with ticket branch. Issues with finalizeCharacterize downstream gone.
    • w11: GBDES on.  detectAndMeasure segfaults (fixed with hours to spare for w15) 
    • w15: quasi-random skyObject placement (DM-23781), source selectors use isPrimary (DM-39141)
    • w19: Parallax and PM on (DM-37943), astrometric match improved (DM-38808), cleared mask plan of the template. (DM-38901)
    • w23: RA/Dec columns renamed
    • w27: No major pipeline changes
    • w32: Use GAIA DR3 refcat in GBDES
    • w35: 
• Nightly rc2_subset runs.
  • Lee reports yPerp has been fluctuating more lately (since ~w39). Could not get Chronograph to show this live; something seems awry with the dashboard (link, screenshot below).
    • 
• What pipeline changes do we expect for w_2023_43?
  • Scaled-size scatter cuts
  • Reference-catalog matching plots need to get closed out.
  • Manifest checker: counts of quanta that failed and succeeded
  • scarlet lite as a standalone package 
  • FGCM logic change not lookup table
• PDR2 Tanaka-san plots (Sophie Reed )
  • https://docs.google.com/presentation/d/155Z_T0l2gMidyyWGF3L5EjSMVzY8t-DRiFva0t5_uf8/edit 
  • Expecting to see the shape-size fractional diff have the same sign for most/all tracts...
    • Not seeing it super clearly, but in GAMA in particular there appears to be a bias (with other fields biased the other way).
    • We do see some bad tracts that need closer investigation.
  • wPerp:
    • XMM looks a fair bit worse.  Reddening? (should be corrected to first order)  Metallicity?
    • Problems look more common at the edges of fields - incomplete tracts, maybe?  Especially true in offset as opposed to scatter.
  • sky objects
    • Edges of fields consistently have a different sign from the centers.  This may just be a (hard) plotting problem, not necessarily a problem in the processing.
    • One field away from the plane (HectoMap?) is a clear outlier.
  • YA: recall https://docs.google.com/presentation/d/1COMTFdoAh1SL2OSYVMTet8697Wg90cuA53w9lxx0X4M/edit#slide=id.g25ddfaaa75b_4_185
  • 
• Show and tell:
• AOB:

Action Items