Mondays 12PT (3 - 3:50pm ET)

Yusra's Zoom:


Yusra, Lee, Erfan, Clare, Eli, Orion, Jim, Sophie, Jen, and several others Dan forgot to note (sorry)



  • Meeting recorder - Dan (last 6 meetings were:  Erfan, Lee, Robert, Arun, Clare) 
  • Announcements
  • Action items from last time:
    • Sophie: make a new list for outstanding analysis_drp plots that require moving, send to Jim (Sophie sent it to Colin instead, and will tell us where it is soon) 
    • Clare: add analyzeMatchedVisitsCore to step8. Done!
    • Clare: add the proper motion correction to the metrics.
    • Lee: There was a mystery that 1 data id. One of the failures (in detectAndMeasureDiaSources visit=36180, detector=34.) we are seeing here with w_2023_27 are not seen in w_2023_25 on Tiger (DM-39770, step 4 errors
  • Processing Status
    • Processing of w_2023_32 RC2 (Orion)
      • first with QBB
      • same old errors on subtractImages (see Jira ticket), no other notable erros
  • Review the w_2023_32 rerun (Orion):
    • Recall what we expected: Recall: expected changes include QBB, matchedVisitMetrics run during step8, rubin-env7. 
    • Recall 2023 history:
      • w03: Issues with using finalize characterize PSFs downstream. 
      • w07: ip_diffim. Cannot find plugin (fixed on DM-38209) run with ticket branch. Issues with finalizeCharacterize downstream gone.
      • w11: GBDES on.  detectAndMeasure segfaults (fixed with hours to spare for w15) 
      • w15: pseudo- quasi-random skyObject placement (DM-23781), source selectors use isPrimary (DM-39141)
      • w19: Parallax and PM on (DM-37943), astrometric match improved (DM-38808), cleared mask plan of the template. (DM-38901)
      • w23: RA/Dec columns renamed
      • w27: No major pipeline changes
      • w32: Use GAIA DR3 refcat in GBDES
    • Small wPerp changes, but not alarming
    • Even smaller changes in fractional size residuals and sky object fluxes
    • Unclear why Gaia DR3 switch didn't improve astrometry much
      • Clare: Remember there are no proper motions in metrics (yet)
      • Eli: There's a big gap in 9813 in Gaia DR2, why no improvement w/DR3?
  • What pipeline changes do we expect for w_2023_35? (Note w_2023_35 was tagged 11 days ago.  w_2023_39 will be tagged Sept 27)
    • Amp-to-amp offset switched to general one
    • AA and AB might be in for w_2023_39
  • Show and tell:
  • resource usage from PDR2 (through Step3):
    • Memory Usage: PDR2_step3_2left_log.pdf
      • Yusra: Most dataIds for most tasks below nominal 4GB limit; some outliers beyond
      • Eli: Still some memory leaks
    • Runtime: PDR2_runtime_as_of_step3_2_left_log.pdf
      • Eli: explained why finalizeCharacterization takes ~100x longer than each characterize
      • Jim: finalizeCharacterization being slower than makeWarp is interesting; means PSF model fitting is slow
      • Yusra: jointcal outlier lower than before; Clare's outlier rejection is working
  • AOB:
    • Regular nightly step processing of the RC2 subset is now being run at the USDF via cron. Output collections are persisted in /repo/main with name formats akin to: HSC/runs/RC2_subset/d_2023_09_10.
      • Metrics from these nightly runs are also pushed to the RC2 subset Chronograf dashboard. Use of the Flux language to generate queries encouraged. Edits welcome.
      • No special tags/collections for weeklies (yet)
    • Next meeting is next week!

Action Items

DescriptionDue dateAssigneeTask appears on
  • Add a plot with fakes stats to the dashboard. Sophie Reed 
04 Sep 2020Sophie ReedDRP Metrics Monitoring 2020-08-07
  • Clare: add analyzeMatchedVisitsCore to drp_pipe step8
DRP Metrics Monitoring 2023-06-26
  • Sophie: make a new list for outstanding analysis_drp plots that require moving, send to Jim
DRP Metrics Monitoring 2023-06-26
  • turn catchFailures on in calibrate. Add flag to indicate that deblender failed because PSF is bad. 
DRP Metrics Monitoring 2022-10-31
  • Yusra AlSayyad Eric's account was deleted; we need to make sure he has all his logs. 
Yusra AlSayyadDRP Metrics Monitoring 2021-06-14
  • Arun Kannawadi Modify rho stats in pipe_analysis  to use debiased moments (see  DM-30751 - Getting issue details... STATUS ). 
Arun KannawadiDRP Metrics Monitoring 2021-04-19
Arun KannawadiDRP Metrics Monitoring 2021-03-01
  • Yusra AlSayyad Do a rerun with w50 PS1 refcat and one with shrunk refcat errors. 
Yusra AlSayyadDRP Metrics Monitoring 2021-01-04
  • Jeffrey Carlin Add an absolute astrometry match-to-refcat metric to dashboard  DM-34153 - Getting issue details... STATUS
Jeffrey CarlinDRP Metrics Monitoring 2021-01-04