2pm Pacific Time

Zoom: https://washington.zoom.us/j/98846655020

attending:

regrets

Topics for discussion:

  • Project updates (Eric Bellm , Ian Sullivan ):
    • ops rehearsal this week.  Bullets below
  • Auxtel processing status (all):
    • As usual
  • Ops Rehearsal (all):
  • Priorities from now-ComCam (Eric Bellm ):
  • Pipelines Infrastructure (John Parejko, Krzysztof Findeisen ):
    • KF: cut a daily for PP that sidesteps the problems that showed up in the "final weekly".   Configured service to aggressively clear local repo, but we're still seeing pods dying for as-yet-unknown reasons.
    • John: put in deblending on diffim and improved dipole centroiding, which we hope will improve the DIASource centroids (and make the cutouts center on the actual DIASource, which we should verify).  More questions to dig into post-rehearsal.  Note that current dipole centroid outputs will look rather different. 
    • Eric: added # of PP diaSources to chronograph, also working on times square notebook
  • Precursor processing & Campaign Management ( Kenneth Herner , Erin Howard):
    • nothing ops-rehearsal relevant. 
  • Satellites (Meredith Rawls ):
    • following up fakes completeness change after the deblending merge; nothing obvious. 
    • streak masking now out entirely in non-fakes AP because of calibrateImage, but it's still in the AP fakes pipeline as well as DRP.  Clare has a ticket for putting into diffim detectAndMeasure
  • Image differencing algorithms, DCR  ( Bruno Sanchez , Ian Sullivan ):
    • Ian: made some nice plots of diffim performance, which missed the pipelines freeze but will be there for the future.
  • alert distribution (Brianna Smart , Eric Bellm ): 
    • Bri: Alert distribution is working, but the timeout checks are too aggressive, so some visits won't send alerts.  The fix is ready to go but would need a new daily.
  • ML (Nima Sedaghat Harshit Rai , Eric Bellm ):
    • ML is off for ComCam but not for LATISS
    • Eric: got pipelines to touch the GPU
  • Solar-system processing (Ari Heinze, Kurlander Jake , Mario Juric ):
    • out today
  • Review CI (https://usdf-rsp-dev.slac.stanford.edu/chronograf/):
    • lots of movement due to deblending and dipole changes
    • big increase in detection runtime for HSC  (12→ 30+ sec) after dipole change in a couple of data IDs after 3/28
  • Review outstanding action items
  • QA meeting (May):
    • Ops rehearsal debrief
  • AOB



Action Items

DescriptionDue dateAssigneeTask appears on
  • Eric Bellm write up retention policy and sizing for APDB  
17 Jul 2023Eric BellmAP Pipeline Meeting, 2023-06-26
  • Eric Bellm dig into alert serialization test in ap_association and ticket ways to improve it  
11 Sep 2023Eric BellmAP Pipeline Meeting, 2023-08-21