AP Pipeline Meeting, 2022-05-23

2pm Pacific Time

Zoom: https://washington.zoom.us/j/98846655020

attending:

• Eric Bellm 

regrets

• Nima Sedaghat (UW AI symposium)

Topics for discussion:

• Project updates (Eric Bellm , Ian Sullivan ):
  • watch for email about virtual summit tour June 1 (will be recorded)
• Pipeline Performance sprint (Eric Bellm , John Parejko , Meredith Rawls ):
  • halfway through
  • Umbrella ticket: DM-34623 - Getting issue details... STATUS
  • made a AP-specific SFM pipeline; removing cmodel provided 30% decrease in execution time
  • well on our way to a DC2 CI dataset
  • MR: identified a larger 200+visit dataset for longer runs; now a tagged/chained collection.  Will run that and persist timing metrics.
  • JP: figured out how to turn off timing decorator so profiling will be interpretable; also trying statistical profiler (pyinstrument)
  • Eric thinking about how to use e.g. ELASTICC to make fake history for timing our timeseries features.  Could we have a pre-loaded apdb in CI?
• Pipelines Infrastructure (Krzysztof Findeisen , John Parejko ):
• Precursor processing (Meredith Rawls, Kenneth Herner ):
• Image differencing algorithms, DCR  ( Ian Sullivan ):
• transinet (Nima Sedaghat, Eric Bellm, John Parejko ):
  • out today
• alert distribution (Eric Bellm ):
  • no update.
• Review CI (https://chronograf-demo.lsst.codes/)
• Review outstanding action items
• QA meeting in June:
  
  • Performance sprint update
  • Report on diffim refactor
• AOB
  • No meeting next week due to the holiday.

Action Items