AP Pipeline Meeting, 2023-03-06

2pm Pacific Time

Zoom: https://washington.zoom.us/j/98846655020

attending:

• Eric Bellm 
• Ian Sullivan 
• John Parejko 
• Ari Heinze 
• Krzysztof Findeisen 
• Erin Howard 
• Brianna Smart 
• Nima Sedaghat 
• Kenneth Herner 

regrets

Topics for discussion:

• Project updates (Eric Bellm , Ian Sullivan ):
  • lights back on at SLAC; TMA fuses
  • another schedule workshop in early April
  • JTM:
    • full agenda
    • 2023 DM All hands session at JTM - Monday 13th March 2023
    • add slides to lightning talk deck
    • hotel: everyone is on one giant hotel registration
      • double check your flights against your original google form submission to Yusra–let Yusra and/or Carol know if they differ
    • you will be picked up from the airport if you filed an approved travel report
      
      • Ian inquiring about +1s
    • if you have travel trouble, email chile admins (CChirino@lsst.org, #chile_admins)
• Pipelines Infrastructure (Krzysztof Findeisen , John Parejko ): 
  • no updates
  • Eric & John on RFC-906
    • CcdVisit and Visit in APDB biggest sticking point
      • CcdVisit has pipeline-computed quantities as RFC'd, so can't just go straight from metadata.  having our pipelines compute it seems reasonable
      • Visit more complex
      • We think we want to argue that we need/want them for analysis right now, figure out the detailed propagation once we have APDB & PPDB actually realized
• Precursor processing ( Kenneth Herner , Erin Howard ):
  • Erin: going to try running Saha Bulge on HTCondor
  • Ken: going to dig into
• Image differencing algorithms, DCR  ( Bruno Sanchez , Ian Sullivan ): 
  • Ian Sullivan filed a ticket to deal with edge and preconvolution issues DM-38247
    

• transinet (Nima Sedaghat, Eric Bellm):
  • Still working on model packages ticket.
  • Trying to access DC2 data in the cloud, working through some environment issues.
• alert distribution (Brianna Smart , Eric Bellm ):
  • Bri: up again, issue was with upstream strimzi?  Resyncing finally worked.
• Solar-system processing (Ari Heinze ):
  • Ari: thinking about inputs that make_tracklets doesn't require.  Needs Visit table information, wants to loop per image
  • trying to come up with a new name from heliolincc since this is different than Matt's initial 2d algorithm.  Eric mentioned that #dm-naming-things
• Review CI (https://chronograf-demo.lsst.codes/):
  • 20% slowdown on everything starting ~Feb. 20, remaining elevated
    
    • https://lsstc.slack.com/archives/C2B6X08LS/p1677715055591189 some discussion
    • K-T wanted us to move to long-log format, DM-38247 - Getting issue details... STATUS
      • Eric Bellm ticket long-log format 20 Mar 2023 
    • Jenkins running on google cloud
• Review outstanding action items
• QA meeting in April:
  • Ken says he could follow up on the crossmatching results of the switch to HSM shape
  • edge flags? (& vignetting)
  • off-chip centroids – JP thinks it would be good to dig into why first
  • RB scoring?  still too early, want to show it one of the large runs
  • Eric on detection thresholds/fakes forced photometry?
  • Discussion of AP QA needs in the future that Commissioning/LINCC might assist with
  • preconvolution – this still needs some digging in to understand the edge behavior
  • Bruno share his diffim status report
• AOB
  • PCW being held downtown Tucson this year!
  • no meeting next week, but a subset of folks will be still traveling the next week.  Meet?  Consensus is yes , there will be a meeting March 20th for those available.

Action Items