AP Pipeline Meeting, 2020-12-07

2pm Pacific Time

BlueJeans: https://bluejeans.com/426716450

attending:

• Eric Bellm
• Ian Sullivan
• Unknown User (cmorrison)
• Unknown User (gkovacs)
• Krzysztof Findeisen
• Kenneth Herner
• Meredith Rawls

regrets:

Topics for discussion:

• Gen 3 conversion (all):
  • Krzysztof Findeisen :
    • making progress on filterLabel
    • scripts needed to update ap_verify gen3 datasets need to be fixed.  repos still work at the moment though.

• Precursor processing (Meredith Rawls ):
  • has been working on gen3 calibs–can now start from scratch and ingest and build gen3 calibs for DECam.  Still finishing building the flats for 2015 but as soon as they are done can do full ap_pipe rerun.  May try pair coding on Weds.   Hopes to have this ready for Monday's QA meeting
  • holding off on Ian's crowded field run at Ian's request due to Lauren's tweak
• report from NCSA (Unknown User (emorganson)  + Unknown User (manninga) et al): 
  • not in today
• ap_association/SDM/fakes (Unknown User (cmorrison)):
  • most of the unit tests for the fakes are running–some problems with registering filters in unit tests, plus another bug.  chasing with Krzysztof
• Crowded field photometry (Ian Sullivan ):
  • nothing new–ap_pipe will finish in a day or two
  • starting a new reprocessing from the beginning to incorporate Lauren's refcat fix
  • starting writing text for the technote
• Image differencing (Unknown User (gkovacs) ):
  • closing out some long tickets this week–sent draft technote to Ian for review.  Organizing other work to put notebooks in reviews
• Preops project (Kenneth Herner  and all):
  • Now able to run notebooks on lsst-devl
• Review CI (https://chronograf-demo.lsst.codes/):
• Review outstanding action items

• AOB
  • next week: QA meeting
  • no meetings 12/21 and 12/28; resume 1/4/2021
  • Meredith: what's the parallelization situation in gen3?  Heard some discussion around HTCondor.  Current SLURM parallelization doesn't really use knowledge that gen3 could potentially use.  Chat with Lauren &/or Nate

Action Items