Mondays 12pm - 12:50pm ET

Yusra's Zoom: https://princeton.zoom.us/my/yusra

Postponed from Feb 7.

Attendees:

Yusra AlSayyad , Eli Rykoff , Fred Moolekamp , Nate Lust , Jim Bosch , Angelo Fausti , Unknown User (brendal4) , Sophie Reed , Lauren MacArthur , Dan Taranu , Christopher Waters , Colin Slater , Jeffrey Carlin , Clare Saunders , Arun Kannawadi , Joshua Meyers , Lee Kelvin , Leanne Guy 

Agenda:

• Announcements:
  • We can review w08 too! 
• Review Action items from last week
• Processing Status
• Review HSC RC2 rerun w_2022_04
  • What was noteworthy in this rerun? How did processing go?
    • w04: DM-33402
      • BB: How to tell faro not to run on the narrow-bands?
        • Jeffrey Carlin  Make faro not attempt running on narrow-bands. 16 Mar 2022 
      • slow because of filesystem overload and issues.
      • wPerp needed to be run on lsst-devl
    • w08: DM-33741
      • tracts 9697/9615 wPerp succeeded on batch nodes!
      • step5 has tasks that take a lot of memory.
      • New image difference error
        • Yusra AlSayyad look into new diffim error
    • Expected changes
      • matchedCatalogsTract changed, skyCorr run as of w50, new skyFrames 
      • scarlet lite was turned on for w08!!!
        • There is a config option to switch back.

• • What changed in the metrics?
    • Big change in repeatabilty metrics between w04 and w08. What do we do?
      • Run w04 faro on w08 outputs?  Unknown User (brendal4) Jeffrey Carlin 
      • We expected scarlet lite to reduce runtime and memory. File ticket for adapting what ap_pipe uses. Label PairCoding. 
      • Disentangling effect of sky frames and scarlet lite on w08 Fred Moolekamp 
    • YA: see DM-33863 for pair coding ticket

• • What do we expect from w_2022_08? (Tagged Feb 16)
    • What new metric or plot can we expect next time?
    • Option 2b
• Review DC2
  • w_2022_03
  • • gen3:
    • gen2: 
    • Gen3 Pipeline for DP0.2 (backport-v23 label)
• AOB
  • SR: The 70th mag stars are gone! 
  • DT: Main diff in scarlet lite in DC2 is the bright and saturated (just below triggering the flag) stars used to be classified as extended and now they're not.  The correct thing to do is to reconcile the stars used in the metrics before and after the matching change. 
  • LM: Gen3 pipelines are now scientifically equivalent to Gen2!!!!!! Yay!!!!!!
  • JFB: which means that we can stop the gen2 reruns. 
  • We need to port over the quick checks at the end of ci_hsc_gen2 to ci_hsc_gen3

Action Items

Sky Frames w04 vs w08

Comparing 'HSC/runs/RC2/w_2022_04/DM-33402-b' against 'HSC/runs/RC2/w_2022_08/DM-33741':

deepCoadd_calexp:

deepCoadd: