Mondays 12pm - 12:50pm ET

Yusra's Zoom:

Postponed from Nov 29. 



  • Announcements:
  • Review Action items from last week
  • Processing Status
  • Review HSC RC2 rerun w_2021_46
    • What was noteworthy in this rerun?
      • Gen2: Still in progress. 
      • Gen3: DM-32563
        • Went smoothly!
        • wPerp still needs to be run on lsst-devl by hand. 
        • JFB: We expect this to be fixed by parquet tables. 
        • LG: We expect this to be wrapped up imminently.
    • What changed? Annotate
      • stellar_locus_width_wPerp has gone up – not sure why. Leanne Guy suggests that this may be related to the behavior seen in CI Gen3 where the stellar locus fluctuated nightly, but it's not possible that this could be because of something in Science Pipelines (changed are not made on a nightly basis, so this would be impossible). It may not be possible to trust the numbers coming out of faro right now. We also need to investigate why the dates for the stellar locus only go back to October.
    • What do we expect from w_2021_50 IN 2 DAYS (last RC2 of the year)?
      • Processing changes:
      • Changes toward Gen2-Gen3 parity:
        • LAM would like a quick discussion on the last few comments on  DM-30284 - Getting issue details... STATUS
        • In skyCorr there are very small expected differences.
        • In directWarp the differences are more significant. In Gen3, the sky correction is not getting applied correctly and is not updating the calexp. After correcting this the major differences are gone. There are still small differences which are probably explained by differences in FGCM. It looks like the root issue is that a reference to the maskedImage is getting changed, but the maskedImage is not changed. JFB suggests that the problem is that the the maskedImage was not deep-copied.
      • What new metric can we expect next time 
        • DC2:  DM-32624 (the secret bank of DC2 configs)
        • RC2: 
          • check that skyCorr is being applied during makeWarp. w50
  • Review DC2
    • w_2021_44
    • Why is the astrometry metric so bad for DC2? The photometry metric is better than what we see from HSC. Eli says that jointcal will not help astrometry because the simulation has steps between detectors that do not follow the model of smooth variations over the field of view expected by jointcal or gbdes.
  • Processing schedule for the next 6 weeks:
  • AOB:

Action Items

DescriptionDue dateAssigneeTask appears on
  • Add a plot with fakes stats to the dashboard. Sophie Reed 
04 Sep 2020Sophie ReedDRP Metrics Monitoring 2020-08-07
  • Sophie to add field in metric definition to hold thresholds. DM-43364 - Getting issue details... STATUS
DRP Metrics Monitoring 2024-03-18
  • Sophie: make a new list for outstanding analysis_drp plots that require moving, send to Jim
DRP Metrics Monitoring 2023-06-26
  • Clare: add analyzeMatchedVisitsCore to drp_pipe step8
DRP Metrics Monitoring 2023-06-26
  • turn catchFailures on in calibrate. Add flag to indicate that deblender failed because PSF is bad. 
DRP Metrics Monitoring 2022-10-31
  • Yusra AlSayyad Eric's account was deleted; we need to make sure he has all his logs. 
Yusra AlSayyadDRP Metrics Monitoring 2021-06-14
  • Arun Kannawadi Modify rho stats in pipe_analysis  to use debiased moments (see  DM-30751 - Getting issue details... STATUS ). 
Arun KannawadiDRP Metrics Monitoring 2021-04-19
Arun KannawadiDRP Metrics Monitoring 2021-03-01
  • Yusra AlSayyad Do a rerun with w50 PS1 refcat and one with shrunk refcat errors. 
Yusra AlSayyadDRP Metrics Monitoring 2021-01-04
  • Jeffrey Carlin Add an absolute astrometry match-to-refcat metric to dashboard  DM-34153 - Getting issue details... STATUS
Jeffrey CarlinDRP Metrics Monitoring 2021-01-04