All
CI status, bugs, issues of the week
- verify_drp_metrics CI jobs
- Check variation in metrics seen last week
- Fluctuation still being seen in several metrics - strongly suspect this is due to fixes made to make CI work again a few weeks ago.
- Fixes were made to the pipeline in in rc2_subset - https://github.com/lsst-dm/rc2_subset (pipelines directory). Was made to inherit as much as possible from obs_subaru.
- Jeffrey Carlin will look into this.
- Nulls don't make it to influx so can't alert on these from influx
- Setup some sort of sanity check of our outputs to alert on metrics not computed.
- We will use the same jenkins channel to send these alerts to.
- Fall 2021 epic
- Backlog epic:
- Progress on conversion to parquet
- TeX conversions
- KB: No updates on astrometry
- JC & ED looked at the TE1 metirc diff at the tract level. Were calculating from deep_coadd_ForcedSource tableand the commparison we should do is from deep_coadd_meas table
- KB: how shoudl we know this and find the doc?
- JC: dug through the yaml policy defns for conveting to parquet.
- CTS: schema Browser https://dm.lsst.org/sdm_schemas/browser/
- Units should be described in the schema browser
- CTS found bug in html conversopn p units are in the yaml fole for HSC
- Colin Slater and Leanne Guy to work out how to proceed
TEx metric conversions:
- Changed the default to use deep_coadd_meas in the base classes. This has mostly fixed the differences seen in comparison with the parquet tables. Still seeing small differences. Ready for internal team review.
- Will ask someone in pipelines to review the implementation of the TEx algorithm, once the internal code change review is done
PF:
- close to done with AA1 metric - needsthe filtering SNR/flag filtering to be updated to work with the parquet format.
- mostly done with comparison with a complately external catalogue. PoC level.
- RHL- take care about problems with the outside catalogues
- Data processing campaigns
- RC2/DC2 reprocessing epic :
- w_2021_40 RC2:
- w_2021_44 DC2 :
- w_2021_40 RC2:
- AuxTel
- AP/DiffIm
- AuxTel data reduction is proceeding, currently tweaking PSFEX parameters with Merlin to handle both dense and sparse imaging fields. Next AuxTel run is Dec 6-9, we should have a chance to get another set of imaging data then. Should discuss benefits of adding r' filter of same field before it sets
- AuxTel is shallower so some exposures cannot be processed out of the box due to fewer stars
- What is the process to ask deep technical questions and process questions? What channels should be used for what? rubinobs-sitcom-surveys v rubinobs-science-verification
- Keith Bechtol Leanne Guy Robert Lupton to take the question of how we run sitcom surveys to sclt
- Keith Bechtol Leanne Guy to clarify use of rubinobs-sitcom-surveys v rubinobs-science-verification
Faro for DP0.2
No news
Potential co-working session ideas here
JOR review tomorrow - some people will not be at cowork
Last meeting of 2021 on 14 December. Meet again in 18 January 2022
