Date
Location
Zoom alias : https://ls.st/rsv
Zoom: https://noirlab-edu.zoom.us/j/96120781994?pwd=bCtpT3Q3b2RsU1ZBRUFaSnUrZXo3Zz09#success
Attendees
Regrets
Useful links
Metric tracking dashboards
- DC2 and HSC RC2 monthly reprocessing (Gen3 and Gen2/3, faro): https://chronograf-demo.lsst.codes/sources/2/dashboards/75
- Nightly CI (Gen3, faro): https://chronograf-demo.lsst.codes/sources/2/dashboards/70
Rubin science pipelines weekly change log and Github repo: https://github.com/lsst-dm/lsst_git_changelog
Status of jenkins jobs and slack channle for notifications: #dmj-s_verify_drp_metrics slack channel
Discussion items
Item | Who | Pre-meeting notes | Minutes |
---|---|---|---|
News, announcements and task review | All | Welcome to the last meeting of 2021 Faro paper - our proposed paper has been accepted. Abstracts due to the project by 2021-12-20. SPIE abstract submission 2022-01-05
| Peter and Erik to be added to Project author list database. SPIE conference in Montreal. Requested a talk and paper. Slack channel will be open for business, but no meetings. |
CI status, bugs, issues of the week | All |
| Jeff did some more exploration as to why the metrics are changing nightly. Did 2 back-to-back rc2-subset. Differences in coadds. Subtracted the images from each other → pixel level differences (and obviously diff number of sources in the catalogs) FGCM zeropoints. Model written out by FGCM each time is different. Are the visit-level images are identical? Need to check this Seems to be some non-deterministic in the calibration. Not sure whether it is random aspect of the algorithm, or related to the order of inputs. Astrometry does not change but was see nightly fluctuations in photometric measured. TE1/2/Stellar locus are measured on coadds - observed nightly variation is symptomatic of non-determinism in the zeropoints since those are related to weights when building the coadd. Jeff will reach out to Lauren to coordinate. Jeff will check the config files that were saved in butler to see if the FGCM random seed is set (and to what) - DM-32451Getting issue details... STATUS |
Faro Development status | PF: Match-probabilistic folded into some of the parquet-based metrics. Refcat loader returns a NP array. Need to convert format. Faro is using the new RefCatLoader so we have some freedom to adapt it directly. Peter and Keith will look into this. Need to review selecters to filter the catalogues - e.g SNR and how we apply this → cowork | ||
Data processing campaigns |
|
| |
DP0.2 | Faro for DP0.2 | ||
AOB | Potential co-working session ideas here | Next meeting 18 January 2022 |
List of tasks (Confluence)
Description | Due date | Assignee | Task appears on |
---|---|---|---|
| 19 Oct 2021 | Leanne Guy | 2021-09-28 Science Metric Development Agenda and Meeting notes |
| 26 Oct 2021 | Leanne Guy | 2021-08-31 Science Metric Development Agenda and Meeting notes |
| 30 Nov 2021 | 2021-11-09 Science Metric Development Agenda and Meeting notes | |
| Colin Slater | 2022-04-19 Science Metric Development Agenda and Meeting notes | |
| Jeffrey Carlin | 2022-04-19 Science Metric Development Agenda and Meeting notes | |
| Keith Bechtol | 2021-09-14 Science Metric Development Agenda and Meeting notes | |
| Keith Bechtol | 2021-09-14 Science Metric Development Agenda and Meeting notes |