All
CI status, bugs, issues of the week
- verify_drp_metrics CI job,
- Exciting week in CI!
- Several tickets resolved to get CI going again
- Jointcal ticket causing breakage -fixed by adding a check to skip a dataid if the calibration information is not there.
- Issues with changes to inherit from drp obs_subaru pipelines. We inherited configuration. Led to breakages related to DiffIm. DRP were seeing this but ignoring it as it was an edge case. Our finite field size exacerbated this.
- Ellipticity metrics not in the definition file
- .. lots of changes. Jeff has sorted them all out!
- Nightly still broken - need a nightly run to check we are running again.
Data processing campaigns
- RC2/DC2 reprocessing epic :
- w_2021_40 RC2:
- w_2021_44 DC2 :
- w_2021_40 RC2:
- AuxTel
- AP DiffIm (DECam data)
Auxtel - watch #rubinobs-sitcom-surveys for updates
- Porting AuxTel pipelines to Gen3, configs need change.
- g,r,i, data to get a colour locus.
- Spec run in dec to got data tor atm transmis - fr
- g data taken in 2 runs - 1 sq. deg.
- go back to do a gri run in january
- Have data, not reduced.
- Reduction of data on NCSA - still not up on antu.
- Ingested at NCSA, calibs built, incl. g-band flats.
- xtalk produced but not validated.
- Expect to have a full set of calibs.
- Will move to antu after one run at NCSA .
AP DiffIm (DECam data)
- No news
AP DiffIm (AuxTel)
- Wait to do that until prompt production is available in ~June 2022.
Faro for DP0.2
- SQuaSH Dashboard for DP0.2 processing?
- Plan to compute metrics for pilot runs
- Fall 2021 epic
- Backlog epic:
- Where are we on parquet conversion?
- Implementation of forced source catalog reviewed.
- not applying external ph/as calibrations. Want to apply them but will be costly to look up external calibs for every object.
- In the next few months, this will be done as part of creating the tables.
- For now we will not look up and apply external calibs.
- No ability to compare to an external ref catalog - compare frc src to object table and object table to external
- Implementation of forced source catalog reviewed.
- TEx metrics implementation
- Jeff + Erik review this week.
- Template for additional metrics using parquet.
- Documentation merged! Daily build: https://pipelines.lsst.io/v/daily/modules/lsst.faro/
- Peter progressed on AA1 metric.
- Sophie re-implemented stellar locus metric. We should review the underpinnings of the new implementation once stable. In porting the code, Sophie has identified things that can be done better.
- Colin to ask about capturing ideas for improvement to the stellar locus algorithm
Potential co-working session ideas here
