You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Date

 

Location

Zoom alias : https://ls.st/rsv

Zoom:  https://noirlab-edu.zoom.us/j/96120781994?pwd=bCtpT3Q3b2RsU1ZBRUFaSnUrZXo3Zz09#success

Attendees


Regrets


Metric tracking dashboards

Rubin science pipelines weekly change log and  Github repo: https://github.com/lsst-dm/lsst_git_changelog

Status of jenkins jobs and slack channle for notifications:  #dmj-s_verify_drp_metrics slack channel 

Discussion items

ItemWhoPre-meeting notesMinutes
News, announcements and task review

All





CI status, bugs, issues of the week

All

 

Faro Development status 
  • Spring 2022 epic  DM-33385 - Getting issue details... STATUS
  • Backlog epic:  DM-29525 - Getting issue details... STATUS
  • Progress on conversion to parquet
  • Remaining infrastructure in faro to support adding many more metrics
    • Relationship with visualization
      • Visualization capability within faro
      • Connection to analysis_drp – understanding the relationship between these two software packages
      • Infrastructure for visualizing ensembles of metric values / statistics / correlations
    • Diagnostic capability
      • Partly addressed with shelf
      • Other tooling for understanding an unexpected metric value – related to visualization above
    • Metric naming convention and metric package specifications
    • Review of documentation
    • Review of unit tests / coverage
    • List of metrics to be implemented / review of metric specifications
    • Any additional analysis contexts needed?
    • Persisting metrics as lsst.verify.Measurement objects
      • Performance question when scaling up to thousands of metric values
  • Rough example of PA1 using MatchedCatalogTableMeasurement (Git branch tickets/DM-32613
  • DM-33959 has been bumped up the priority list for pipelines. We're expecting a fix to land in w15. DM-31855 is essentially a duplicate so this has been marked as 'won't fix. This would apply astrometric and and photometric calibrations to source parquet tables.
    • Would a second matching step need to run to make table of matched sources?

Data processing campaigns  

  • RC2/DC2 reprocessing epic : DM-26911 - Getting issue details... STATUS
    • w_2021_40 RC2:   DM-32248 - Getting issue details... STATUS
    • w_2021_44 DC2 : DM-32391 - Getting issue details... STATUS
  • AuxTel - Erik to give update
  • AP/DiffIm
  • Prior issues with AuxTel photometric calibration issues now understood, a bug to the calibrated fluxes written to parquet tables was discovered and a fix is under development (see DM-34019 - Getting issue details... STATUS ). For now, we can still calibrate fluxes using AFW tables and photoCalib object. Calibration is good but shows some systematics in scatter. 
  • I need to generate/register a skymap for the different fields in order perform co-addition, is there a way to do this outside of repo/main to allow for experimentation? 
    • butler register-skymap --config-file /path/to/file /path/to/repo (could experiment on rc2subset, example config in obs_lsst )
  • Are there any single-visit/detector level metrics are implemented now in Faro that are worth running on the afw tables we have already generated?
DP0.2


AOB

Potential co-working session ideas here

Next meeting   


List of tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Colin Slater to make a preliminary draft agenda for a workshop to clarify visualization use cases for science verification and validation
Colin Slater2022-04-19 Science Metric Development Agenda and Meeting notes
  • Jeffrey Carlin to review metric specification package organization and the relationship to formal requirements documents
Jeffrey Carlin2022-04-19 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol Schedule a time to have focused discussion on verification package, potentially next status meeting
Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol to make a ticket to better understand mapping of these camera and calibration products characterization efforts to verification documents and the focus of these efforts. Discuss with the SCLT
Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes






  • No labels