Date

 

Location

Browser

Room System

Phone Dial-in

https://bluejeans.com/690803707

or 

https://ls.st/rsv


  1. Dial: 199.48.152.152 or bjn.vc
  2. Enter Meeting ID: 690803707 -or- use the pairing code

Dial-in numbers:

  • +1 408 740 7256
  • +1 888 240 2560 (US Toll Free)
  • +1 408 317 9253 (Alternate Number)

Meeting ID: 690803707

Attendees

Regrets

Metric tracking dashboards

Rubin science pipelines weekly change log and  Github repo: https://github.com/lsst-dm/lsst_git_changelog

Status of jenkins jobs and slack channle for notifications:  #dmj-s_verify_drp_metrics slack channel 

Discussion items

ItemWhoPre-meeting notesMinutes
News, announcements and task review

All

  • Task review 
  • SPIE faro paper 
  • Open topics from last week
    • Running faro on calibs / ISR verification
    • Metrics for near-realtime data quality analysis to support AuxTel imaging campaigns (we could ask at FAFF meeting later today)
  • Erik making progress on TEx metric
  • Documentation
    • PR (tickets/DM-25839)
  • For the TEx metric utility reimplementation, it is functionally working for TE3 and TE4, and now trying to understand numerical differences between the parquet table implementation and afw table implementation.
  • Documentation
    • rc2_subset is not suitable to use for CI testing. Not currently configured with tests, and so building the package will not be a useful CI test for faro. Current EUPS packages to run during Jenkins testing is still "lsst_distrib lsst_ci ci_hsc_gen3 ci_imsim"
  • Request that we clean up "test" annotations, Simon will delete.

Bugs, issues, topics, etc of the week

All

From Jeff on Thursday last week: Just a note to let RSV folks know that verify_drp_metrics has failed for two days in a row, and will continue to do so until Simon and I can get to it on Mon./Tues.. It’s related to a change we made that added DIA processing into the pipeline (and is thus failing due to the issue described in DM-31777), and we’re considering solutions (but limited on time, and I’ll be out of office tomorrow).

  • Current status?

Data processing campaigns 

  • AuxTel 
  • AP DiffIm 
  • Currently failing. Jeff is working on it. Seems like failing in faro step to make the matched catalogs. Not finding FGCM photocalibs. Not easy to test in part because it takes a few hours to get to the point where the failure occurs. Save the sqllite registry to another name. Then you can repeatedly run the steps afterwards.
    • Ask Jim dm-middleware-support the recommended way to do this
  • Merlin finished Gen2 config changes. Might be a one-liner. Propose to wait until Merlin does the last bit. All the thinking is done. The reduce-auxTel ticket is DM-32141.

Reprocessing status and metrics review  

Jeffrey Carlin Keith Bechtol

  • Nightly CI with new rc2_subset
  • RC2/DC2 reprocessing epic : DM-26911 - Getting issue details... STATUS
  • w_2021_38 RC2:   DM-31795 - Getting issue details... STATUS
  • w_2021_36 DC2 :  DM-31699 - Getting issue details... STATUS
  • From monthly DRP metrics. Need to push on getting all the metric calculations working with parquet tables. Metrics are not being calculated because they require too much memory. We should push
DP0.2

Colin Slater 

Leanne Guy  

Faro for DP0.2

  • Colin mentioned yesterday that doing some test processing runs on the IDF. Included in pipelines that are being run are the faro tasks. We should soon have metrics to start monitoring. We should set up a dashboard to monitor.
Development status 

Leanne Guy

  • Fall 2021 epic DM-30748 - Getting issue details... STATUS
  • Backlog epic:  DM-29525 - Getting issue details... STATUS
  • Peter has started working on AA1 metric implementation (DM-29368)
  • Open PR for the force source implementation (DM-31460)
  • Open topic for another day: metrics that require telemetry (EFD) or correlation with instrument coordinates
    • Might be more appropriate as an afterburner using database query than run within faro?
    • We might consider bending the rules to allow database queries within tasks
    • We could imagine building binned summary statistic in faro by tract, etc.
AOB

Leanne Guy

Potential co-working session ideas here



List of tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Colin Slater to make a preliminary draft agenda for a workshop to clarify visualization use cases for science verification and validation
 Colin Slater2022-04-19 Science Metric Development Agenda and Meeting notes
  • Jeffrey Carlin to review metric specification package organization and the relationship to formal requirements documents
 Jeffrey Carlin2022-04-19 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol Schedule a time to have focused discussion on verification package, potentially next status meeting
 Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol to make a ticket to better understand mapping of these camera and calibration products characterization efforts to verification documents and the focus of these efforts. Discuss with the SCLT
 Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes