Date

Location

Browser

Room System

Phone Dial-in

https://bluejeans.com/690803707

or 

https://ls.st/rsv


  1. Dial: 199.48.152.152 or bjn.vc
  2. Enter Meeting ID: 690803707 -or- use the pairing code

Dial-in numbers:

  • +1 408 740 7256
  • +1 888 240 2560 (US Toll Free)
  • +1 408 317 9253 (Alternate Number)

Meeting ID: 690803707

Attendees

Regrets

Metric Tracking Dashboard


URL: 

Discussion items

ItemWhoPre-meeting notesNotes and  Action Items 
News, announcements and task review

Leanne Guy


  • sandbox notebook - there have been other requests for a sandbox. Simon will come back with a proposal next week
  • How to handle failure modes
    • Need CI dataset that is fit for purpose (highest priority)
    • There is distinction between values recorded lsst.verify.Measurement, what gets saved in json, and what gets recorded in chronograph
    • Idea of status codes as extras in lsst.verify.Measurement
    • Create a backlog Jira ticket for thinking about metric status codes?
  • faro dashboard for RC2
    • InfluxDB is distinct from chronograph visualization. Can create dashboard separate from persisting values in database.
    • Leanne to follow up with Yusra

Bugs, issues, topics, etc of the week

All


Reprocessing status and metrics review  

Jeffrey Carlin Keith Bechtol

Spreadsheet with plans/progress tracking.

Dashboards can be found here: https://chronograf-demo.lsst.codes/sources/2/dashboards

Monthly reprocessing: 

  • Need to replace validation_data_hsc_gen3  (3 bands, 2-3 visits/band).
  • New subset has 5 bands and 5-8 visits / band . Includes parquet tables.
  • Plan to update the nightly processing:  
    • Jeff to run faro on Simon's gen3_rc2_subset dataset to test and review outputs
    • Review outputs 
    • Iterate on dataset until happy
    • When happy  replace CI dataset. 
  • TE metrics & stellar locus metrics measure on coadds
  • Need to fix stellar locus metric
  • TE metrics use sources not deblended by scarlett. We can not run deblending by removing from the pipeline. 
    • CI specific pipeline definition to retarget deblending. 
    • Could also change the SNR to 3sigma (from 5sigma)
Development status 

Leanne Guy

  • Fall 2021 epic  DM-30748 - Getting issue details... STATUS
  • Backlog epic:  DM-29525 - Getting issue details... STATUS
  • DM-26214 - Getting issue details... STATUS   
    • New metrics should be added using the new parquet file approach 
    • Need to migrate existing metrics and deprecate the FITS file classes with  high priority. 
    • Make one ticket per context. Need to create an equivalent base class following the template and create the yml files to point to the base class. 
  • Add DM license preamble to all python files
    • DM-31135 - Getting issue details... STATUS
    • Started this for all the files touched so far
    • Create / improved doc strings
    • Homogenize run method signatures across all the measurement tasks. Suggest in general to inherit run method from CatalogMeasurementBaseTask base class, which can accept and pass keyword arguments. We should avoid passing dataIds to measurement tasks were possible. For example, we can use FilterLabel or list of FilterLabels instead of passing the dataIds if we just need to know which bands are being used.
    • Added most of the utility for loading external reference catalogs into the CatalogMeasurementBaseTask base class
    • Add unit tests for task code in faro
    • Use consistent DM class naming convention for base classes
      • DM-31136 - Getting issue details... STATUS
      • Started this
    • Development of reference catalog loading capability in faro with proper configuration options led to discovery and resolution of a bug in LoadReferenceCatalogTask. Thanks to Eli.
AOB

Leanne Guy

Next meeting  



List of tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Colin Slater to make a preliminary draft agenda for a workshop to clarify visualization use cases for science verification and validation
 Colin Slater2022-04-19 Science Metric Development Agenda and Meeting notes
  • Jeffrey Carlin to review metric specification package organization and the relationship to formal requirements documents
 Jeffrey Carlin2022-04-19 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol Schedule a time to have focused discussion on verification package, potentially next status meeting
 Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol to make a ticket to better understand mapping of these camera and calibration products characterization efforts to verification documents and the focus of these efforts. Discuss with the SCLT
 Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes