Page History

All

• Chris Waters shares a presentation "Introduction to cp_verify"
  
  • Slides: cp_verify overview-VV.20220314.pdf
  • Example notebook: cp_verify_exampleNotebook-20220315.pdf
  • DMTN-101: https://dmtn-101.lsst.io/
  • Measure metrics on a calibration residual image
  • Do the calibration product corrections do what it is expected to do
  • DMTN-101 defines the metrics
    • Several of the metrics are likely to partially cover OSS requirements, however, there was not yet a dedicated effort so far to check the traceability. The system is sufficiently modular that it should be straightforward to add more metrics.
  • Used both for checking the afternoon calibrations, and for certifying data for the set of master calibration products
  • Currently implements: bias, dark, flat, brighter-fatter.
    • Zero-residual tests for crosstalk, linearity, and fringes in development
  • Would like to have the cp_verify metrics available in a database. Currently being ouput as yaml files.
  • It does correctly catch bad data
  • Run as part of OCPS. Observers can run a script that runs cp_pipe and cp_verify. Trying to condense the information into a summary report, e.g., sending warning messages to LOVE
  • Ongoing work:
    • Documentation
    • Visualization is a challenge (e.g., full focal plane mosaics). This has overlap with FAFF charge as well. Visualization use cases include both pixel-level data and representation of scalar fields.
      • Relationship with analysis_drp and code is afw (see cam geom utils) for drawing sensor boundaries. Ask Sophie Reed what is the plan.
      • DRP plotting sprint is happening through Wednesday this week
  • Do you see these notebooks as a debugging tool during development, or a more long term tool like a  "report" or diagnostic tool when warning appear?
    • Initially for development, Alysha might(?) be looking at them?
  • Chris is effectively serving as calibrations control board. In the future, might have a board with more people, e.g., with a specific commissioning needs in mind. For example, Erik has started to engage in this process, running the notebooks that Chris wrote. We are verifying, but in some cases, want to go deeper. In some cases, might want to go back and inspect even after the calibrations have been applied.
  • In practical terms of how the certification is done, is the long-term goal to fully automate the certification based on scalar metric values, or will there always been a need for visual inspection?
    • In practice, running a notebook and doing visual inspection as part of certification. In principle, there is a cell that checks all the metric values against specs, but still like to have visual inspection for assurance.
    • Used parametrized notebooks to generate report as notebook automatically
    • Already, Chris is doing some iteration of the analysis and labeling versions of the analysis as collection names
  • Calibrations change over time. How is this handled?
    • We should be able to preemptively make calibrations to capture trends
    • The bookkeeping is done for you with the butler. Each calibration has a valid time interval (datetime).
  • Metric tracking
    • Can only track if have some inputs. Don't want 10 points on your dashboard for the 10 iterations that were run on some day.
    • Processing streams get validated against daily calibration data
    • Daily calibrations get validated against current master calibration products
    • Can certify into different collections.

Leanne Guy

• Spring 2022 epic 

  Jira
  server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-33385

• Backlog epic: 

  Jira
  server JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-29525

• Progress on conversion to parquet

• Create MatchedCatalogTableMeasurement base class (DM-33980) 
  • https://github.com/lsst/faro/pull/126
  • Also want to add columns to isolatedStarAssociation config (branch in pipe_task), pull request made. 
• Update wPerp so it uses less memory (https://github.com/lsst/faro/pull/122 , DM-33389) 

Jeffrey Carlin Keith Bechtol

• RC2/DC2 reprocessing epic :

  Jira
  server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-26911

  • w_2021_40 RC2:  

    Jira
    server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-32248

  • w_2021_44 DC2 :

    Jira
    server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-32391

• AuxTel - Erik to give update
• AP/DiffIm

Colin Slater 

Leanne Guy  

Leanne Guy

Next meeting 22 Mar 2022