Date

Location

Browser

Room System

Phone Dial-in

https://bluejeans.com/690803707

or 

https://ls.st/rsv


  1. Dial: 199.48.152.152 or bjn.vc
  2. Enter Meeting ID: 690803707 -or- use the pairing code

Dial-in numbers:

  • +1 408 740 7256
  • +1 888 240 2560 (US Toll Free)
  • +1 408 317 9253 (Alternate Number)

Meeting ID: 690803707

Attendees

Regrets


Metric Tracking Dashboard

URL:

Discussion items

ItemWhoPre-meeting notes
News, announcements and task review

All

  • Does Focus Friday apply for SV work, including #rubinobs-science-verification Slack channel?
  • Camera team has been developing a similar software package as faro for camera verification purposes. This is being posted to Gen 3 (ongoing work by Eric Charles) as https://github.com/lsst-camera-dh/eotask-gen3/
    • There is also a collection of pages organizing the presentation of static plots in a hierarchical fashion: https://srs.slac.stanford.edu/BOT_EO_Reports/
    • eotask-gen3 is persisting some of the results as astropy tables in a format that can be used to easily create plots of values for each amp across the focal plane (~3K measurements).
  • Focus Friday:
    • Commissioning currently does not have Quiet Friday. NOIRLab has second-Friday no meetings. Guidelines for Focus Friday at this link.
    • RSV is a mixed channel, DM. Camera, Commissioning folk. 
    • We are not a support team/channel - support considerations do not apply
    • Proposal: No regularly scheduled meeting. One-off meetings can be OK – judgement call. Co-work sessions doing development are welcome. Slack channel is open for business. DM members observing Quiet Friday don't need to feel obligated to respond. "@" – use judiciously and don't chase people down, only "@" people already in the channel. Don't '@' a dm person in a dm channel. Mixed channels are different and the same rules cannot be easily applied.
  • EOTest
    • Goal - to do reverification of the camera on the summit. Also cp_verify package. cp_verify / eotest - what are the req.s dcos they map to. No clear answer. Implications for OSS reqs - characterization of the science pixels. Overlap with eotest_g3/cpp_verify.
    • lots of good work in the repo and similar to faro. 
    • static plots but better organized. 
    • Not using lsst.verify measurements but astropy tables. e.g to easily present all1 16 amp measurements from all rafts.
    • CS: want to answer, is this bias that we made aceptable, or did something go wrong. We have requirements to produce a bias/flat/dark - so we need ot verify them.  Not instrument/sensor  perf
    • KB: should follow up to understand
      • Keith Bechtol to make a ticket to better understand mapping of these camera and calibration products characterization efforts to verification documents and the focus of these efforts. Discuss with the SCLT

Bugs, issues, topics, etc of the week

All
  • New dataset status
  • Changes to dispatch_verify,
  • Handling of NaN 
  • Jeff and Sophie Reed have started discussing the relationship between faro and analysis_drp visualization tools (see  DM-29753 - Getting issue details... STATUS ). Should we (a) broaden the scope of the discussion, and (b) invite Sophie to present about her plotting tools (and configurable actions) at an upcoming SV meeting?
  • rc2_subset: Jenkins changes made, KT approved. Merge this afternoon and will run tonight. 
  • ... but ... cannot yet dispatch with NaN. This is the real blocker now. 
  • Time to run nightly is exepceted to be long - we will do some first runs and time it. If it takes to long, look at getting more h/w
  • PF found a bug  in the call signature for analysis contexts using parquet table inputs related to changed in our base class. Will updates to yaml files in repo be automatically propagated to nightly CI?  KSK thinks yes. 
  • Jeff will give us a demo at the first co-work session. 
  • JC: analysis_drp uses configurable actions for the new plotting package. Wanted to make sure we are on the same page about persisting measurements, metadata, etc. 
    • Jeffrey Carlin to coordinate with Sophie about a time to have technical discussion about plotting tools and potential integration with faro, potentially a co-working session

Reprocessing status and metrics review  

  • Nightly CI with new rc2_subset
  • w_2021_34 RC2
  • w_2021_36 DC2
    • From DRP QA meeting - bad astrometry and photometry metrics for gen2to3 as compared with native gen3 processing – see  DM-31762 - Getting issue details... STATUS
    • Probably external calibrations, afterburner, check that faro is picking up the correct inputs. 
  • Do we want a dedicated dashboard nightly CI metrics for faro?  Yes 
Development status 
  • Fall 2021 epic DM-30748 - Getting issue details... STATUS
  • Backlog epic:  DM-29525 - Getting issue details... STATUS
  • Jeff to focus on matched source conversion to parquet tables
  • Using Object tables  DM-31459 - Getting issue details... STATUS
  • Astrometry –  wait for Object tables in parquet DM-31673 - Getting issue details... STATUS
  • faro documentation: DM-25839 - Getting issue details... STATUS
    • Substantial comment is providing guidance on the naming of the metrics and association with verification package – for now, this should no block development and release of faro documentation. We will need to return to the topic of the verification packages as this is
      • Keith Bechtol Schedule a time to have focused discussion on verification package, potentially next status meeting
AOBPoll setup for a regular faro development co-working meeting. It would be great if we could get responses by Thursday the 23rd of September. 
Link to poll: http://whenisgood.net/faroCowoking

Co-work session is scheduled for ..... 11:00 PDT Wednesday

  • Leanne Guy  get Aime to set up a calendar invitation  


List of tasks (Confluence)

DescriptionDue dateAssigneeTask appears on
  • Leanne Guy to talk to Science Pipelines (Yusra) about when do this transfer  
19 Oct 2021Leanne Guy2021-09-28 Science Metric Development Agenda and Meeting notes
  • Leanne Guy arrange to disucss at a future meeting if there are metrics from PDR3 & this paper that we might want to include in faro.   
26 Oct 2021Leanne Guy2021-08-31 Science Metric Development Agenda and Meeting notes
  • Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
30 Nov 2021 2021-11-09 Science Metric Development Agenda and Meeting notes
  • Colin Slater to make a preliminary draft agenda for a workshop to clarify visualization use cases for science verification and validation
Colin Slater2022-04-19 Science Metric Development Agenda and Meeting notes
  • Jeffrey Carlin to review metric specification package organization and the relationship to formal requirements documents
Jeffrey Carlin2022-04-19 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol Schedule a time to have focused discussion on verification package, potentially next status meeting
Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes
  • Keith Bechtol to make a ticket to better understand mapping of these camera and calibration products characterization efforts to verification documents and the focus of these efforts. Discuss with the SCLT
Keith Bechtol2021-09-14 Science Metric Development Agenda and Meeting notes