Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

 

Location

Browser

Room System

Phone Dial-in

https://bluejeans.com/690803707

or 

https://ls.st/rsv


  1. Dial: 199.48.152.152 or bjn.vc
  2. Enter Meeting ID: 690803707 -or- use the pairing code

Dial-in numbers:

  • +1 408 740 7256
  • +1 888 240 2560 (US Toll Free)
  • +1 408 317 9253 (Alternate Number)

Meeting ID: 690803707

Attendees


Regrets

Metric tracking dashboards

Rubin science pipelines weekly change log and  Github repo: https://github.com/lsst-dm/lsst_git_changelog

Status of jenkins jobs and slack channle for notifications:  #dmj-s_verify_drp_metrics slack channel 

Discussion items

ItemWhoPre-meeting notesMinutes
News, announcements and task review

All



CI status, bugs, issues of the week

All
  • verify_drp_metrics CI job, 
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-31777


  • Exciting week in CI!
  • Several tickets resolved to get CI going again 
    • Jointcal ticket causing breakage  -fixed by adding a check to skip a dataid if the calibration information is not there. 
    • Issues with changes to inherit from drp obs_subaru pipelines. We inherited configuration.  Led to breakages related to DiffIm. DRP were seeing this but ignoring it as it was an edge case. Our finite field size exacerbated this. 
    • Ellipticity metrics not in the definition file 
    • .. lots of changes. Jeff has sorted them all out!
  • Nightly still broken - need a nightly run to check we are running again. 

Data processing campaigns  

Auxtel - watch #rubinobs-sitcom-surveys for updates

  • Porting AuxTel pipelines to Gen3, configs need change.  
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-32141
    • g,r,i, data to get a colour locus. 
    • Spec  run in dec to got data tor atm transmis - fr 
    • g data taken in 2 runs - 1 sq. deg.
    • go back to do a gri run in january 
    • Have data, not reduced.
  • Reduction of data on NCSA - still not up on antu. 
    • Ingested at NCSA, calibs built, incl. g-band flats. 
    • xtalk produced but not validated. 
    • Expect to have a full set of calibs. 
  • Will move to antu after one run at NCSA .

AP DiffIm (DECam data) 

  • No news

AP DiffIm (AuxTel)

  • Wait to do that until prompt production is available in ~June 2022.


DP0.2

Faro for DP0.2

  • SQuaSH Dashboard for DP0.2 processing?
  • Plan to compute metrics for pilot runs
Faro Development status 
  • Fall 2021 epic
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-30748
  • Backlog epic: 
    Jira
    serverJIRA
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-29525
  • Where are we on parquet conversion?
    • Implementation of forced source catalog reviewed. 
      • not applying external ph/as calibrations. Want to apply them but will be costly to look up external calibs for every object. 
      • In the next few months, this will be done as part of creating the tables. 
      • For now we will not look up and apply external calibs. 
      • No ability to compare to an external ref catalog - compare frc src to object table and object table to external 
  • TEx metrics implementation
    • Jeff + Erik review this week. 
    • Template for additional metrics using parquet. 
  • Documentation merged! Daily build: https://pipelines.lsst.io/v/daily/modules/lsst.faro/
  • Peter progressed on AA1 metric.
  • Sophie re-implemented stellar locus metric. We should review the underpinnings of the new implementation once stable. In porting the code, Sophie has identified things that can be done better. 
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-28144
  •  Colin to ask about capturing ideas for improvement to the stellar locus algorithm   
AOB

Potential co-working session ideas here



List of tasks (Confluence)

Task report
pages97681924
labelsmeeting-notes