Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ItemWhoPre-meeting notesMinutes
News, announcements and task review

All



CI status, bugs, issues of the week

All
  • verify_drp_metrics CI jobs
  • Check variation in metrics seen last week 


  • Fluctuation still being seen in several metrics - strongly suspect this is due to fixes made to make CI work again a few weeks ago. 
  • Fixes were made to the pipeline in in rc2_subset - https://github.com/lsst-dm/rc2_subset (pipelines directory). Was made to inherit as much as possible from obs_subaru. 
  • Jeffrey Carlin  will look into this.  
  • Nulls don't make it to influx so can't alert on these from influx
  • Setup some sort of sanity check of our outputs to alert on metrics not computed. 
  • We will use the same jenkins channel to send these alerts to. 
Faro Development status 
  • Fall 2021 epic
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-30748
  • Backlog epic: 
    Jira
    serverJIRA
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-29525
  • Progress on conversion to parquet
  • TeX conversions
  • KB: No updates on astrometry
  • JC & ED  looked at the TE1 metirc diff at the tract level. Were calculating from deep_coadd_ForcedSource tableand the commparison we should do is from deep_coadd_meas table
  • KB: how shoudl we know this and find the doc? 
  • JC: dug through the yaml policy defns for conveting to parquet.
  • CTS:  schema Browser https://dm.lsst.org/sdm_schemas/browser/
    • Units should be described in the schema browser 
    • CTS found bug in html conversopn p units are in the yaml fole for HSC 
      Jira
      serverJIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
      keyDM-32749

TEx metric conversions:

  • Changed the default to use deep_coadd_meas in the base classes. This has mostly fixed the differences seen in comparison with the parquet tables. Still seeing small differences.  Ready for internal team review.  
  • Will ask someone in pipelines to review the implementation of the TEx algorithm, once the internal code change review is done

PF: 

  • close to done with AA1 metric - needsthe filtering SNR/flag filtering to be updated to work with the parquet format.  
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-32611
  • mostly done with comparison with a complately external catalogue. PoC level. 
  • RHL- take care about problems with the outside catalogues
  • Data processing campaigns  
  • AuxTel data reduction is proceeding, currently tweaking PSFEX parameters with Merlin to handle both dense and sparse imaging fields. Next AuxTel run is Dec 6-9, we should have a chance to get another set of imaging data then. Should discuss benefits of adding r' filter of same field before it sets
  • AuxTel is shallower so some exposures cannot be processed out of the box due to fewer stars
  • What is the process to ask deep technical questions and process questions? What channels should be used for what? rubinobs-sitcom-surveys v rubinobs-science-verification
DP0.2

Faro for DP0.2

No news

AOB

Potential co-working session ideas here

JOR review tomorrow - some people will not be at cowork

Last meeting of 2021 on 14 December. Meet again in 18 January 2022

...