Versions Compared

Old Version 3

changes.mady.by.user Leanne Guy

Saved on

compared with

New Version Current

changes.mady.by.user Keith Bechtol

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ItemWhoPre-meeting notesMinutes
News, announcements and task review

All

Faro paper submitted to SPIE. Draft: dmtn-211.lsst.io . Acceptance notification from SPIE is 06 Apr 2022, so nothing more to do until then. 


  • Along with other changes in Rubin leadership, there will be a reorganization of SIT-Com. Plan by the AMCR.

CI status, bugs, issues of the week

All
  • CI job has not been running for a week. There is an issue with Jenkins. Jobs so slow that they don't finish. KT is on it.
  • The new weekly should have the fix for non-deterministic wiggles in metric values. Since dashboard hasn't been running, Jeff is running his own tests.
  • When source tables are combined into a single parquet table, they are combined in a random order. Eli implemented change to enforce ordering by detector so that repeatable. Before fix, FGCM was getting slightly different calibrations each run. The algorithms have an order dependence.
    • This gives us a sense of the systematic floor of the algorithms
  • Separate issues. Require 50 repeated measurements to compute photometric repeatability. Jeff will change configuration for the CI jobs to be 20. yaml configs.
Faro Development status 

Leanne Guy

  • Fall 2021 epic
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-30748
  • Backlog epic: 
    Jira
    serverJIRA
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-29525
  • Progress on conversion to parquet
  • Last week merged ticket so that refcat loader gives a single merged dataframe that includes refcat columns + proper motion corrected astrometry and color-term-corrected photometry 
  • Dan Taranu had developed a matcher. To use, we would do matching before the measurement task
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-32034
  • Jeff and Peter working on selectors. There is PR. Once this is merged we can finish converting metrics to use parquet format
    Jira
    serverJIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-32611
     
  • ATLAS REFCAT2 RFC. General support to move forward. Closes tomorrow. Already shared up in the desired format.

Data processing campaigns  

Jeffrey Carlin Keith Bechtol


DP0.2

Colin Slater 

Leanne Guy  

Faro for DP0.2


AOB

Leanne Guy

Potential co-working session ideas here

Next meeting   Homework task for everyone to take a look at tickets from the previous development epic and we'll do a big review of status + planning for new development cycle next week.


List of tasks (Confluence)

...