Page History

All

Computing clusters / data facilities

• Rubin construction effort at NCSA will be shutting down 15 August 2022. Machines will be shipped out. A few people from NCSA will continue into LSST Operations. We will want to migrate work. Datasets will be migrated in a planned manner
• SLAC is looking to be ready at end of July. SLAC will do full reprocessing at HSC PDR3. SLAC USDF will support commissioning activities. Not exactly clear when AuxTel data processing will transition to USDF.
  • USDF has understanding that it is responsible for commissioning, including AuxTel
• Data Previews at IDF
• Prompt Processing Prototype at IDF. Mainly for development purposes with intent to switch to using USDF.
• Relationship with Antu

•  Colin Slater Follow up with Fritz to check status of USDF readiness for AuxTel data 12 Apr 2022 

•  Most metric values changed between 30 and 31 March.
  
• Questions of exactly what changed and how would we know. Star selection? Measurements of photometry? We currently don't have quick ways of diagnosing.

Leanne Guy

• Spring 2022 epic 

  Jira
  server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-33385

• Backlog epic: 

  Jira
  server JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-29525

• Progress on conversion to parquet

• Status of DM pipeline tickets
  • Bug in the application of zeropoints to source catalogs resolved

    Jira
    server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-34019

  • Feature: Photometric and astrometric corrections applied to source catalogs

    Jira
    server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-33959

• Performance metrics to support AuxTel imaging campaigns
  
  • Example diagnostics from image quality team
  • More ideas for single-visit performance metrics starting to collect in FAFF context
  • Comparison with metadata and pixel-level image data? In a commissioning context, there are specific drivers for automated analyses that compare quantities from source catalogs and other sources

Jeffrey Carlin Keith Bechtol

• RC2/DC2 reprocessing epic :

  Jira
  server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-26911

  • w_2021_40 RC2:  

    Jira
    server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-32248

  • w_2021_44 DC2 :

    Jira
    server JIRA columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key DM-32391

• AuxTel  (Erik Dennihy )
• AP/DiffIm

• Erik developed a workflow - a ticket is written prior to each run, lays out scheduler conditions, etc. Followup ticket in SITCOm prj. to track the details - source collections, etc. 
  • Example ticket of imaging survey observing requests -

    Jira
    server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key CAP-868

  • Example ticket of imaging survey data processing -

    Jira
    server JIRA serverId 9da94fb6-5771-303d-a785-1b6c5ab0f2d2 key SITCOM-253

Colin Slater  

Leanne Guy

Next meeting 12 Apr 2022 

Faro work planning meeting is scheduled for next week.  Please add your thoughts to 2022-04-12 Science Verification - Planning Meeting Agenda and Meeting notes so that we can make most efficient use of the meeting time