Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Logistics

Date  , 9:00 - 17:00 PT

Teleconference coordinates: https://bluejeans.com/507894076

Location:  University of Washingtonm ,The Petersen room

Attendees

Regrets

Agenda

TimeTopicChairNotes
9:00-9:10Welcome
  • Review agenda and plan for the day
  • Sign John's food sheet
9:10 - 10:30Science pipelines test plan
  • Collaboratively write the science pipelines test plan. The idea is to first plan the document structure together and then break out into smaller working groups .
  • Relevant documents:
    • Data Management System (DMS) Requirements: LSE-61
    • LSST Level 1 System Test Specification: LDM-533
    • LSST Level 2 System Test Specification: LDM-534
    • LSST Science Platform Test Specification: LDM-540
    • DM Science pipelines key performance metrics: LDM-502
10:30-11:00Break (Refreshments Provided)
11:00 - 13:00Science pipelines test planAll
12:30-13:30Lunch (Provided)
13:30-15:30Science pipelines test planAll
  • Collaboratively write the science pipelines test plan

Actions from the LSP working group:

  •  Robert Gruendl to get access patterns from DES   
  •  Leanne Guy get the access patterns for Gaia following DR1 and DR2  

15:30-16:00Break (Refreshments Provided)
16:00-16:30Review open items
  • Review all open tasks, RFCs and tickets & change requests of interest to DM-SST

  •  Gregory Dubois-Felsmann to create a ticket with DMLT tag to reschedule the work to clarify interface between science platform and batch system. The previous action item dated 2017-08-25 'to convene meeting(s) to understand the state of and clarify LSP ↔ batch interface (maybe a WG?)' to be closed when complete   - Done:
    Jira
    serverJIRA
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2
    keyDM-14873
  •  Gregory Dubois-Felsmann to dig out existing SUIT use cases (LDM-244)and review the list with Leanne Guy for any that may be missing. This action supersedes the previous action assigned to Mario dated 2017-08-25  
  •  Leanne Guy to schedule formal review of the Science Platform. This action supersedes the previous action assigned to Mario to do the same, dated 2017-07-28.  
  •   Propose how to balance ProductOwner/SST Studies/Validation time for Science Leads (Leanne GuyWil O'Mullane). This action supersedes the previous same action assigned to Mario dated 2017-04-07  
  • Actions assigned to Mario dated 2017-04-07 to 1) to make sure we organize an effort to understand the feasibility of creating a specialized (stellar) crowded field data product and 2) formulate and post consensus description of the current crowded field policy have been superseded by the crowded fields study


 

16:30 - 17:00SST planning
  • Discussion and brainstorming of future SST projects and priorities. We should provide an ~ 10 min presentation on the plans for the SST during F18 at DMLT on 2018-05-24

17:00 -SST project updates
  • Status update and report on current DM-SST projects. (if time permits)
17:00Close

Other possible agenda items:

WhoWhatDescription
QA data products

It's becoming increasingly clear that we will need transformed, on disk, data products that are persistent and used in multiple QA contexts.

Examples are columnar representations of the catalog data, like parquet, and hierarchical image partitions for large scale and full sky image analysis. HiPS is an example for the latter.

Discussion could involve what data products to generate and persist, impact on sizing, and whether we should rethink what we consider as the primary data products.





Pre-Brainstorming for Future SST Projects:

WhatSuggested byDescription
detection efficiencies for transient rates analyses

Detection efficiencies for transient rates analyses: do we need injected fake sources? This is JIRA issue DM-12584. The official requirements on DM to produce detection efficiencies have been added to the text of that ticket, and the comments describe a path forward for this project. DM-SST should decide whether MLG's time should be spent on this.

variability characterization parametersAt some point, DM will have to select which variability characterization parameters (VCP) are included in the source catalogs (Prompt and DRP). This will depend on what is needed by the science community and by the mini-brokers, and what can be computationally supported by the DM system. Regarding the former, the TVS has a task force to evaluate which VCPs are needed for their science goals which should conclude around the end of 2018. It is anticipated that a similar selection process for VCPs as e.g., photo-z, will be needed.
documentation of photometric calibration

Produce user-facing documentation for LSST's photometric calibrations that are derived from Robert Lupton's documents: easy and hard.

jointcal astrometry
AP on real data at scale. 
QA



List of SST tasks (Confluence)

Task report
pages54853746

Open DM SST RFCs 

Jira
serverJIRA
jqlQueryfilter=16770
serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2


Open DM SST LITs 

Jira
serverJIRA
jqlQueryfilter=16772
serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2


Overdue DM SST JIRA Tickets

(JIRA DM tasks with label "dm-sst")

Jira
serverJIRA
jqlQueryfilter=16774
serverId9da94fb6-5771-303d-a785-1b6c5ab0f2d2