Versions Compared

Old Version 17

changes.mady.by.user John Swinbank

Saved on

compared with

New Version 18

changes.mady.by.user John Swinbank

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Logistics

Date

24   – 

Location

  • This meeting will be conducted on BlueJeans: nobody is expected to travel to participate in it.
  • The Workroom in Tucson has been reserved for those in Tucson.

Browser

Room System

Phone Dial-in

https://bluejeans.com/293724745/

  1. Dial: 199.48.152.152 or bjn.vc
  2. Enter Meeting ID: 293724745 -or- use the pairing code

Dial-in numbers:

  • +1 408 740 7256
  • +1 888 240 2560 (US Toll Free)
  • +1 408 317 9253 (Alternate Number)

Meeting ID: 293724745

Slides

  • Please upload slides to Confluence in advance of your presentation (to avoid issues with screen-sharing, etc).

Attendees

Apologies



Pre-Meeting Planning

Suggested topics for discussion


TopicRequested byTime required (estimate)Notes
Middleware status

Fritz Mueller

1 hour?
Validation of Parquet data products

Fritz Mueller

60 minutes
  • Who controls the schema for Parquet data products?
  • Who validates the generated data against the schema?

Following discussion with Fritz on this topic, I (Leanne Guy ) propose to expand this session to address our overall strategy for Parquet, including: 

  • Are we committed to support Parquet (or more generally a columnar data format) as a user facing format for LSST catalog data products.
  • if so, how do we slice/tile the data within the files?
  • How do we make these available? Bulk download? By sky region? 
  • What is the strategy on using catalog data in Parquet files for backup or disaster recovery. 

We should also consider which documents, and how,  need to be updated to reflect our strategy 

Management of data during the operational era

John Swinbank

30 minutes
  • What is the model for managing data and data products during the operational era?
  • For example, are calibration products versioned through git repositories (as they are during construction)? Are they exclusively managed through the Butler? At what points can data be “ingested” to a data repository?
  • My understanding is that the middleware and calibration products teams have built an impressive toolbox of technologies that can be used to implement whatever data management policy we want, but that nobody has yet written down what that policy should be... and many people have different, incompatible, implicit policies in their heads.
SDM Standardization Update

Leanne Guy



Networks Status and PlanningJeff Kantor30 minutes
  • Brief overview of Summit, Summit - Base, and Base - LDF Network status and schedule
Public access to data after the 2 year proprietary periodEric Bellm30 minutes?We should develop and advertise a clearer plan for how non-Data Rights holders can access data release(s) that are no longer proprietary.  Bulk access through a cloud host?  Unauthenticated API or Portal access?  Something else?  More if they pay?
Status  of drill down tool for analysis of pipeline outputs

Leanne Guy

30 mins+ 

What is the status of the drill down tool being developed by the external consulting firm? A demo would be good (if possible)

.

Image display 

Leanne Guy

15 mins+ HSC map is now working with  DESC DC2 data. I would like to float and discuss the idea of using HSCMap for multi-band image display 
Incremental Template Generation in LOY1Eric Bellm30 minutesAlert science in early operations would be enhanced by incremental template generation prior to DR1.  This would be new scope–how much effort would be required of the construction project, and do we have estimates of the operations effort to run it during LOY1?
Future operations rehearsals

John Swinbank

30 minutesHow are we scheduling future operations rehearsals? Are they tied to particular hardware deliveries / system capabilities being available, or are they purely time based? What can we nail down now, to enable them to be used in planning V&V activities?


Agenda


Day 1: 2019-02-

24

25

Time (Project)TopicChairNotes
09:00WelcomeWil O'Mullane

Break
11:00


12:30Break
13:00


14:30Close

Day 2: 2019-02-

25

26

09:00


10:30Break




12:30Break
13:00


14:30Close

Day 3: 2019-02-27

09:00


11:00Close


Attached Documents

Attachments

Action Item Summary

Task report
spacesDM
pageSize40
labelsdmlt-201902