May 2017 DMLT
Logistics
Date
-
Location
- University of Washington, Seattle, WA, Physics and Astronomy Building, 3rd floor. Rooms vary by day–see agenda for locations.
- Remote access via BlueJeans at ls.st/jmc or dial one of the following numbers: +1.408.740.7256 +1.888.240.2560 +1.408.317.9253
Hotel / Per Diem
1. University Inn, (206) 632-5055 ** Erin Carlson has a room block at this hotel, but you must make your own reservation by Friday, April 28; see here for more info (Updated 4/19 1620 hrs). **
Approx. university rate is $189
2. Silver Cloud, (206) 526-5200
$149 (+ parking, hot breakfast wifi) + tax (single king bed) + local shuttle (14ppl max), $159 (two queen beds)
Depending on the availability, it can vary from $111 to $157
Additional visitor information can be found here.
Planning to attend
- Wil O'Mullane
- Kian-Tat Lim
- Eric Bellm
- Unknown User (mjuric-admin)
- Tim Jenness (remote)
- Unknown User (xiuqin)
- John Swinbank
- Jim Bosch
- Frossie Economou
- Robert Lupton (attending PST on Monday/Tuesday)
- Fritz Mueller
- Gregory Dubois-Felsmann
- Michael Wood-Vasey
- Jeff Kantor
- Margaret Gelman
- Donald Petravick
- Unknown User (ciardi)
- Simon Krughoff (local)
Agenda
Day #1: Tuesday May 9 - start 1:00PM
Apologies from Mario Juric, Robert Lupton, Wil O'Mullane, John Swinbank: patchy/no availability due to PST meeting.
13:00–15:00 room C341
- Discuss document tree and list of documents for the review (Kian-Tat Lim)
15:00–15:30 break
15:30–17:30 room B305
- Continue document tree discussion as long as it is productive
- Otherwise time available for self-organizing breakouts. Suggested topics include:
- SuperTask WG
- F17 cross-WBS planning
17:30 End (or earlier if we make it)
18:00 Joint Dinner with PST (Ivar’s Salmon House)
Day #2: Wednesday May 10 (room B305)
09:00–11:00 The NSF/DOE Review -
- Document pack - thanks to Ranpal for having a first go at this
- The agenda
- Overview by Wil O'Mullane
- Session chairs to present ~1 slide overview of plans & people they expect to be there
Actions
- Whole DMLT: send comments on LDM-148 component diagram to Kian-Tat Lim.
- Kian-Tat Lim: produce finalised LDM-148 component diagram.
- Whole DMLT: submit suggested risks to Wil O'Mullane. Should include "What worries me is ..., impact on the project is ...", bonus points for "probability is ..., cost is ...".
- Mario Juric: distribute guidelines for coding priorities of requirements to DMLT members (e.g. "will do", "may do", "won't do").
- Science Leads: provide prioritized list of requirements to Wil O'Mullane, work with T/CAMs to ensure the expressed priorities are consistent with the plan.
- Whole DMLT: submit list of external data dependencies (e.g. reference catalogues, "auxiliary data") to Wil O'Mullane.
- Wil O'Mullane: understand project level requirements for "quick look" tooling. Ensure terminology used within DM is consistent with OSS (OSS-REQ-0057, etc). Agree with John Swinbank what should be included in NSF review presentations.
- John Swinbank: work with T/CAMs, Kevin to clean up & understand the contents of PMCS in a way that can be presented to the review panel.
- John Swinbank: ensure that interfaces from the Science Pipelines to other parts of the system (task framework, Butler, NCSA, ...) are represented at the ~1 slide level in review material.
- Kian-Tat Lim: include material on system integration in review plenary session.
- Review session leaders:
- Margaret Gelman: add list of presentations for Data Facility breakout to review agenda, link to specific charge items.
- John Swinbank: add list of presentations for Science Pipelines breakout to review agenda, link to specific charge items.
- Unknown User (xiuqin)/Mario Juric: add list of presentations for Science Platform breakout to review agenda, link to specific charge items.
- Wil O'Mullane: add list of presentations for Management breakout to review agenda, link to specific charge items.
11:00–11:30 Break
11:30–13:00
- DM org chart updates, status of LDM-294 (Wil O'Mullane) [20 minutes]
- Product Tree: aims, current status, work needed (Wil O'Mullane) [20 minutes]
- Summary of Wil O'Mullane's SLAC visit (Fritz Mueller) [20 minutes]
Actions
- Whole DMLT: give comments to Wil on LDM-294.
- T/CAMs: provide material on lead institutions for LDM-294.
- Kian-Tat Lim / Tim Jenness: produce (draft) trace table of requirements to components to go into LDM-294.
- Wil O'Mullane / John Swinbank: rename “Infrastructure & Processing” to “Data Facility” on org chart.
- Robert Lupton, Jim Bosch, Wil O'Mullane, John Swinbank: convene small group to discuss product tree for DRP.
13:00–14:00 Lunch (on your own)
14:00–15:30 Planning for F17
- Present current status of plans for the upcoming cycle: 10 minutes per group + 30 minutes questions.
15:30–15:45 Break
15:45–17:30 Planning for F17 (continued)
- Group status updates continue:
- Science Platform development planning for 2017 (Gregory Dubois-Felsmann) [30 minutes]
- Integration effort between HSC reprocessing & SUIT/DAX (Unknown User (xiuqin), Fritz Mueller) [30 minutes]
- Group status updates continue:
Actions
- Mario Juric, DM-SST members: discuss plans for global photometric calibration (FGCM, Übercal, etc). – moved to - DM-11504Getting issue details... STATUS
- All (relevant) T/CAMs: fill in F17 epics on the Science Platform and PDAC development and deployment in 2017 page, to support discussion at the PDAC meeting.
- Unknown User (xiuqin): fill in remaining F17 epics (or stories, where needed) for PDAC development on Confluence
- Fritz Mueller: fill in remaining F17 epics for PDAC development on Confluence
- Frossie Economou: fill in remaining F17 epics for PDAC development on Confluence
- Margaret Gelman: fill in remaining F17 epics for PDAC development on Confluence
17:30 End
Off-site Team Dinner
- Reservation at Tai Tung, 655 S King St, Seattle, WA 98104 for 19:00 map
- The reservation is under the name Simon Krughoff
- A group will travel there by public transit after the meeting winds up for the day.
- Round trip light rail tickets are $5 and available at the station for cash or plastic
- There is street parking. I think it's free after 6PM.
- Travelers should deduct $34 from per diem for dinner meal allowance.
Day #3: Thursday May 11 (room B305)
09:00
- LSST "patch" DM feature - networks perhaps... for any creatives .. (Wil O'Mullane)
- SuperTask WG report and next steps (Gregory Dubois-Felsmann) [1 hour]
- Binary releases: current status, requirements, plans (Frossie Economou, Wil O'Mullane, John Swinbank) [30 minutes]
- See also DMTN-044.
Actions
- John Swinbank: update DMTN-044 to reflect the acceptance of the SQuaRE provided binary release system, and that decisions about long-term release maintenance will be deferred until the release manager position has been filled, and place it in Docushare. - DM-10813Getting issue details... STATUS
- Wil O'Mullane / John Swinbank: ensure that responsibility for the maintenance of EUPS is well understood and included in the DM plan. - DM-10814Getting issue details... STATUS
- Jeff Kantor provide network images/art suggestions for LSST Patch to Wil O'Mullane
10:30–10:45 Break - DMLT photo (in the rain ?)
10:45–12:00
- Status of the Verification plan (Frossie Economou, Wil O'Mullane, Mario Juric) [30 minutes]
- Networks Status and Verification Plan (Jeff Kantor) [15 minutes]
- Summit Base ITC Design Tiger Team results to date (Jeff Kantor) [15 minutes]
Actions
- Whole DMLT: review LDM-503 list of proposed tests (master schedule, §5). Send corrections, updates, additional suggestions to Wil O'Mullane.
- Gregory Dubois-Felsmann, Fritz Mueller Submit LCR against DMSR (LSE-61) to incorporate the existing database performance requirements from the Data Access White Paper (Document-5373) (as a starting point - a later change request should cover a more comprehensive set of user data service performance metrics)
12:00–13:00 Lunch - WORKING LUNCH IN ROOM B305 (for Frossie, Wil, Simon, Gregory, John, Fritz, Xiuqin, KT, Jeff, Mario, Michael)
- Continuation of prior discussion topics for select team members.
13:00–14:00 Videocon on NCOA - https://bluejeans.com/309465185
14:00–15:00 Planning for F17 (continued)
- Technical decision making
- WCS/AST
- Refer to: DMTN-010, - RFC-193Getting issue details... STATUS , - RFC-211Getting issue details... STATUS
- - RFC-329Getting issue details... STATUS
- WCS/AST
- Pre-operations capacity planning (Margaret Gelman) [15 minutes]
- Pipelines/SUIT integration: "Objects" in SUIT/notebook are what? Astropy or/and LSST Stack objects?
- Technical decision making
Actions
- Robert Lupton to review calculations in RFC-329 or delegate (likely to Bob Armstrong).
- Mario Juric: any significant data usage at NCSA which is not recorded in LDM-503 master test schedule to Margaret Gelman.
- Jim Bosch: provide sizes of individual data products (& persisted temporaries) to Margaret Gelman based on LDM-151. Now - DM-10812Getting issue details... STATUS .
- Mario Juric: convene working group on data compression (assignee changed from Wil O'Mullane per DMLT of 2017-06-12).
- Robert Lupton & Gregory Dubois-Felsmann write specifications for user interface for reconstituting Python objects (including, e.g,
HeavyFootprint
s) from a database-backed Butler. - captured as - DM-12275Getting issue details... STATUS .
15:00–15:30 Break
15:30–16:50
- Resolve outstanding cross-group & prioritization questions for F17 (continued)
- T/CAMs should be ready to submit the plan for at least the first three months to Kevin within ~1 week from this session.
- Resolve outstanding cross-group & prioritization questions for F17 (continued)
16:50 Closing remarks - (Wil O'Mullane)
17:00 End
Key Documents
Please submit comments requested above relative to these documents:
- LDM-148 (Data Management System Design): https://ldm-148.lsst.io/v/u-ktl-pre-DMLT/index.html
- LDM-294 (Data Management Organization and Management): https://ldm-294.lsst.io/v/DM-9880/index.html
- LDM-503 (Data Management Test Plan): https://github.com/lsst/LDM-503/blob/261b1df2c1c778f7ebb7295180e02c5c52d6ef0e/LDM-503.pdf
- DMTN-044 (LSST DM Software Release Considerations): DMTN-044-3fcf748.pdf
Pre-Meeting Planning
Focus
Preparing for DM Review.
Other Topics for the agenda (please add here any points you would like to discuss)
- Science Platform development planning for 2017 (Gregory Dubois-Felsmann)
- Planning for integration effort between HSC reprocessing and DAX+SUIT (Fritz Mueller, Unknown User (xiuqin))
- what hardware is to be used?
- Are we going to provide a PDAC-like system for internal users to access reprocessed HSC?
- What's the relationship of the above said system and the science verification?
- Networks Status and Verification Plan (Jeff Kantor)
- Summit Base ITC Design Tiger Team results to date (Jeff Kantor)
- Binary release plans & developer workflow (John Swinbank)
- We've discussed this in DMLT telecons
- Completing LDM-151 revision, in particular as regards requirements tracing (John Swinbank)
- Pre-operations capacity planning (Margaret Gelman)
- Science Validation (Michael Wood-Vasey)
Topics requested by Wil O'Mullane
- Binary releases; see DMTN-044 (source, PDF).
- Status of databases & results from Wil O'Mullane visit to SLAC.
- Summary of that visit requested from Fritz Mueller.
- Session plans for DM review.
- Each of the session chairs (Margaret Gelman, Unknown User (xiuqin)/Mario Juric, Wil O'Mullane, John Swinbank) should have a ~1 slide overview of how their session will be organized.
- Status/results from the SuperTask WG.
- Brief slide deck requested from Gregory Dubois-Felsmann.
- Product tree (PDF).
- Homework for everybody: please identify missing elements.
- Status of the Verification Plan (Wil O'Mullane, Mario Juric, Frossie Economou)
- Updates to the DM Org Chart.