Agenda Frozen

The agenda for the DM-SE AHM is no longer being developed on this page. Changes added here will be lost. Check the meeting website for the latest information.


Program Notes

Rather than ask each T/CAM (or science/technical lead) to provide a status update from their team, the suggestion is that Wil O'Mullane will request inputs from T/CAMs in advance of the meeting and present them himself. The schedule below budgets just 45 minutes for that; should consider whether this is enough time to provide a worthwhile update from every team.

Each session has a chair, indicated in the table below. This chair is responsible for preparing the detailed agenda for their session.

Sessions which are of expected to be of wide interest to both DM and SE are coloured green. Those primarily of interest to DM are blue; of interest to SE, yellow.

Room allocations are provisional! (Unknown User (xiuqin), could you please check if they make sense?)

Note: KS415 and KS300 can have about 20 people. Some sessions in Hameetman may not need such a big space, we will make switch when needed. 

Remote Participation

Will be available for plenary sessions at https://bluejeans.com/769397284.

Will also be available during the DMLT portion of the meeting; details TBD.

TimeHameetmanKS300KS410EKS410WKS415

Monday 2018-03-05
13:00

Project Systems Engineering Team Building Workshop (Brian, Chuck, Chris Montgomery)

  • Creating High Performing Teams
  • Defining a shared Vision
  • Developing a Transformation Plan

DM-SST meeting.

(Zeljko Ivezic)

17:00Adjourn
18:00

Project Systems Engineering Team Building Activity

The Bunker Experience (http://www.thebunkerexperience.com/index.php)


Tuesday 2018-03-06
09:00Welcome & Logistics (Xiuqin, Gregory, or somebody from IPAC)



09:05
LSST Project Status (Victor Krabbendam)




09:45

DM Status (Wil O'Mullane)

  • Will include brief status update from each DM team; T/CAMs will coordinate this with Wil in advance.




10:30

LSST Training Opportunities (Unknown User (cmontgomery))

  • Available Training Opportunities
  • Creating High Performance Teams




11:00Refreshments
11:30

DM Code of Conduct Refresher

(Kian-Tat Lim)


Control Room Displays

  • Needs, Use Cases, Next Steps, Planning for INRIA mtg

(Unknown User (fdelgado))



11:45

DM Communications Tools Orientation

(Jonathan Sick)




12:00

New DM middleware: status and overview of upcoming changes

(Jim Bosch)


Work Management System Tool

  • Scope, Overview, Status, Next Steps

(Brian Selvy / Austin Roberts)



12:30Lunch (Hameetman Patio)
13:30

Technical and algorithmic topics. Those suggested so far include:

  • Multi-core programming and efficiently working in limited memory (KTL)
  • Next to database programming (Fritz)
  • DCR-aware coadds and matched templates for image differencing (Ian S.)
  • HiPS data in Firefly (Xiuqin)
  • LDF service monitoring systems (Michelle B.)
  • Status update on the Science Pipelines User Guide (content and format); plans for adopting numpydoc everywhere; tooling (JSick)
  • Update from the Obs Package WG: what does the future hold for Obs packages? (Simon)

(Jim Bosch)

Hacking space available

EFD Overview and Status

(Dave Mills)


The DM-Commissioning interface at a management level:

  • Roles and responsibilities of DM in verification, validation & commissioning;
  • AuxTel ConOps/Expectations
  • External datasets;
  • Resources from DM to support pipeline commissioning/testing;
  • Data services and processing capabilities for commissioning;
  • Support of the Commissioning Cluster;
  • Schedule of DM development & its relationship to commissioning;

(Wil O'Mullane & Chuck Claver)

14:30

LSST ConOps - Review of Existing Materials & Updates

(Brian Selvy / Unknown User (aserio))

15:30

Refreshments

16:00Technical and algorithmic topics continued.Hacking space available

DM tool development in support of commissioning and operations:

  • Requests, requirements, deliverables;
  • LCR-1203 (interactive nightly reports);
  • Visualization;
  • Metadata tracking.

(Wil O'Mullane & Chuck Claver)

17:30Adjourn

Wednesday 2018-03-07
09:00

Commissioning Rehearsal

(Wil O'Mullane & Chuck Claver)


Representative 24-hour periods in commissioning. This would involve thinking about

  • where specific people are working
  • the specific procedures that occur during the day and night
  • schedule of meetings / telecons between different sites
  • data transfers / where are data sitting and being analyzed
  • who is processing data? how do they know what to process and when?
  • planning on-sky observations
  • sleeping

Proposal is to generate a google doc.

Hacking space available

Early Integration Activities - Planning & Work Session

(Michael Reuter)

DM ICD Working Session
LSE-72 Updates

(Kian-Tat Lim / Unknown User (mrodriguez))

Current status of QA tooling and datasets:

  • Currently available SQuaSH functionality, plans for integration of Bokeh, etc. (Simon?)
  • Tim Morton's QA work at Princeton, pipe_analysis, etc (Tim M.)
  • Introduction to lsst.verify (JSick)
  • Overview of ap_verify (Krzysztof? Meredith? Eric?)
  • Overview of ci_hsc (Paul?)
  • Overview of existing validation_foo packages and associated datasets (Michael W-V)
  • Firefly (Xiuqin)


(John Swinbank)
11:00Refreshments
11:30

Continued commissioning rehearsal; review & post-mortem of commissioning rehearsal activities.

(Wil O'Mullane & Chuck Claver)


** need to end a few minutes early for class at 12:30pm

Hacking space available


Continued Early Integration Activities - Planning & Work Session

(Michael Reuter)


Science Platform development:

  • Follow-up on December meeting
  • Track status of requirements
  • Check on action items
  • Schedule for integration

(Unknown User (xiuqin))

12:30Lunch
14:00

DM tools demonstration & tutorial.

  • Focus on JupyterLab, other tools as needed.
  • Expectation is that this is a developer/user led demo, vs yesterday's manager/product owner discussion of responsibilities.
  • Refer to the Systems Engineering requests.

(Simon Krughoff)

** ** need to start a few minutes late for class ending at 2pm

Gen. 3 Middleware: dev team design session

(Jim Bosch)

Work Packages without assigned resources (Brian Selvy / Victor Krabbendam / Sandrine Thomas / Wil O'Mullane / John Swinbank / Chuck Claver)

  • come up with a list of items that are known to be required for commissioning or operations but are not captured in PMCS or are in PMCS but do not have assigned resources

The LSST mini-broker:

  • Development of use cases and requirements.

(Eric Bellm)

15:30Refreshments
16:00

Continued DM tools demonstration & tutorial.

(Simon Krughoff)

Hacking space available

Alert distribution system architecture and design:

  • How to we join the dots between LDF, AP, SUIT and Architecture?
  • Who is responsible for delivering what to whom?
(John Swinbank)
17:30Adjourn

Thursday 2018-03-08
09:00

The Systems Engineering approach to integration and facility-level characterization: what are the timelines? What will be tested when? A summary for the DM team.

(Brian Selvy)





09:45

Reports from sessions & summaries of key outcomes.

(Session leads)





10:30

Closing address.

(Steven Kahn)





11:00Refreshments
11:30

Update on LDF services in support of development

(Unknown User (mbutler))


LSE-30 OSS Verification Planning Working Session

(Brian Selvy / Chuck Claver)



11:45

What will DM look like in commissioning? How will we transition to operations?

(Wil O'Mullane)




12:30Lunch
13:30
Hacking space available

LSE-30 OSS Verification Planning Working Session

(Brian Selvy / Chuck Claver)


DMLT Meeting

Major discussion topics to include:

  • Status of LDM-503 milestones incl. delivery of test specifications.
  • Planning for the F17 development cycle.
  • Decision making re QA workflows, datasets, verification, validation, etc.
  • Metadata for images/sources/catalogs.
  • Early AuxTel operations.
    • Requirements for pipeline processing.
    • Delivery timeline of SuperTask, Butler Gen3 and pipelines built atop those, and the schedule for integrating them at the Data Facility.
17:30Adjourn

Friday 2018-03-09
09:00

Hack Day (KS300, MR214)

Prospective projects:

  • Build a mountain monitoring system with different portals for say DM manger and Commissioning manager. How do we integrate data from EFD, various monitoring systems and log files to present warning of interest to different individuals or groups ? How do we drill down to say "Show me all log messages around this event" How can that be made sensible (some logs may be very large and have many entries per second). What is the best electronic log book for operators to use and how will it tie in with procedure execution? Would want Chuck Claver around for this (suggested by Wil O'Mullane)
  • Make Header Service configurable (suggested by Kian-Tat Lim)
  • Assorted technical debt cleanup (suggested by John Parejko):
    • Finishing obs_base tests for decam and subaru (and porting them to the remaining obs packages): DM-8444
    • Implement RFC-322 (flux → instFlux)
    • Implement RFC-333 (*Sigma → *Err)
  • Add comment strings describing all the entries in obs_base (suggested by Simon Krughoff).
    • To which Jim Bosch adds: "Could we do that in a separate file (e.g. YAML mapping name -> description), maybe, so it'd be easier to machine-read and load into whatever form those definitions take in Gen3?"
  • Implement a deprecation system, and document it, following RFC-213 (suggested by John Parejko)
  • Convert Task documentation to Sphinx/reStructuredText (suggested by Jim Bosch)
  • Science Pipelines Documentation Hacks. Let's get the Stack into https://pipelines.lsst.io. Participants will pick their favorite package and modernize its documentation (suggested by Jonathan Sick)
    • Add Sphinx documentation boilerplate based on our new project template.
    • Learn how to build the docs locally and on Jenkins.
    • Convert and write docstrings in the Numpydoc format.
  • Document repositories in /datasets, following the proposals in DM-13508 & RFC-447 (suggested by Simon Krughoff)

(Need a non-DMLT volunteer to coordinate this)

Project Systems Engineering FY18 Q2/Q3 Sprint Planning Session

(Brian Selvy / Chuck Claver)


DMLT Meeting


DM Availability Constraints

  • Eric Bellm leaving Thursday PM
  • Frossie prefers later in the week.
  • Robert Lupton missing Thursday & Friday
  • Tim Jenness missing Thursday & Friday (can call in).
  • No labels