Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Agenda

Day 1: 2019-10-28

Time (Local!)TopicChairDiscussion TopicsNotes and action Items
09:00WelcomeWil O'Mullane
  • Confirm agenda.
  • Review action items.

09:15Project news & Data Facility updatesWil O'Mullane
  • It's not yet clear what we'll be able to say about changes (or not changes) to the LDF by the time of this meeting, but we should give what status update we can and allow time for discussion.
  • Also any other project current events.

09:45Middleware status
  • Latest updates on generation 3 middleware.
  • Timeline for dropping support for gen 2.

10:30Break (Refreshments Provided)
11:00Future middleware development plans
  • Staffing needs and management plan for middleware development from the start of calendar year 2020 for the remainder of construction.

11:30SDM standardization & database ingest
  • Update on the status of SDM-standardization efforts.
  • Should include:
    • A reminder of the “big picture” plan, including an overview of all the moving pieces (required pipeline outputs, Felis, database ingest) and the schema(s) they support/understand/map to each other.
    • Results of SDM-standardization work carried out on the AP and DRP pipelines in the F19 development cycle.
    • Status of database ingest.
    • How close are we to trivially having the results of HSC processing published through the LSP?

12:15Verification Control Document
  • Overview of LDM-692.

12:30Lunch (not provided — SLAC cafeteria, use your per diem)
13:30Test Datasets for Scientific Performance Monitoring
  • The SST proposal for test datasets for scientific performance monitoring.
  • See DMTN-091 (and the DM-15448 ticket branch at time of writing).

14:00Status of reprocessing systems at NCSA
  • Given the discussion on datasets (above) and the ongoing and emergent requirements of the construction and commissioning projects, we should understand the current capabilities and future schedule for reprocessing efforts at NCSA. In particular:
    • Following the departure of Hsin-Fang, what staff are assigned to this?
    • How ready is the NCSA team to support regular test processing as requested by the SST (above)?
    • How are issues reported and acted upon?
      • Is tracking metrics with SQuaSH adequate?
      • Do we also need Jira tickets?
      • Who is responsible for filing/triaging/resolving issues?
    • What work needs to be done, either by NCSA or by other teams, to make this process as automatic as possible?
      • Can we read this last item as “what is the current status of the Batch Production Service”?

15:00Break (Refreshments Provided)
15:30Workflow
  • (In so far as it is not covered by the item above), please provide an overview of the current design and implementation of the various services which require workflow management.
  • In particular, following surprise/confusion at the June 2019 DMLT F2F, we should establish whether tools like Pegasus are required:
    • For the Prompt or Batch Production Services;
    • For user-triggered processing from the Science Platform;
    • To respond to the recommendation from the Directors' Review that “more effort should be spent on refining diagnosis and recovery from processing errors as this will be critical for operating at scale.”

16:15Influx EFD
  • Demo with questions. Simon Krughoffplans to present this.
  • And a status update of who is responsible for delivering and running which services where (in particular, what is an LDF responsibility, what is a SQuaRE responsibility, what is a T&S responsibility).

17:00Close

Day 2: 2019-10-29

09:00Networks Status and Planning
  • Brief overview of Summit, Summit — Base, and Base — LDF Network status and schedule
  • Update on networks Verification and Validation plan
  • Q&A

09:30Ops Rehearsal #2Robert Gruendl
  • While a basic outline has been set the devil is in the details and these need to be discussed as they will set a timeframe where this rehearsal can occur
  • Also need to discuss whether or not verification tests should be convolved with the rehearsal

10:30Break (Refreshments provided)
11:00Commissioning (and Control) Dataflow and Processing
  • Review of DMTN-111 highlighting missing pieces; confirmation of timelines for delivery of them.

11:30Image Display Working Group
  • Summary of WG results and timeline towards final report.

12:30Lunch (not provided — SLAC cafeteria, use your per diem)
13:30Conda packaging updates
  • We've been hearing for a long time about plans to move third party packages to Conda, to adopt a Conda-based toolchain, etc. Let's have a summary of the work which has been performed to date, and a summary of and timeline for future plans.

14:00Product tree
  • Overview of DMTN-104, the “extended” version of the product tree.

14:15Current status of the Prompt Products Database
  • How close are we to hitting (or missing?!) our performance requirements?
  • What investigations have been performed? What's our currently-favoured solution?
  • What is the timeline for this converging?
  • ...and what's the latest on plans for public PPDB releases, renaming to the APDB, etc?
    • This was proposed during the June Community Broker Workshop, but I'm not aware of any follow-through.

15:30

Break (Refreshments Provided)

16:00Size and cost model updates
  • Status update on the work to produce revised (and simplified!) sizing and cost models.

17:00

Close [Adjourn to Alpine Inn beer garden, 3915 Alpine Road, Portola Valley for dinner and refreshments]

Day 3: 2019-10-30

09:00S19 retrospective / S20 plans

Each team to give a brief (~15 minute) overview of:

  • Highlights from F19 (only a couple of slides)
  • Plans for S20

In this order:

(We assume networks are adequately covered by Jeff Kantor's talk the previous daty


10:30Break (Refreshments Provided)
11:00Plans for S20 (continued)Discuss outstanding issues, refine timelines, resolve cross-team issues.
12:00Review action items & plans for future meeting
  • Next meeting is a Virtual F2F, 24–27 February 2020
  • Other meetings in 2020:
    • Seattle, 11-14 May 2020
    • Tucson, 9–12 November 2020
  • Consider a F2F in La Serena in 2021.

12:30Lunch (Provided)
13:00 SST meeting. Folks not involved with the SST are free to leave.


...