Purpose of LSST Long-Haul Networks

Provide reliable connectivity of sufficient bandwidth between all LSST Observatory sites (Base, Archive, Headquarters, Data Access Center, Satellite Processing, and Camera sites) to meet operational requirements.


Network Engineering Team

Per the LSST Network Operations and Management Plan, the overall architecture, engineering, testing, operations and maintenance of the LSST Networks are assigned to the Network Engineering Team (NET) under the direction of the LSST Network Architects and LSST Management.  The NET is formed of project/observatory and network provider technical staff.  The current members of the NET are:

Members:

Guests

Network Engineering and Testing Mailing List

The LSST networks are being engineered and tested via a distributed team with representatives from the LSST project, as well as the sub-award partners providing networks, and their subcontractors.  In order to facilitate communications among this team, a mailing list has been created and all people working on LSST Networks should subscribe to this list:

LSST-End-To-End mailing list

The Network Engineering Team is a subset of this list, and has a dedicated NET list:

LSST NET mailing list


Network Engineering Team Meetings

The NET meets monthly at 0800 PT in an online meeting on Blue Jeans Meeting ID: (varies with meeting, see meeting page.

Past meeting notes are linked below.


Specifications and Design Documents

Note: due to historical reasons, access to the baseline versions of linked documents below requires an LSST login to get into docushare.  The NET will keep the most current baselined versions linked.

Data Management System-level network specifications (extracted from LSE-61 Data Management Subsystem Requirements)

180 days MTBF/year

48 hours MTTR/year

Base to Archive nightly data volume (science images and meta-data): 15TB

        Amount of time available to transfer data from Mountain to Base to Archive:

                 Crosstalk-corrected images for Alert Production: 6 seconds to move (between 2.6 - 12.4 Gbytes depending on compression)

                 Raw images: 24 hours

Note, there is also Observatory Control System and other operational data transferred at night, and there is daytime engineering and calibration traffic potentially at the same volume.  Finally, there is periodic data transfer from the Archive to the Base, primarily as a result of annual Data Release Processing.  All the data flows and allocated bandwidths are defined in the following documents.

A grouping of this traffic for purposes of network design, QoS, prioritization etc. is on the LSST Network Traffic Types.

A bandwidth allocation by link of this traffic for purposes of network design, QoS, prioritization etc. is on the LSST Bandwidth Allocation.

The LSST Long-Haul Networks are specified in LSE-78 Rubin Observatory Network Design and LSE-479 Rubin Observatory Networks Technical Document.

The budgeted cost and schedule of deployment of links and bandwidth, and their utilization is documented in LDM-142 Network Sizing Model

The requirements for the Summit Network are in LTS-577 Summit Network Specification

In addition to the top-level documents above, there are documents describing how the LSST Networks are to be tested, verified, and managed:

The LSST Network End-to-End Test Plan defines the plan for development testing and monitoring the LSST networks.

The Vera C. Rubin Network Verification Baseline defines the plan for formal verification of the LSST Networks

Rubin Observatory Network Pre-Verification Review Report is the report from the panel from the June 2020 review.

The LSST Observatory Network Verification Plan defines plan for formal verification of the LSST networks.  OBSOLETE, SUPERCEDED BY LDM-732 and JIRA LVV Project

The LSST Observatory Network Verification Matrix defines requirements and methods for formal verification of the LSST networks. OBSOLETE, SUPERCEDED BY LDM-732 and JIRA LVV Project

The LSST Network Operations and Management Plan  defines the plan for operating and maintaining the LSST networks as a single integrated process.

SLAC US Data Facility Networks (ppt, pdf)

ESnet - Europe Networks (pdf)

Pages and other documents related to LSST Long-Haul Networks

Quick Display Action Items (Incomplete)

DescriptionDue dateAssigneeTask appears on
10 Sep 2020Cristián Silva2020-08-20 Network Engineering Team Meeting notes
  • Cristián Silva Develop plan for disk - disk, disk - memory tests with various protocols, engaging other NET expertise  
30 Sep 2020Cristián Silva2020-08-20 Network Engineering Team Meeting notes
  • Kate Robinson Confirm ESnet has plans to maintain Peachtree - SOCS backhaul.  FIU would like a way to provide redundancy in Atlanta.   
18 Feb 2021 2020-08-20 Network Engineering Team Meeting notes
  •  Paul W will check on whether ESnet has a long term commitment to maintaining their peering with SoX.
 2021-01-14 Network Engineering Team Meeting notes
  •  Julio will create a catalog of all relevant LHN documents for review/update/discussion at the upcoming NET meeting.
 2021-01-14 Network Engineering Team Meeting notes

Quick Display Action Items (Complete)

DescriptionDue dateAssigneeTask appears on
  • Jeff Kantor, Julio Ibarra Set meeting coordinate for 8AM pacific, add meeting time and BJ ID information to the Confluence page.  
19 Apr 2017Jeff Kantor2017-03-23 Network Engineering Team Meeting notes
19 Apr 2017Jeff Kantor2017-03-23 Network Engineering Team Meeting notes
28 Apr 2017Jeronimo Bezerra2017-03-23 Network Engineering Team Meeting notes
  • Jeff Kantor Confirm guarantee of 2x40 minimum capacity during observing night  
28 Apr 2017Jeff Kantor2017-03-23 Network Engineering Team Meeting notes
  • Unknown User (kollross)  Inquire from Lyon about required bandwidth and provisioning  By Mid 2017 will have 20Gbps.  2018 will have possibility of 100Gbps
28 Apr 2017 2017-03-23 Network Engineering Team Meeting notes
  • Jeronimo Bezerra to update the bw_reservation.xlsx and share it with NET  
15 May 2017Jeronimo Bezerra2017-05-04 Network Engineering Team Meeting notes
17 May 2017Jeronimo Bezerra2017-03-23 Network Engineering Team Meeting notes
  • Unknown User (kollross) to provide information on NCSA plans for dedicated wave, 500G backbone, etc.  
22 Jun 2017 2017-05-04 Network Engineering Team Meeting notes
  • Jeronimo Bezerra to update the LSST End to End Test Plan to address his 100G concerns discussed during the meeting  
22 Jun 2017Jeronimo Bezerra2017-05-04 Network Engineering Team Meeting notes
  •  Unknown User (kollross) to get IN2P3 scope of work and confirm NCSA - IN2P3 bandwidth requirements, get more details about the 20G Ethernet service  
22 Jun 2017 2017-05-04 Network Engineering Team Meeting notes
  •  Jeff Kantor Configure a work team to work this in next 2 weeks  
07 Jul 2017Jeff Kantor2017-07-06 Network Engineering Team Meeting notes
  • Julio Ibarra Poll for an interim meeting by July 20  
10 Jul 2017Julio Ibarra2017-07-06 Network Engineering Team Meeting notes
  • Jeronimo Bezerra Schedule next demonstration coordination meeting  
27 Jul 2017Jeronimo Bezerra2017-07-20 Network Engineering Team Meeting notes
  • Jeff Kantor Propose change to LDM-142 table with total of 100 Gbps rather than 130 Gbps  
02 Aug 2017Jeff Kantor2017-07-20 Network Engineering Team Meeting notes
  • Jeff Kantor Add link to E2E test plan from Network Verification Plan  
02 Aug 2017Jeff Kantor2017-07-20 Network Engineering Team Meeting notes
  • Jeff Kantor Add link to LTS-577 on NET home page in confluence  
02 Aug 2017Jeff Kantor2017-07-20 Network Engineering Team Meeting notes
  • Jeff Kantor ensure traffic types referenced in LDM-142 are defined in LSE-78.  Updated due date, this is in work and will be in the next LSE-78 LCR, goal is before LSST 2017.  
09 Aug 2017Jeff Kantor2017-05-04 Network Engineering Team Meeting notes
25 Aug 2017Jeronimo Bezerra2017-08-24 Network Engineering Team Meeting notes
28 Aug 2017Jeronimo Bezerra2017-08-24 Network Engineering Team Meeting notes
21 Sep 2017Albert Astudillo2017-08-24 Network Engineering Team Meeting notes


  • No labels