Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Table of Contents
stylesquare

...

perfSONAR Hosts description

Hosts are Dell R320 servers with the following specifications:

  • Service Tag: 66V6Q22
  • Intel(R) Xeon(R) CPU E5-1410 v2 @ 2.80GHz
  • DDR3 1600Mhz 8GB RAM
  • 500GB WD HardDisk

...


Each host has three interfaces:

  • One 10G interface for BWCTL
  • One 10G interface for latency and loss (OWAMP

...

  • )
  • One 10G or 1G interface for management

Login information

current hostnameold hostnameps-bw.ncsa 120Paul Wefel <neteng@ncsa.illinois.edu>ltncsaampathpsncsa-ltlhnlsst.org
CityNodeBWCTLMgmt IPOWAMPThroughputIPwhen onlinecontactLoss
Miami (AmLight)ps-mia.ampath.netpsncsa-bw.lhn.lsst.org(tick)190.103.184.93 (p1p2.4003)p1p2em3
Huechuraba (AmLight)ps-scl.sdn.amlight.net190.103.184.2014113 (em1.4002)p2p2p2p1
São Paulo (AmLight)ps-spo.sdn.amlight.net200.136. (tick)

190.103.184.153

2014Paul Wefel <neteng@ncsa.illinois.edu>
ps-bw.ampath.ampath.netperfsonar.ampath.net(tick) 

190.103.184.114

2015Humberto Galiza <galiza@amlight.net>
ps-lt.ampath.ampath.netperfsonar-1g.ampath.net (tick)

190.103.184.146

2015Humberto Galiza <galiza@amlight.net>
ps-bw.ansp.ampath.netpsansp-bw.lhn.lsst.org(tick) 

190.103.184.115

2015Humberto Galiza <galiza@amlight.net>
ps-lt.ansp.ampath.netpsansp-lt.lhn.lsst.org (tick)

190.103.184.147

2015Humberto Galiza <galiza@amlight.net>
ps-bw.l3-santiago.ampath.netpsl3cl-bw.lhn.lsst.org(tick) 

190.103.184.116

2015Humberto Galiza <galiza@amlight.net>
ps-lt.l3-santiago.ampath.netpsl3cl-lt.lhn.lsst.org (tick)

190.103.184.148

2015Humberto Galiza <galiza@amlight.net>
ps-bw.reuna.ampath.netpsreuna-bw.lhn.lsst.org(tick) 

190.103.184.119

2015Albert Astudillo <aastudil@reuna.cl>
ps-lt.reuna.ampath.netpsreuna-lt.lhn.lsst.org (tick)

190.103.184.149

2015Albert Astudillo <aastudil@reuna.cl>
ps-bw.aura.ampath.netpsaura-bw.lhn.lsst.org(tick) 

190.103.184.118

2014Ron Lambert <rlambert@lsst.org>
ps-lt.aura.ampath.netpsaura-lt.lhn.lsst.org (tick)

190.103.184.151

2014Ron Lambert <rlambert@lsst.org>

...

41.86 (enp7s0f1)enp11s0f0enp11s0f1
Panamá City (AmLight)ps-pty.sdn.amlight.net200.0.207.47 (em1.7)p1p2em1
La Serena (AURA)ps-aura.sdn.amlight.net139.229.127.104 (em1)p1p2p2p2
La Serena (LSST)perfsonar1.ls.lsst.org139.229.135.17 (em1)p2p1p2p2
Champaign (NCSA)ps-ncsa141.142.129.31 (em1)em2p2p1
Cerro Pachón (LSST)TBDTBDTBDTBD
Santiago (REUNA)TBDTBDTBDTBD

High-level Perfsonar Deployment Diagram

Image Added

Configured Tests


Test

Type

Path BW
Throughput

Loss
VLANIPVLANIP
MIA x PTYPer Path100G70610.7.6.0/2470710.7.7.0/24
fd95:26fb:39ab:0706::/64fd95:26fb:39ab:0707::/64
MIA x HuechurabaPer Link10G70010.7.0.0/2470110.7.1.0/24
fd95:26fb:39ab:0700::/64fd95:26fb:39ab:0701::/64
MIA x HuechurabaPer Path100G (Atlantic)71810.7.18.0/2471910.7.19.0/24
fd95:26fb:39ab:0718::/64fd95:26fb:39ab:0719::/64
MIA x HuechurabaPer Path100G (Pacific)71610.7.16.0/2471710.7.17.0/24
fd95:26fb:39ab:0716::/64fd95:26fb:39ab:0717::/64
MIA x SPOPer Path100G (Atlantic)70810.7.8.0/2470910.7.9.0/24
fd95:26fb:39ab:0708::/64fd95:26fb:39ab:0709::/64
MIA x SPOPer Path100G (Monet)72410.7.24.0/2472510.7.25.0/24
fd95:26fb:39ab:0724::/64fd95:26fb:39ab:0725::/64
PTY x HuechurabaPer Link100G70210.7.2.0/2470310.7.3.0/24
fd95:26fb:39ab:0702::/64fd95:26fb:39ab:0703::/64
PTY x HuechurabaPer Link100G70210.7.2.0/2470310.7.3.0/24
fd95:26fb:39ab:0702::/64fd95:26fb:39ab:0703::/64
Huechuraba x SPOPer Link100G70410.7.4.0/2470510.7.5.0/24
fd95:26fb:39ab:0704::/64fd95:26fb:39ab:0705::/64
Huechuraba x LSC (LSST)Per Path100G72610.7.26.0/2472710.7.27.0/24
fd95:26fb:39ab:0726::/64fd95:26fb:39ab:0727::/64
LSC (LSST) x Cerro PachónPer Path100G72810.7.28.0/2472910.7.29.0/24
fd95:26fb:39ab:0728::/64fd95:26fb:39ab:0729::/64
Huechuraba x LSC (AURA)Per Path100G72210.7.22.0/2472310.7.23.0/24
fd95:26fb:39ab:0722::/64fd95:26fb:39ab:0723::/64
MIA x LSC (LSST)Per Path - BGP chosen100GN/AMIA: 198.32.252.193/31N/AMIA: 198.32.252.195/31
LSC: 139.229.140.135/31LSC: 139.229.140.137/31
MIA x NCSAPer Path - BGP chosen100GN/AMIA: 198.32.252.193/31N/AMIA: 198.32.252.195/31
NCSA: 141.142.129.87/31NCSA: 141.142.129.85/31
LSC (LSST) x NCSAPer Path - BGP chosen100GN/ALSC: 139.229.140.135/31N/ALSC: 139.229.140.137/31
NCSA: 141.142.129.87/31NCSA: 141.142.129.85/31

Perfsonar Host Configuration information

To support 10Gbps speeds, on paths of 100ms, 120MB of buffer must be available. Hosts configured to use jumbo frames need more buffer space as well.

...

Testing from a faster host to a slower host (e.g.,: A with 10Gbps NIC card, and B with a 1Gbps NIC card), the receive receiving host might end up dropping lots of packets. The only way to prevent that is to use the Linux 'traffic control' command, but this only works reliably up to around 5Gbps. E.G.:

...

Where xxx.xxx.xxx.xxx match de IPv4 address attached to the device p1p2 

...


MADDASH server

This tool aims to provide both LSST and AmLight engineers a two-dimensional monitoring data as a set of grids referred to as a dashboard. Using this dashboard through the web, LSST and AmLight engineers will have a continuous and near-real-time overview of the network health, being able to anticipate actions in case of service degradation or disruption. 

httphttps://ps-dashboard.ampath.net /maddash-webui/index.cgi