...
| Start | End | What happened? | Location | What was affected? | Outcome |
|---|---|---|---|---|---|
2017-04-17 (13:41) | 2017-04-17 (13:53) | Unplanned lsst-dev login node down | NCSA | Users unable to log in to lsst-dev. | Fixed |
| 2017-03-27 (220022:00) | 2017-03-29 (140014:00) | Blue Waters maintenance | NCSA | Due to maintenance of cooling infrastructure at NPCF, Blue Waters will down during this period. Cray will also take this maintenance window to perform some system updates at the same time. Systems that will be down
Systems that will remain up Qserv nodes ( lsst-qserv-* ), SUI nodes ( lsst-sui-* ), Bastion node ( lsst-bastion01 ) should remain online during the outage. However, if temperatures in the NPCF rise too high, we will be forced to shut these down as well. I've been told that this is a low-probability scenario and we will be given time to do graceful shutdowns. In the unlikely event that this happens, it will be communicated through the DM Slack channel and also posted here. | All systems normal |
2017-03-23 (0800) | 2017-03-23 (1300) | NCSA Nebula Outage | NCSA | Nebula will take an outage to balance and build a more stable setup for the file system. This will require a pause of all instances, and Horizon being unavailable. | Nebula is back to normal. |
| 2017-03-16 (0430) | 2017-03-16 (0930) | LSST monthly maintenance | NCSA | GPFS filesystems will go offline for entire duration of outages. Some systems may be rebooted, especially those that mount one or more of the GPFS filesystems. | |
| 2017-02-22 1415 | 2017-02-22 (1615) | Nebula Gluster Issues | NCSA | All Nebula instances paused while gluster repaired | Nebula is available. |