Date

Attendees

Notes from the previous meeting

Discussion items

DiscussedItemNotes
(tick)Project news
  • Anything from DMLT?
  • News from the last Data Facilities meeting on Qserv expansion at USDF
    • 1 week power outage in June/July
  • SLAC travel to DM JTM in Chile?
    • Link to the hotel at Las Serena: https://clublaserena.com/?lang=en
    • instructions on 
    • not advised to travel with the passport that that's about to expire within the next 6 months
  • Week of Feb 28th through March 2 Join Operation Review at SLAC:
    • local people are encouraged to participate (be present at the reviews)
    • demo may be required
(minus)Investigating worker lockups

Recent developments:

  • 2023.1.1-rc2 with recent fixes and improved worker monitoring (including extended Web Dashboard) deployed and tested at IDF (-int). Qserv still locks up.
  • Igor Gaponenko has made progress with:
    • DM-37854 - Getting issue details... STATUS
    • trying to look at the performance of the worker tasks (how much time is spent executing queries vs sending result sets to Czar). Tasks reported by Qserv worker db06 
    • MySQL connections that were active at the same time
    • Observation: most tasks are in the "stealth" mode. They have booted off their schedules and they are silently sending data (*VERY* slowly) to Czar. No stats exists in Qserv for those.
    • details will be reported at the meeting

Action items

  •