Database Meeting 2023-01-25

Fritz Mueller:

• office moves are underway
• news from DMLT
  • Vincent R. is leaving the Camera team for LLNL
  • Fundraising for Simon K.:
    • TBC: links
• The operations review is coming up end of February
• (Project) schedule workshop this week. The possible impact of the recent safety incident/standdown on the project and camera (shipping) schedule. It's possible ComCam could be back on the schedule.  More info when we have it.
• Travel to Chile
  • E-mail updates posted by Yusra. A few forms are to be filled. It's a good idea to get there on the weekend. Flights in both directions are overnight.
  • Details on traveling on SLAC funds are yet to be clarified. 
• USDF:
  • The first big hardware order has landed. That includes 15 nodes for Qserv (as specified). The systems are expected to be placed into racks within the next few weeks. The nodes will be included in the Qserv k8s cluster.
  • Working on the next batch, including 30 more Qserv nodes. We need to discuss storage options for the new nodes.
  • Butler "meltdown" in USDF: error messages when accessing Butler. Database corruption was identified as the root cause of the problem. Details are coming.
• Discuss possible changes in the group meeting schedule. Considering options for moving the meeting to some other day: Tuesday or Thursday.

Colin Slater, Fritz Mueller :

• Prototype TAP uploads are underway
• The uploads need to land within Qserv

Fritz Mueller will contact GPDF to discuss the details

Status/progress:

• extended monitoring of Qserv workers via Web Dashboard (Igor Gaponenko)
• fixup to the query cancellation (John Gates )
• John Gates a shortage of MySQL doesn't seem to be a problem (a reason for the lockups)

Next/ongoing steps:

• Fritz Mueller is going to build a new release to include the latest improvements from 
• Igor Gaponenko is working on adding more monitoring plots for Qserv workers. These should be ready by the end of the day today.
• Fritz Mueller was wondering about a lingering ticket for "making XROOTD connections reusable"
  • The benefits and an effect of this change aren't clear. Need some clarification from Andy Hanushevsky.
• Fritz Mueller we can build the new release at any time
• John Gates we need to deploy existing monitoring improvements at IDF in the new release

Postponed since Fabrice Jammes wasn't present at the meeting

Fritz Mueller:

• to Colin Slater:
  • Qserv documentation can be found at: https://qserv.lsst.io/
  • the latest documentation won't be available before a new Qserv release will be built
• demo on building the documentation in the development container

Andy Salnikov :

• started looking at the Butler client/server architecture
• Butler wasn't designed for that
• look problematic due to a complex client state that would need to be moved around