Working on deploying a new version of imgserv that will support coadds; was built by Brian Van Klaveren last night. Includes fixes from Jim Bosch and John Gates.
Deployed a basic Nagios service.
Currently monitoring status of SQL services (i.e., Qserv czar).
Ready to monitor state of HTTP service endpoints (i.e., DAX webserv) as soon as NCSA changes the puppet configurations to permit it.
Will be able to accommodate monitoring of the SUIT endpoints as well. SUIT will look at making sure that there are useful "no-op" endpoints that support this.
Will also do machine-level monitoring (CPU, memory, disk space).
NCSA has its own production Nagios monitoring. Will look into merging what we need into that.
Following discussions with Mario Juric et al., re-prioritizing work to get the WISE data loaded sooner.
Gregory Dubois-Felsmann has already been working with Igor Gaponenko to test the transfer rates achievable between IPAC and NCSA for the ~3.5TB of WISE ForcedSource-like ("MEP") data. Naive HTTP transfers look like they'll be adequate to just run in the background for a few days. Object table is very small, not a problem. For now, will not explore any alternative data transfer approaches (fast parallel TCP tools or physical media).
Gregory Dubois-Felsmann will look into the readiness of the Source-like tables for bulk distribution.
Thinking about whether PDAC should / needs to host the WISE single-epoch or coadded image data. Using the IRSA image services remotely from PDAC is an option and might lower the workload on the Data Access group, freeing up some effort for QA. Discussion of a hybrid model where the IRSA services are wrapped by DAX imgserv. Discussion of the creation of the camera mapper code that would be needed to support WISE data through the Butler.
This might be an interesting startup project for a new Data Access team member.
Gregory Dubois-Felsmann noted that WISE image data support in the Butler would also be a first step toward enabling pixel processing of the WISE data someday. This is relevant at least because it is an LSST SUIT goal to enable ad-hoc interactive pixel-level analysis.