You are viewing an old version of this page. View the current version .
Compare with Current
View Page History
« Previous
Version 5
Next »
Date 03 Nov 2016
Attendees Goals Review progress toward PDAC completion at the end of the month Discussion items Time Item Who Notes NCSA / infrastructure Unknown User (jalt) Going to announce on Monday that lsst-dev01
will be in full operation in two weeks Looking at the sizing model this month, looking for ways to improve it Looking at DRP/Princeton needs for QA Discussion of handling 100 sq. deg. of HSC public-dataComparison of this to the Data Access group's need for further scaling tests QA system appears to need the interactive creation of user databases Discussion of whether the QA system can be hosted on the same cluster as the S82/WISE PDAC All hosts in the PDAC cluster are functioning SLAC / Data Access - Qserv Igor Gaponenko Stripe 82 catalog databases have been loaded into Qserv; simple tests seem to be workingHave not tried performance / large-scale tests yet Lots of changes to the loading procedure were required in order to make this efficient & correct Procedure is now highly parallel Next step: produce a writeup on loading, especially for Unknown User (speckins) 's useShould be possible to experiment with loading additional databases without affecting S82 data Working on better file organization for the image data Ran into some problems with respect to time stamps / time zones in creating Docker containers (see
DM-8119
-
Getting issue details...
STATUS
)Interpreting logs when containers have a different time zone than the host OS Interpretation of time stamps in the database data Unknown User (jalt) : NCSA is very happy to go to uniform UTC time zone settings in production services SLAC / Data Access - DAX Brian Van Klaveren Ready to redirect dbserv
at the Qserv cluster Qserv is now up, so we should try to do this today Still working on getting metaserv
up today and tomorrow John Gates made progress on imgserv
and we will make some images available todayJohn Gates : raw images and cutouts are now workingNeed Jim Bosch 's changes to afw
deployed in order to get codas working, may take a couple of days IPAC input: please prioritize getting Qserv going behind {{dbserv}} Everybody is OK with giving first priority to dbserv
-Qserv and imgserv
-raw/calexp Some discussion with Unknown User (ymei) of whether DAX is giving accurate reports of float vs. double column typesConclusion: prioritize getting metaserv
up to produce accurate answers in preference to fixing the immediate issue IPAC / SUIT Trey Roby Working on getting multiple types of searches attached to dbserv
from the UI. Have demonstrated full round trips from the UI to the current temporary dbserv
. Really need the actual Qserv service in order to continue to make progress.These search processors are already running on the PDAC Firefly deployment Load-balancing server is up and runningPlanning to put the DAX services behind the load-balancer as well Planning to do direct DAX queries from an IPython notebook as a proof-of-concept, with Firefly visualization in the notebook Have started the creation of the PDAC Firefly application pageWill bring in the IRSA light curve viewer once the images are available
Action items