Igor Gaponenko Fritz Mueller Andy Salnikov Colin Slater Kian-Tat Lim Fabrice Jammes Andy Hanushevsky Joanne Bogart
Discussed | Item | Who | Notes | |
---|---|---|---|---|
Project news | Fritz Mueller on the project news:
Office spaces in Building 50. We've been contacted by the SLAC IT/Admin folks. Shared group space in ROB is an option for up to 4 people in one room. Staying on B50 would require being present on site for at least 3+ days a week. Anyone interested in a situation with the prospective shared office space should contact Christine Soldahl directly. | |||
User-generated data products in Qserv | Context:
Colin Slater: A big question is on a possible user interface for this. It has to be interactive because users are not aware of the specific requirements of Qserv. So, the interface would need to ask them additional questions before proceeding with the ingest. Discussed an option of setting up the browser-based ingest "wizard" for requesting and managing the data ingest interactively:
Colin Slater on a minimal set of the formats supported here:
Igor Gaponenko mentioned a use case of ingesting results of the
| |||
Technical discussion on scaling ingests in the Replication/Ingest system | Context:
Igor Gaponenko proposed the following solution:
The following JIRA ticket has been registered to address this case: | |||
Extending qserv-ingest to support the Parquet-to-CSV and partitioning phases | team | Fabrice Jammes will discuss it with the FrDF colleagues first. After that, someone would begin working on this project. Fritz Mueller thinks Igor Gaponenko should begin using | ||
On building the table statistics (row counters) for optimizing certain classes of Qserv queries | Context:
Igor Gaponenko: On collecting the table statistics. It's been documented in the new version of the documentation on the Ingest system: Managing statistics for the row counters optimizations. This step can be done as a part of the catalog ingest campaign or a posteriori. | |||
Moving documentation on the Ingest system into Git | team | Fabrice Jammesmentioned issues with finding the Confluence-based documentation on the Ingest system. Suggested moving it to GitHub. In the meantime, it would be nice to have a link to Confluence from the Git-based documentation on Qserv. Fritz Mueller eventually, we would have to move this document to Git. We have an example of how the documentation on Qserv would look like using the customized styles at: https://documenteer.lsst.io/guides/index.html |