Date
Attendees
Igor Gaponenko Fritz Mueller Andy Salnikov Andy Hanushevsky Joanne Bogart John Gates Unknown User (npease)
Discussion items
Discussed | Item | Who | Notes |
---|---|---|---|
Project news |
| ||
(unfinished) Progress on topics discussed at the previous meeting Database Meeting 2022-05-18 | Generating overlaps when partitioning director and child tables:
Improving error reporting in Qserv:
| ||
DP02 | Igor Gaponenko: on the status of processing and ingesting the remaining tables into Qserv. This catalog represents 1/60th of the LSST DR6. The amount of data (per table) to be ingested is shown below: Table | Status | Size on disk (MySQL data directories) ------------------------+-----------------------+-------------------------------------------------- Object | ingested | 3 TB Source | ready to be ingested | 8 TB (estimated) ForcedSource | processing input data | 29 TB (estimated based on 33% of data processed) ForcedSourceOnDiaObject | processing input data | 3 TB (estimated based on 33% of data processed) The amount of data in other tables doesn't exceed 1 TB. The The Igor Gaponenko will need to inspect the status of the Ingest system in IDF to see if it needs to be upgraded to include the latest features. And if the upgrade is needed then Fritz Mueller will build and deploy it in IDF ( Fritz Mueller has mentioned the RFC that's related to the observed problem: - RFC-844Getting issue details... STATUS Andy Salnikov has reported on his experience of using Andy Hanushevsky: a new version of the translation is available:
Andy Salnikov: there is the Python tool for exploring metadata and structure of the Fritz Mueller: there is a related discussion on: https://stackoverflow.com/questions/36140264/inspect-parquet-from-command-line Action items for Igor Gaponenko:
Fritz Mueller: on the status of the IVOA tables
Fritz Mueller: disk storage in IDF
| ||
leftover from the previous meeting | Qserv in IDF fails to lock tables in the memory | Context:
Action items (no assignee yet):
|