wPerp. This does not seem to be a multimatch issue. We need a ticket for wPerp specifically. There may be a short term fix.
Jeffrey Carlin to make a ticket for wPerp issue and add Yusra as watcher .
Separate issue with multimatch. Consumes large amount of memory. Our proposed solution is communicating that the fix is on the way. In parallel, we need to make progress on parquet conversion of the catalog matching.
Jeffrey Carlin to try the backport to make a minimal change to add filtering prior to catalog matching, still using the FITS catalog inputs (see DM-26987). Assess feasibility to make the backport.
JIRA ticket for multimatch
The parquet conversion involves a few steps
Merge the current selectors PR
Improvements to catalog matching
Shorter term fixes:
Use column store
Filtering on sources
There is a longer term issue of matching algorithm. Tasks should have an outer layer that speaks butler, and an inner layer that works with in-memory objects.
Converting other metrics to use parquet inputs
Back porting to v23 processing. The deadline is in a few days.
We have an option to turn off faro for DP0.2 processing
In-progress and ToDo tickets have been moved to the new S22 epic. There are 3 remaining tickets to be closed out (currently In Review or Reviewed) in the F21 epic, then we can close out the f21 epic.
Status of selectors PR (DM-32611)
Building off of selector actions
Introducing base class for measurement configs to specify the columns to be loaded from the parquet tables in a more straightforward way. May want to consult with Jim whether this belongs with pexConfig before merging into faro.