Meredith: updating plotting tools in ap_pipe-notebooks
Ian: worked some on diffim unit tests for simulated data, will be ready for metrics soon
Eric: with Meredith, got cutout→Zooniverse pipeline working on Postgres + Gen3, also did some prototype calcuations/metrics on the cutouts
Gabor: put metadata exploration notebook on Trello board (
diffimTests/tickets/DM-28201_diffim_metadata/inspect_diff_metadata.ipynb). Doesn't seem to be super useful, though, since the metadata system hasn't been extensively used in later pipeline development–might be useful place for us to put new entries going forward. Also thinking some about number of sources detected w/ decorr. afterburner–doesn't think it's a simple increase/decrease. Also working on technote, thinking about preconvolution.
COSMOS shows a small bump in the DIAsrc/source ratio on Mar 1
gen2 and gen3 COSMOS don't agree on object counts–we will ticket this and pick it up in the next sprint planning once we have a bit more history to look at
Lauren MacArthur just popping in here...I'm not entirely sure of the context for these object counts, but if they rely on Gen2/Gen3 parity through singe frame processing we are not quite there yet, but I am working on it (and getting close!) See and . Ignore me if this is entirely irrelevant for this issue!
Gen3 COSMOS runtime looks a little bit better, but this may be because Gen3 doesn't account for I/O time the same way (it's not a walltime calculation)
todos:
Eric Bellm write ticket for Meredith Rawls ( TBC) to investigate differences in object counts between Gen2 and Gen3 COSMOS CI
Ian: Saha bulge catalogs: group has just released a paper on this dataset. Catalog is for their internal use right now, but Ian is going to ask for access for our testing.
