Versions Compared

Old Version 4

changes.mady.by.user Jim Bosch

Saved on

compared with

New Version Current

changes.mady.by.user Jim Bosch

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

UPDATE FROM 2018-11-12 MEETING WITH CADC REPS

Present: Tim Jenness , Gregory Dubois-Felsmann , Jim Bosch , Pat Dowler, Séverin Gaudet, Stephen Gwyn

  • We should just map CAOM2 Plane directly to LSST Dataset, and hence have a 1-1 mapping between Planes and Artifacts.  The concerns about denormalization of Plane-linked entities with this approach expressed in in the Alternatives section below simply aren't valid; the CAOM2 UML is in some sense maximally denormalized for flexibility, but our internal representation can be as normalized as we'd like.  This solves all of the problems we identified below with fine-grained provenance and CAOM2 productID vs. LSST dataset_id.
  • Representing SkyMap Tracts and Patches as CAOM2 static CompositeObservations with membership defined based only on overlaps (not actual inclusion in any particular coadd) was regarded as completely natural.  This is more or less how CADC use those concepts themselves (i.e. Observation membership represents intent, Plane provenance represents actual contributions).  Not all CAOM2 producers do this (it sounded like perhaps MAST was the exception?), but if anything there would be a push to get others to adopt the philosophy we (and CADC) prefer.
  • Generalizing CompositeObservation membership to permit CompositeObservation (not just SimpleObservation) members (to permit Visits rather than Snaps to be the direct children of Tracts or Patches) is indeed a change to CAOM2, but one that CADC is open to making (they simply didn't have a use case for it until now).  This may involve just unifying SimpleObservation and CompositeObservation.  No one has a use case for this that involves trees with dynamic depth, so we're not overly concerned about the potential for cycles here; we just need to take the usual care for backwards compatibility and due diligence.  CADC will pursue that change over the natural course of negotiating the next version of CAOM.

ORIGINAL REVIEW, 2018-10-04

Collections

Both the Gen3 Butler and CAOM2 define a "collection" concept, and happily they're broadly consistent.

...