Lunch and tour NCSA facility (we can have lunch delivered for those who want to visit the facility)
DM-10 (Portal) descope discussion (30 min)
wrap up, and establish timeline for agreed upon tasks (30 min)
hack session: DAX set up WebDAV and SUIT access it from portal
User workspace requirements
Need a new term to refer to user-created tables that are do not bring the full spectrum of "Level 3" requirements; i.e., user uploads a random catalog, what do we call that?
Context: Gregory suggested that a user could make a "level 3" data product on their home computer, but Frossie suggests this shouldn't be conflated with products stored on the DAC
Need to clearly specify that we support a MyDB-type storage of arbitrary data, does not have to be related-in-scientific-meaning to the LSST data products
Determine how tables will be uploaded to MyDB, either by Portal or Notebook or external clients.
There was a discussion of "direct access to consolidated database", beyond capabilities of IVOA protocols. Need to follow up on whether this is mediated by DAX services or if some form of more direct connection to consolidated DB is acceptable.
Science platform requirements say MyDB reqs are "still in development"
Scope effort for providing user-facing crossmatches/comparisons with other surveys, beyond those that are already in-use for Pipelines validation.
What are the sizes of user-generated data in existing archives? Our 10% for users is probably too small.
Leanne Guy will ask Gaia archive for user data volumes.
What is the story that we will tell reviewers for how external groups will leverage more compute/storage, of their own acquisition, beyond the 10%? What development requirements does such a system impose on us, and what decisions do we need to make to support this "beyond 10%" capability? Do we have appropriate requirements in the baseline, and to support evolving this N-years into operations?
Leanne Guy will write a tech note listing some "Level 3"/"MyDB" science use cases and present first version at SST/DMLT F2F Nov 2018
Arch and Blockers
Raise at DMLT the question of whether Google is a required deployment target.
Raise at DMLT whether the parquet support should be added to the portal.
Kian-Tat Lim to raise at DMLT that the DMTN-094 proposal would require a token server to be built and is not yet assigned to a WBS.
Colin Slater to raise the A&A/security usage patterns at SST, develop a document describing the user stories.
In the Thursday A&A session, Kian-Tat Lim proposed to write up the identity-based authentication system as an initial sufficient system to build. The more sophisticated capabilities-based system could be developed as an evolution of that, closer to or during operations.
DMTN-094 update should include a comparison to what other archives are implementing.
Kian-Tat LimGregory Dubois-Felsmann to write up options for standardizing the names and meanings of capabilities. Proposed methods are: 1) change-controlled document 2) shared library 3) shared service.
After we codify our DMTN-094-level design, we need to collaborate (via IVOA) on improving the authentication capabilities of non-LSST clients (topcat, pyvo). Arch team responsibility?
Suggested topics for discussion
Time required (estimate)
Deployments of all three aspects within one instance
There are a couple parks within walking distance of the hotel -- Mattis Park and the Boulware Trail to the west and Hessel Park to the north.
The University of Illinois Willard Airport is 5 miles south of the Home2suites in the village of Savoy. Taxi, Lyft, or Uber should be about $12 plus tip.
C-U buses generally cost $1 per one-way trip. iStops are campus stops where it is unnecessary to pay a fare to ride the Gold, Illini, Silver, Teal, and Yellow routes. iStop locations are indicated on individual route maps with an iStop symbol (an orange octagon with a white "i" inside) and are identified as such on bus stop signs at the stop location.
A Gold route stop is a long block north of the hotel at State and Kirby. Disembark at the Ceramics building shelter on Goodwin Avenue; NCSA is 0.3 miles north. Take Gold East to NCSA, Gold West to the hotel.
Use the C-U MTD Trip Planner to investigate times and options, but beware of options having you board/disembark at Lot E-14 or St. Mary's and Oak. To get to/from the hotel you have to traverse the narrow St. Mary's Road under an overpass with no sidewalk or shoulder and plenty of morning/evening traffic.