| Demo of cluster-wide distributed logging | | - Logging system based on Kibana and
fluentd demonstrated. Able to collect messages by ingesting (and reading the tail of) existing physical log files, as well as by connecting to syslog message streams. - Already ingesting JupyterLab and Qserv logs.
- Discussion of access to host logs:
- May we have a small number of key people have direct access to the logs?
- Would it be possible to ingest the logs to Kibana?
- Is there an API for Kibana? Yes. Is there a facility for setting up alerts? Yes, a very complex one.
- Storage is currently local to the hosts.
- Authorization not configured yet. Starting to explore some basic possibilities.
- When can this be made available? Sometime after Unknown User (cbanek) comes back from the IVOA meeting.
- Any chance of making the prototype available to the Qserv team, even without auth, behind the VPN?
- Brian: we could put it behind the Oauth proxy
|