Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • planning to switch away from zookeeper, and use mysql instead. Reasons:
    • headaches with C++ bindings to zookeeper, forced us to use python in hacky way when loading data from zookeeper
    • we are less thrilled with watchers than we originally were (watcher can miss sending notifications, essentially making it much less useful for us)
    • we have some (not really proven) reservations about write/update performance, though some official zookeeper benchmarks claim 20K updates per sec
    • we are using zookeeper less than we were originally hoping planning (query metadata info is in mysql, data distribution info will most likely be in distributed hash table), and we have mysql system for this sort of things anyway (for query metadata), thus simplifying the system and removing some moving parts like zookeeper is good
  • Nate will be working on it
    • adding support for updates to CSS 
    • implementing locking
    • unifying c++/python APIs (kv interface) - we want the C++ to be the master API, and expose it to python layer

...