Home

Berkeley Smart Grid Store

Welcome to the Berkeley Smart Grid Store user manual.

Smart Grid Store is a distribution of the Berkeley Tree Database (BTrDB) that also (optionally) includes components that support storing, manipulating and analyzing electric grid data.

Smart Grid Store, or SGS, consists of the following components:

• BTrDB: the timeseries database that stores all the data
• Multi Resolution Plotter (Mr. Plotter): an efficient, uncomplicated plotter for visualizing and exploring massive datasets in real-time
• AdminCLI: A supervisory admin text-based console that allows monitoring and configuring the cluster
• pmu2btrdb: A high performance direct-path ingress daemon for Power Standards Lab microsynchrophasors
• receiver/sync2q: A buffered-path ingress daemon pair for uPMUs that preserves the raw files produced by the devices for debugging or recovery at the expense of performance

We are working on developing the following components for the latest version of SGS:

• DISTIL: continuous analysis and transformation of BTrDB streams
• Jupyter notebooks: a preconfigured python notebook setup for quick custom analysis
• IEEE C37 ingress daemon: for connecting to third party synchrophasor systems

SmartGridStore relies upon third party software:

• Kubernetes: a container orchestration framework
• Ceph: a software defined storage layer

Both of these dependencies are rock solid, and have available enterprise support contracts. Note that at present we do not support OpenSHIFT, the commercial Kubernetes distribution by Red Hat, as we use features in Kubernetes upstream that have not made it to openshift yet, but if there is enough interest we may reconsider this choice.

An enterprise support contract for Smart Grid Store is available upon request, and is provided by PingThings Inc.. Please contact them directly if you are interested.

Overview

The installation procedure is broken into a few sections, that you can pick and choose based on what kind of platform you are installing on. The only supported configuration is installation on to three or more dedicated instances (whether that be EC2 instances, VMs or physical servers) running Ubuntu 16.04.1. As a result, the installation script will assume it is free to install whatever is required, reboot and otherwise reconfigure the servers. If you are using this set of scripts on existing servers, please read the through the script beforehand and ensure they will not disrupt your services.

Step 1: Set up new EC2 instances

This stage will walk you through setting up some new EC2 instances to run BTrDB and the Berkeley Smart Grid Store.

Step 2: Setting up the quickstart environment

Next we will set up the quickstart environment so that the commands know how to find and communicate with your servers.

Step 3: Preparing your servers

This stage will ensure that your servers are up-to-date, have Docker installed, have a healthy Etcd cluster, and running Fleet.

Step 4: Creating and executing an installation plan

Here, the quickstart kit will scan your servers for you, and suggest an installation plan. You then need to modify that plan and approve it. Here is where you can choose which services run on which servers.

Step 5: Managing the stack

Once installation is complete, accounts can be created on the plotter (the default is all data public) and synchrophasors can be configured to load.