added consolidated: true to hrrrzarr source in catalog and updated instructions to add that argument. This improve performance of the notebooks considerable. (#16)

Author: jnmorley

notebooks/catalog.yml

@@ -13,9 +13,8 @@ sources:
     metadata: {}
   hrrrzarr:
     args:
-      chunks:
-        projection_x_coordinate: 1799
-        projection_y_coordinate: 1059
+      chunks: null
+      consolidated: true
       storage_options:
         anon: true
       urlpath:

notebooks/creating_catalogs.ipynb

@@ -173,12 +173,10 @@
     "urls = ['s3://hrrrzarr/sfc/20160824/20160824_00z_anl.zarr/surface/TMP/surface',\n",
     "           's3://hrrrzarr/sfc/20160824/20160824_00z_anl.zarr/surface/TMP']\n",
     "\n",
-    "chunks = {'projection_x_coordinate': 1799,\n",
-    "          'projection_y_coordinate': 1059}\n",
+    "source = intake.open_zarr(urls, chunks=None,\n",
+    "                          storage_options={\"anon\": True},\n",
+    "                          consolidated=True)\n",
     "\n",
-    "so = {\"anon\": True}\n",
-    "\n",
-    "source = intake.open_zarr(urls, chunks=chunks, storage_options=so)\n",
     "source.name = 'hrrrzarr'\n",
     "source.description = \"Mesowest's HRRR data. See readme source for more information.\"\n",
     "ds = source.read()\n",
@@ -189,7 +187,7 @@
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "Above we used the `storage_options` argument to tell Intake how to access data on AWS. In this case we accessed the data as an anonymous user.\n",
+    "Above we used the `storage_options` argument to tell Intake how to access data on AWS. In this case we accessed the data as an anonymous user. The `consolidated=True` argument is given to tell [Xarray](https://foundations.projectpythia.org/core/xarray.html) how to load the metadata for this source. Zarr data may contain consolidated metadata. If it does, using it can increase performance significantly.\n",
     "\n",
     "When you use Intake's `open_{driver}` methods, it creates a catalog entry for the source. You can view the yaml using the source's `yaml` method."
    ]
@@ -433,7 +431,7 @@
    "source": [
     "## Testing the Catalog\n",
     "\n",
-    "Now that your catalog is on Github let's try using it. In the cell below replace the url with the url pointing to the raw catalog file on Github"
+    "Now that your catalog is on Github let's try using it. In the cell below replace the url with the url pointing to the raw catalog file on your Github account"
    ]
   },
   {