geospatial-data-catalogs

Introduction

Some of the popular cloud-computing platforms (e.g., AWS, Google Earth Engine, Microsoft Planetary Computer, NASA's Common Metadata Repository (CMR)) host a lot of publicly available geospatial datasets. This repo compiles the list of all geospatial datasets on these platforms as a CSV file and as a JSON file, making it easier to find and use them programmatically. The list is updated daily.

Usage

This repo provides the list of geospatial datasets in two formats:

Tab separated values (TSV) format

• AWS Open Data: aws_open_datasets.tsv
• AWS Open Geospatial Data: aws_geo_datasets.tsv
• AWS Open Geospatial Data with STAC endpoint: aws_stac_catalogs.tsv
• STAC Index Catalogs: stac_catalogs.tsv
• Earth Engine Catalog: gee_catalog.tsv
• Planetary Computer Catalog: pc_catalog.tsv
• NASA CMR STAC Catalog: nasa_cmr_catalog.tsv

Copernicus Services Products

• Copernicus Atmosphere: copernicus_atmosphere.tsv
• Copernicus Climate: copernicus_climate.tsv
• Copernicus Emergency: copernicus_emergency.tsv
• Copernicus Land: copernicus_land.tsv
• Copernicus Marine: copernicus_marine.tsv

JSON format

• AWS Open Data: aws_open_datasets.json
• AWS Open Geospatial Data: aws_geo_datasets.json
• AWS Open Geospatial Data with STAC endpoint: aws_stac_catalogs.json
• STAC Index Catalogs: stac_catalogs.json
• Earth Engine Catalog: gee_catalog.json
• Planetary Computer Catalog: pc_catalog.json
• NASA CMR STAC Catalog: nasa_cmr_catalog.json

Copernicus Services Products

• Copernicus Atmosphere: copernicus_atmosphere.json
• Copernicus Climate: copernicus_climate.json
• Copernicus Emergency: copernicus_emergency.json
• Copernicus Land: copernicus_land.json
• Copernicus Marine: copernicus_marine.json

Examples

The TSV file can be easily read into a Pandas DataFrame using the following code:

import pandas as pd

url = 'https://github.com/opengeos/geospatial-data-catalogs/raw/master/aws_geo_datasets.tsv'
df = pd.read_csv(url, sep='\t')
df.head()

Relevant Projects

• A list of open datasets on AWS: aws-open-data
• A list of open geospatial datasets on AWS: aws-open-data-geo
• A list of open geospatial datasets on AWS with a STAC endpoint: aws-open-data-stac
• A list of STAC endpoints from stacindex.org: stac-index-catalogs
• A list of geospatial datasets on Microsoft Planetary Computer: Planetary-Computer-Catalog
• A list of geospatial datasets on Google Earth Engine: Earth-Engine-Catalog
• A list of geospatial datasets on NASA's Common Metadata Repository (CMR): NASA-CMR-STAC
• A list of geospatial data catalogs: geospatial-data-catalogs
• The Maxar Open Data STAC Catalog: maxar-open-data
• Copernicus Services Products Metadata: Copernicus-Services-Products-Metadata