Skip to content
/ eodm Public

Library and CLI application used to collect common functions and ETL operations for EO data.

License

Notifications You must be signed in to change notification settings

geopython/eodm

Repository files navigation

eodm - EO Data Mover

build

Library and extensible CLI application for ETL (extract, transform, load) operations on EO data.

Concept

Below are the main ideas on how to use the application. Note the shell piping operator, the intended use case is such that output of one command is piped into the next. With this a clear interface is required between the commands. For this purpose the STAC Item is chosen.

eodm extract stac-api items https://earth-search.aws.element84.com/v1 sentinel-2-l2a --bbox 49.1,18.1,49.2,18.2 --datetime-interval 2023-06-01/2023-06-30 \
| eodm transform metadata band-subset red,green,blue,nir \
| eodm load stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/
eodm extract stac-catalog items s3://my-bucket/catalog.json \
| eodm load stac-api items https://stac2.hub-dev.eox.at/

There are also library functions which are thin wrappers around popular libraries, with some custom implementations for certain sources.

Current support

Extract

extract features CLI lib
stac-api items
stac-api collection(s)
stac-catalog items
stac-catalog collection(s)
OData
Opensearch
OGCAPI - Records

Transform

transform features CLI lib
subset bands
clean metadata

Load

extract features CLI lib
stac-api items
stac-api collection(s)
stac-catalog items
stac-catalog collection(s)

Plugins

There is support for writing plugins for extract and load from and to custom endpoints as well as transformers. Refer to the docs for more information.

About

Library and CLI application used to collect common functions and ETL operations for EO data.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 3

  •  
  •  
  •