arcgis-utils-go

A command-line tool written in Go to download data from various public ArcGIS sources (Feature Layers, Feature Servers, Map Servers, ArcGIS Online Items including Web Maps) and convert it to common geospatial formats.

Features

Feature	Description
Supported ArcGIS REST API Endpoints	Single Feature Layer URLs (.../FeatureServer/0), Feature Server URLs (.../FeatureServer), Map Server URLs (.../MapServer), ArcGIS Online Item URLs (arcgis.com/home/item.html?id=...) (supports Feature Service, Map Service, and Web Map items)
Layer Discovery	Handles discovery of layers within services and web maps.
Interactive Layer Selection	Provides interactive selection of layers to download.
Export Formats	GeoJSON (.geojson), KML (.kml), GPX (.gpx), CSV (.csv), JSON (.json), Text (.txt)
Configuration Options	Configurable options for file handling, output naming, and request timeouts.
Automated Layer Processing	Process layers from a CSV file, enabling automated workflows.
Versioned Output	Append timestamps to output filenames for versioning.

To-Do

• ArcGIS API Support

Installation

Download the binary for your platform from the releases page.

Usage

Linux/MacOS Example:

arcgis-utils-go-linux-amd64 -url <ARCGIS_URL> [OPTIONS]

Windows Example:

.\arcgis-utils-go-windows-amd64.exe -url <ARCGIS_URL> [OPTIONS]

With Go:

go install github.com/Sudo-Ivan/arcgis-utils/cmd/arcgis-utils@latest

arcgis-utils -url <ARCGIS_URL> [OPTIONS]

Docker

mkdir -p results
chown -R 1000:1000 results
docker run --rm -v ./results:/results -u 1000:1000 ghcr.io/sudo-ivan/arcgis-utils:latest -url <ARCGIS_URL> [OPTIONS]

Building from Source

Ensure you have Go installed (version 1.24 or later recommended).

git clone https://github.com/Sudo-Ivan/arcgis-utils-go.git
cd arcgis-utils-go
make build

This will create an executable named arcgis-utils (or arcgis-utils.exe on Windows) in the bin/ directory.

Usage

./bin/arcgis-utils -url <ARCGIS_URL> [OPTIONS]

Docker Build:

docker build -t arcgis-utils .
docker run --rm -v ./results:/results -u 1000:1000 arcgis-utils -url <ARCGIS_URL> [OPTIONS]

Required:

• -url <ARCGIS_URL>: The URL of the ArcGIS resource to process. This can be a Feature Layer, Feature Server, Map Server, or ArcGIS Online Item page URL.
• -layers-csv <path>: Path to a CSV file containing a list of ArcGIS layer URLs to process. The CSV must have a header row with a column named "URL". When this flag is used, -url is ignored and --select-all is implicitly enabled for layers from the CSV.

Options:

• -format <format>: Output format. Options are geojson (default), kml, gpx, csv, json, text.
• -output <directory>: Directory to save the output files. Defaults to the current working directory.
• -select-all: Automatically select and process all discoverable Feature Layers without prompting.
• -no-color: Disable colored terminal output.
• -overwrite: Allow overwriting existing output files in the target directory. Without this flag, the tool will error if an output file already exists.
• -skip-existing: If an output file for a layer already exists, skip processing that layer instead of erroring or overwriting.
• -prefix <prefix>: Add a specified prefix to all output filenames.
• -timeout <seconds>: Set the timeout in seconds for HTTP requests (default: 30).
• -exclude-symbols: Exclude symbol information (images, styling) from the output. Useful for reducing file size or when symbols aren't needed.
• -versioned-output: Append a timestamp (YYYYMMDD_HHMMSS) to output filenames for versioning.

Examples

1. Download a specific Feature Layer as GeoJSON:

arcgis-utils -url https://services.arcgis.com/P3ePLMYs2RVChkJx/arcgis/rest/services/World_Time_Zones/FeatureServer/0

2. Download all layers from a Feature Server as KML to a specific directory, overwriting existing files:

arcgis-utils -url https://sampleserver6.arcgisonline.com/arcgis/rest/services/EmergencyFacilities/FeatureServer -format kml -output ./kml_output -select-all -overwrite

3. Download selected layers from a Map Server as GPX with a filename prefix:

arcgis-utils -url https://sampleserver6.arcgisonline.com/arcgis/rest/services/USA/MapServer -format gpx -prefix USA_Data_
# (Follow interactive prompts to select layers)

4. Process an ArcGIS Online Web Map item, skipping layers if their output files already exist:

arcgis-utils -url https://www.arcgis.com/home/item.html?id=a12b34c56d78e90f1234567890abcdef -skip-existing

5. Download a Feature Layer as GeoJSON without symbol information:

arcgis-utils -url https://services.arcgis.com/P3ePLMYs2RVChkJx/arcgis/rest/services/World_Time_Zones/FeatureServer/0 -exclude-symbols

6. Download a Feature Layer as CSV with a custom timeout:

arcgis-utils -url https://services.arcgis.com/P3ePLMYs2RVChkJx/arcgis/rest/services/World_Time_Zones/FeatureServer/0 -format csv -timeout 60

7. Download layers from a CSV file with versioned output:

arcgis-utils -layers-csv layers.csv -output ./csv_output -versioned-output

License

MIT License