Code

WIP: feat/glide destination#2

Code

Draft

activescott wants to merge 39 commits intomasterglideapps/airbyte:masterfrom

feat/glide-destinationglideapps/airbyte:feat/glide-destinationCopy head branch name to clipboard

Commits

Commits on Feb 17, 2025

• wip: feat: initial logging destination for glide

  

  activescott

  authored and

  schani

  committed
  9500be5

  Copy full SHA for 9500be5

• wip: glide api client

  

  activescott

  authored and

  schani

  committed
  7f1649f

  Copy full SHA for 7f1649f

• wip: gbt strategy progress

  

  activescott

  authored and

  schani

  committed
  73f4a86

  Copy full SHA for 73f4a86

• chore: minor cleanup, move delete_all decision into the strategy

  

  activescott

  authored and

  schani

  committed
  dc74465

  Copy full SHA for dc74465

• chore: cleanup logging

  

  activescott

  authored and

  schani

  committed
  47fdd74

  Copy full SHA for 47fdd74

• fix: AttributeError: 'Column' object has no attribute 'name'

  

  activescott

  authored and

  schani

  committed
  4983062

  Copy full SHA for 4983062

• fix: was adding duplicate rows to gbt

  

  activescott

  authored and

  schani

  committed
  388df6e

  Copy full SHA for 388df6e

• feat: choose a strategy based on config; unify tests

  

  activescott

  authored and

  schani

  committed
  71cf51e

  Copy full SHA for 71cf51e

• fix: glide_api_version configuration was not honored

  

  activescott

  authored and

  schani

  committed
  94ca0bc

  Copy full SHA for 94ca0bc

• fix: batch row adds in rest api

  

  activescott

  authored and

  schani

  committed
  2fdcd4f

  Copy full SHA for 2fdcd4f

• fix: batching row adds in mutations api to prevent error: add rows failed with status 400: {"message":"More than 500 mutations"}" in mutation api

  

  activescott

  authored and

  schani

  committed
  5ea2963

  Copy full SHA for 5ea2963

• fix: update api host config to include protocol

  

  activescott

  authored and

  schani

  committed
  24468cc

  Copy full SHA for 24468cc

• fix: serialize columns for prepare tables with kind

  

  activescott

  authored and

  schani

  committed
  e24d8a6

  Copy full SHA for e24d8a6

• fix: add option to ignore columns

  

  activescott

  authored and

  schani

  committed
  7138915

  Copy full SHA for 7138915

• chore: remove unused rows code

  

  activescott

  authored and

  schani

  committed
  b044d2b

  Copy full SHA for b044d2b

• feat: snuggle rows in a batch

  

  activescott

  authored and

  schani

  committed
  8de46e9

  Copy full SHA for 8de46e9

• chore: cleanup logging

  

  activescott

  authored and

  schani

  committed
  8a33201

  Copy full SHA for 8a33201

• feat: support multiple streams from source

  

  activescott

  authored and

  schani

  committed
  17239a7

  Copy full SHA for 17239a7

• docs: Readme update to help others dev-test locally

  

  activescott

  authored and

  schani

  committed
  77bc93a

  Copy full SHA for 77bc93a

• fix: updates the 'add rows' API request to support the new payload shape + tests

  

  activescott

  authored and

  schani

  committed
  7c2e2ce

  Copy full SHA for 7c2e2ce

• fix: update to new api domain, remove API 'version' config

  

  activescott

  authored and

  schani

  committed
  fff1f05

  Copy full SHA for fff1f05

• feat: pushes airbyte to Glide GCP Artifact registry

  Show description for 824f67d
  

  activescott

  authored and

  schani

  committed
  824f67d

  Copy full SHA for 824f67d

• fix: updated the docker push script to optionally tag the pushed image as latest

  

  activescott

  authored and

  schani

  committed
  2edeb2a

  Copy full SHA for 2edeb2a

• chore: temporary script that is pushing to airbyte cloud. You'll need to modify the values

  

  activescott

  authored and

  schani

  committed
  1441dca

  Copy full SHA for 1441dca

• Update README to clarify setup steps

  

  chkn

  authored and

  schani

  committed
  dc76b14

  Copy full SHA for dc76b14

• Fix doc comment

  

  chkn

  authored and

  schani

  committed
  a46808d

  Copy full SHA for a46808d

• Tidy a bit; no need to call create stash endpoint anymore

  

  chkn

  authored and

  schani

  committed
  19551c2

  Copy full SHA for 19551c2

• Ignore columns that aren't in the schema

  

  chkn

  authored and

  schani

  committed
  00a7e95

  Copy full SHA for 00a7e95

• Simplify: encapsulate buffering into Glide client, don't bother with state

  

  chkn

  authored and

  schani

  committed
  5a89e51

  Copy full SHA for 5a89e51

• Fix up tests

  

  chkn

  authored and

  schani

  committed
  7c21f2c

  Copy full SHA for 7c21f2c

• push-docker-image: ignore "latest" tag

  

  chkn

  authored and

  schani

  committed
  2e506c7

  Copy full SHA for 2e506c7

• fix: this builds the AMD64 architecture image explicitly and pushes to Airbyte's repo for suing it in Airbyte Cloud (#13)

  

  activescott

  authored and

  schani

  committed
  40a730c

  Copy full SHA for 40a730c

• fix: destination would fail when a source reported columns without any type (#14)

  Show description for a965978
  

  activescott

  authored and

  schani

  committed
  a965978

  Copy full SHA for a965978

• Test for current 413 behavior

  schani

  committed
  48251d9

  Copy full SHA for 48251d9

• Split when 413 happens

  schani

  committed
  a355d87

  Copy full SHA for a355d87

• Test that the correct rows are posted

  schani

  committed
  7914fe8

  Copy full SHA for 7914fe8

• Test with different payload size thresholds

  schani

  committed
  d6c7672

  Copy full SHA for d6c7672

Commits on Feb 19, 2025

• Use PUT for the stashes, not POST

  schani

  committed
  77e2c17

  Copy full SHA for 77e2c17

• Push to our docker registry

  schani

  committed
  7ee5e69

  Copy full SHA for 7ee5e69