Skip to content

Support for conversion from bytea to long256 #31

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jerrinot opened this issue Apr 14, 2025 · 0 comments
Open

Support for conversion from bytea to long256 #31

jerrinot opened this issue Apr 14, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@jerrinot
Copy link
Collaborator

jerrinot commented Apr 14, 2025

Background

Some clients encode arbitrary precision numerical types as raw bytes when stored in Kafka. While QuestDB doesn't yet have native support for arbitrary precision Numeric types, many of these values can be effectively represented using QuestDB's Long256 type. Currently, this conversion requires implementing third-party transforms.

Current Workarounds

Users currently rely on external transforms to handle this conversion. Open source examples:

Proposed Enhancement

Integrate a native Bytes-To-Long256 trancoder directly into the QuestDB Kafka connector to:

  1. Simplify the data ingestion pipeline for users working with arbitrary precision numbers
  2. Eliminate the need for external dependencies
  3. Provide a consistent, well-tested implementation that matches QuestDB's behavior
  4. Improve overall user experience for financial and blockchain use cases where Long256 is commonly used

Notes

This is an interim solution until QuestDB implements full Numeric type support, but would immediately benefit users working with large integers, cryptocurrency hashes, and similar use cases.

@jerrinot jerrinot added the enhancement New feature or request label Apr 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant