fix: Widen Athena integer type mapping for unsigned ints - #6739
Merged
ntkathole merged 1 commit intoAug 18, 2026
Conversation
|
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #6739 +/- ##
==========================================
+ Coverage 46.91% 46.98% +0.06%
==========================================
Files 416 416
Lines 50545 50606 +61
Branches 7252 7262 +10
==========================================
+ Hits 23714 23775 +61
+ Misses 25157 25147 -10
- Partials 1674 1684 +10
... and 7 files with indirect coverage changes Continue to review full report in Codecov by Harness.
🚀 New features to boost your workflow:
|
nikolauspschuetz
marked this pull request as ready for review
August 16, 2026 15:12
ntkathole
approved these changes
Aug 18, 2026
pa_to_athena_value_type mapped every unsigned Arrow int (uint8/16/32/64) to Athena tinyint, a signed 8-bit type (-128..127). Any unsigned value above 127 (e.g. a uint32 column) overflows the type in the generated CREATE TABLE DDL built by aws_utils.py. Widen each unsigned type to the next-larger signed Athena type, matching the widening already used for Postgres in arrow_to_pg_type in this module (uint8->smallint, uint16->int, uint32/uint64->bigint). Signed inputs are unchanged. Adds a regression test for both the widened and signed cases. Signed-off-by: Nikolaus Schuetz <nikolauspschuetz@gmail.com>
ntkathole
force-pushed
the
fix/athena-uint-widening
branch
from
August 18, 2026 04:41
22d0661 to
f70192f
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
pa_to_athena_value_typeinsdk/python/feast/type_map.pymaps every unsigned Arrow int (uint8/uint16/uint32/uint64) to Athenatinyint. Athenatinyintis signed 8-bit (-128..127), so any unsigned value above 127 — e.g. auint32column — overflows the type in the generatedCREATE TABLEDDL.Fix
Widen each unsigned type to the next-larger signed Athena type that holds its full range (Athena has no unsigned integer types):
uint8tinyintsmallintuint16tinyintintuint32tinyintbigintuint64tinyintbigintSame widening
arrow_to_pg_typealready applies for Postgres. (pa_to_mssql_typekeepsuint8->tinyintbecause SQL Server'stinyintis unsigned.) Signed inputs are unchanged.Test
Regression test in
sdk/python/tests/unit/test_type_map.py: fails before (assert 'tinyint' == 'smallint'),2 passedafter.drafted with AI assistance; verified locally (red -> green on the added test).