Skip to content

Granite-vision / llava_next fix for AIU: explicit call embedding layer#490

Merged
kaoutar55 merged 2 commits into
foundation-model-stack:mainfrom
sahilsuneja1:llava_next_head_dim_fix1
Nov 20, 2025
Merged

Granite-vision / llava_next fix for AIU: explicit call embedding layer#490
kaoutar55 merged 2 commits into
foundation-model-stack:mainfrom
sahilsuneja1:llava_next_head_dim_fix1

Conversation

@sahilsuneja1

@sahilsuneja1 sahilsuneja1 commented Nov 19, 2025

Copy link
Copy Markdown
Contributor

Explicitly calling embedding layer in llava_next.py as opposed to doing this in the language_model component-- being ignored in AIU run for some reason, leading to incorrect output otherwise.

Signed-off-by: Sahil Suneja <suneja@us.ibm.com>
…_model()

Signed-off-by: Sahil Suneja <suneja@us.ibm.com>
@sahilsuneja1

Copy link
Copy Markdown
Contributor Author

cc: @kaoutar55 @rzbhatti

@rzbhatti

Copy link
Copy Markdown
Contributor

lgtm!

@kaoutar55 kaoutar55 self-requested a review November 20, 2025 14:50
@kaoutar55 kaoutar55 merged commit 665320a into foundation-model-stack:main Nov 20, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants