What's Changed

• 🐛 Fix vision HF prefixes for llava_next by @gkumbhat in #539

Full Changelog: v1.12...v1.12.1

What's Changed

• ⚡ Improve mistral3 perf by replacing masked scatter by @gkumbhat in #531

Full Changelog: v1.11.1...v1.11.2

What's Changed

• Fix llava next text by @gkumbhat in #532

Full Changelog: v1.11.0...v1.11.1

What's Changed

• Update transformers 5.x.x by @flaviabeo in #523
• feat(trust-remote-code): Add trust_remote_code support for HuggingFace model loading by @prashantgupta24 in #526
• 🐛 Run weight expansion before RoPE permutation and use correct head size by @gkumbhat in #527

Full Changelog: v1.10.1...v1.11.0

What's Changed

• 🐛 Fix pad token id resolution in padding function by @gkumbhat in #512

Full Changelog: v1.10.0...v1.10.1

What's Changed

• Qwen3 Embeddings Support by @flaviabeo in #510
• ⚡ remove extra kv cache validation by @joerunde in #524

New Contributors

• @joerunde made their first contribution in #524

Full Changelog: v1.9.0...v1.10.0

What's Changed

• [Bugfix] device mismatch in loglikelihood evaluation for lm-eval by @yannicks1 in #515
• [Feature] batch support for lm-eval function loglikelihood() by @yannicks1 in #522
• Add ministral3 by @gkumbhat in #518

Full Changelog: v1.8.0...v1.9.0

What's Changed

• Add support to openai/gpt-oss-20b [Not supported by Spyre] by @flaviabeo in #459
• Transformers upgrade to 4.57.6 by @flaviabeo in #516
• Fix llama 2 10 by @gkumbhat in #520
• Fix fms-model-optimizer dependency for Pypi by @flaviabeo in #521

Full Changelog: v1.7.0...v1.8.0

What's Changed

• Fix Llava Next Reset Parameters by @alex-jw-brooks in #504
• Multimodal Mistral by @alex-jw-brooks in #502
• 🐛 Fix vision features attention calculation by @gkumbhat in #507

New Contributors

• @gkumbhat made their first contribution in #507

Full Changelog: v1.6.0...v1.7.0

What's Changed

• expansion adaper to allow language model for llava-next by @rzbhatti in #486
• ModelConfig.updated(**kwargs) method to support mulimodel config by @rzbhatti in #484
• Fixed the _hf_to_fms_rope by @rzbhatti in #489
• Granite-vision / llava_next fix for AIU: explicit call embedding layer by @sahilsuneja1 in #490
• [doc] MultiHeadAttention: add kvheads to docstring by @yannicks1 in #487
• Fixed paged implementation to include cuda by @JRosenkranz in #481
• Update training scripts to new FMS conventions by @ani300 in #473
• Fix Reloaded Model Config Types for Composite Models by @alex-jw-brooks in #492
• Add Tests for FMS Model Kwarg Correctness by @alex-jw-brooks in #493
• Refactor HF Config -> FMS Model Kwarg Building by @alex-jw-brooks in #494
• Added granite_v4.py to support 8b model by @rzbhatti in #497
• Fix Parallel Config for Nested Models in Llava Next by @alex-jw-brooks in #500

New Contributors

• @yannicks1 made their first contribution in #487
• @alex-jw-brooks made their first contribution in #492

Full Changelog: v1.5.0...v1.6.0