Skip to content

Tags: oluka007/llama-cpp-python

Tags

v0.3.34-cu130-Basic-win-20260406

Toggle v0.3.34-cu130-Basic-win-20260406's commit message
feat(types): align with latest OpenAI OpenAPI spec (audio, structured…

… outputs)

- Add `developer` role.
- Replace Anyscale-specific JSON schema with official OpenAI `json_schema` response format for Structured Outputs.
- Add `input_audio` and `file` types to request message content parts.
- Add `audio`, `refusal`, and `annotations` (e.g., URL citations) fields to response messages.
- Add `content_filter` to finish reasons and strictly define global `ChatCompletionRole`.

Signed-off-by: JamePeng <jame_peng@sina.com>