Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
JDScript
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
Datepicker
All time
Commit history
Commits on Apr 29, 2024
fix: add binding for name in ChatCompletionRequestToolMessage
JDScript
committed
22dc262
View commit details
Copy full SHA for 22dc262
Browse repository at this point
fix(ci): Update generate wheel index script to include cu12.3 and cu12.4 Closes #1406
abetlen
committed
0c3bc4b
View commit details
Copy full SHA for 0c3bc4b
Browse repository at this point
Commits on Apr 28, 2024
ci: Add support for pre-built cuda 12.4.1 wheels (#1388)
Show description for 2355ce2
Smartappli
authored
2355ce2
View commit details
Copy full SHA for 2355ce2
Browse repository at this point
feat: Add support for str type kv_overrides
abetlen
committed
a411612
View commit details
Copy full SHA for a411612
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
c9b85bf
View commit details
Copy full SHA for c9b85bf
Browse repository at this point
chore(deps): bump pypa/cibuildwheel from 2.16.5 to 2.17.0 (#1401)
Show description for c07db99
dependabot[bot]
authored
c07db99
View commit details
Copy full SHA for c07db99
Browse repository at this point
chore(deps): bump docker/build-push-action from 4 to 5 (#1400)
Show description for 7074c4d
dependabot[bot]
authored
7074c4d
View commit details
Copy full SHA for 7074c4d
Browse repository at this point
chore(deps): bump docker/login-action from 2 to 3 (#1399)
Show description for 79318ba
dependabot[bot]
authored
79318ba
View commit details
Copy full SHA for 79318ba
Browse repository at this point
chore(deps): bump actions/cache from 3.3.2 to 4.0.2 (#1398)
Show description for 27038db
dependabot[bot]
authored
27038db
View commit details
Copy full SHA for 27038db
Browse repository at this point
chore(deps): bump conda-incubator/setup-miniconda from 2.2.0 to 3.0.4 (#1397)
Show description for 17bdfc8
dependabot[bot]
authored
17bdfc8
View commit details
Copy full SHA for 17bdfc8
Browse repository at this point
fix: Functionary bug fixes (#1385)
Show description for f178636
jeffrey-fong
and
abetlen
authored
f178636
View commit details
Copy full SHA for f178636
Browse repository at this point
examples: fix quantize example (#1387)
Show description for e6bbfb8
iyubondyrev
authored
e6bbfb8
View commit details
Copy full SHA for e6bbfb8
Browse repository at this point
ci: Update action versions in build-wheels-metal.yaml (#1390)
Show description for c58b561
Smartappli
authored
c58b561
View commit details
Copy full SHA for c58b561
Browse repository at this point
ci: Update dependabot.yml (#1391)
Show description for 9e7f738
Smartappli
authored
9e7f738
View commit details
Copy full SHA for 9e7f738
Browse repository at this point
Commits on Apr 26, 2024
chore: Bump version
abetlen
committed
65edc90
View commit details
Copy full SHA for 65edc90
Browse repository at this point
fix: Remove duplicate pooling_type definition and add misisng n_vocab definition in bindings
abetlen
committed
173ebc7
View commit details
Copy full SHA for 173ebc7
Browse repository at this point
feat: Allow for possibly non-pooled embeddings (#1380)
Show description for f6ed21f
iamlemec
and
abetlen
authored
f6ed21f
View commit details
Copy full SHA for f6ed21f
Browse repository at this point
fix: pydantic deprecation warning
abetlen
committed
fcfea66
View commit details
Copy full SHA for fcfea66
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
7f52335
View commit details
Copy full SHA for 7f52335
Browse repository at this point
Commits on Apr 25, 2024
fix(ci): Fix metal tests as well
abetlen
committed
266abfc
View commit details
Copy full SHA for 266abfc
Browse repository at this point
fix(ci): Fix python macos test runners issue
abetlen
committed
de37420
View commit details
Copy full SHA for de37420
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
2a9979f
View commit details
Copy full SHA for 2a9979f
Browse repository at this point
Commits on Apr 23, 2024
chore: Bump version
abetlen
committed
c50d330
View commit details
Copy full SHA for c50d330
Browse repository at this point
ci: Build arm64 wheels. Closes #1342
abetlen
committed
611781f
View commit details
Copy full SHA for 611781f
Browse repository at this point
feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)
sean-bailey
authored
53ebcc8
View commit details
Copy full SHA for 53ebcc8
Browse repository at this point
fix: Update scikit-build-core build dependency avoid bug in 0.9.1 (#1370)
Show description for 507c1da
evelkey
authored
507c1da
View commit details
Copy full SHA for 507c1da
Browse repository at this point
feat: Add Llama-3 chat format (#1371)
Show description for 8559e8c
andreabak
and
abetlen
authored
8559e8c
View commit details
Copy full SHA for 8559e8c
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
617d536
View commit details
Copy full SHA for 617d536
Browse repository at this point
Commits on Apr 22, 2024
feat: Use new llama_token_is_eog in create_completions
abetlen
committed
d40a250
View commit details
Copy full SHA for d40a250
Browse repository at this point
Merge branch 'main' of https://github.com/abetlen/llama-cpp-python into main
abetlen
committed
b21ba0e
View commit details
Copy full SHA for b21ba0e
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
159cc4e
View commit details
Copy full SHA for 159cc4e
Browse repository at this point
Commits on Apr 20, 2024
chore: Bump version
abetlen
committed
0281214
View commit details
Copy full SHA for 0281214
Browse repository at this point
feat: Add stopping_criteria to ChatFormatter, allow stopping on arbitrary token ids, fixes llama3 instruct
abetlen
committed
cc81afe
View commit details
Copy full SHA for cc81afe
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
d17c188
View commit details
Copy full SHA for d17c188
Browse repository at this point
Commits on Apr 18, 2024
chore: Bump version
abetlen
committed
893a27a
View commit details
Copy full SHA for 893a27a
Browse repository at this point
Previous
Next
You can’t perform that action at this time.