Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
alexrenda
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Jul 6, 2023
tensor split
alexrenda
committed
142fe7e
View commit details
Copy full SHA for 142fe7e
Browse repository at this point
Commits on Jul 5, 2023
Bump version
abetlen
committed
a1b2d5c
View commit details
Copy full SHA for a1b2d5c
Browse repository at this point
Update llama.cpp
abetlen
committed
b994296
View commit details
Copy full SHA for b994296
Browse repository at this point
Merge pull request #443 from abetlen/dependabot/pip/mkdocs-material-9.1.18
Show description for 058b134
abetlen
authored
058b134
View commit details
Copy full SHA for 058b134
Browse repository at this point
Commits on Jul 4, 2023
Bump mkdocs-material from 9.1.17 to 9.1.18
Show description for 9261a52
dependabot[bot]
authored
9261a52
View commit details
Copy full SHA for 9261a52
Browse repository at this point
Merge pull request #442 from abetlen/dependabot/pip/typing-extensions-4.7.1
Show description for 5e0a6b6
abetlen
authored
5e0a6b6
View commit details
Copy full SHA for 5e0a6b6
Browse repository at this point
Bump typing-extensions from 4.6.3 to 4.7.1
Show description for f1b4423
dependabot[bot]
authored
f1b4423
View commit details
Copy full SHA for f1b4423
Browse repository at this point
Merge pull request #444 from abetlen/dependabot/pip/fastapi-0.99.1
Show description for 2379ed5
abetlen
authored
2379ed5
View commit details
Copy full SHA for 2379ed5
Browse repository at this point
Merge pull request #436 from mikeyang01/main
Show description for bf1dc66
abetlen
authored
bf1dc66
View commit details
Copy full SHA for bf1dc66
Browse repository at this point
Commits on Jul 3, 2023
Bump fastapi from 0.98.0 to 0.99.1
Show description for fb02077
dependabot[bot]
authored
fb02077
View commit details
Copy full SHA for fb02077
Browse repository at this point
Commits on Jun 30, 2023
Update README.md
Show description for c8d0647
mikeyang01
authored
c8d0647
View commit details
Copy full SHA for c8d0647
Browse repository at this point
Merge pull request #435 from vladkens/patch-1
Show description for 28ec88c
abetlen
authored
28ec88c
View commit details
Copy full SHA for 28ec88c
Browse repository at this point
Commits on Jun 29, 2023
Update README.md
Show description for 485eee7
vladkens
authored
485eee7
View commit details
Copy full SHA for 485eee7
Browse repository at this point
Update llama.cpp
abetlen
committed
c67f786
View commit details
Copy full SHA for c67f786
Browse repository at this point
Hotfix: logits_all bug
abetlen
committed
e34f441
View commit details
Copy full SHA for e34f441
Browse repository at this point
Bump version
abetlen
committed
4d1eb88
View commit details
Copy full SHA for 4d1eb88
Browse repository at this point
Load logits directly into scores buffer
abetlen
committed
a2ede37
View commit details
Copy full SHA for a2ede37
Browse repository at this point
Use pre-allocated buffers to store input_ids and scores
abetlen
committed
b95b0ff
View commit details
Copy full SHA for b95b0ff
Browse repository at this point
Free model when llama is unloaded. Closes #434
abetlen
committed
a5e059c
View commit details
Copy full SHA for a5e059c
Browse repository at this point
Add stopping criteria and logits processor to docs
abetlen
committed
442213b
View commit details
Copy full SHA for 442213b
Browse repository at this point
Commits on Jun 27, 2023
Update docs
abetlen
committed
a376659
View commit details
Copy full SHA for a376659
Browse repository at this point
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
abetlen
committed
530599a
View commit details
Copy full SHA for 530599a
Browse repository at this point
Update docs
abetlen
committed
dae9833
View commit details
Copy full SHA for dae9833
Browse repository at this point
Merge pull request #432 from abetlen/dependabot/pip/pytest-7.4.0
Show description for e2a2513
abetlen
authored
e2a2513
View commit details
Copy full SHA for e2a2513
Browse repository at this point
Commits on Jun 26, 2023
Bump pytest from 7.3.2 to 7.4.0
Show description for 89f9e43
dependabot[bot]
authored
89f9e43
View commit details
Copy full SHA for 89f9e43
Browse repository at this point
Merge pull request #430 from abetlen/dependabot/pip/fastapi-0.98.0
Show description for 2718dfb
abetlen
authored
2718dfb
View commit details
Copy full SHA for 2718dfb
Browse repository at this point
Bump fastapi from 0.97.0 to 0.98.0
Show description for dcf1834
dependabot[bot]
authored
dcf1834
View commit details
Copy full SHA for dcf1834
Browse repository at this point
Merge pull request #429 from abetlen/dependabot/pip/mkdocs-material-9.1.17
Show description for 7d01749
abetlen
authored
7d01749
View commit details
Copy full SHA for 7d01749
Browse repository at this point
Bump mkdocs-material from 9.1.16 to 9.1.17
Show description for e03c380
dependabot[bot]
authored
e03c380
View commit details
Copy full SHA for e03c380
Browse repository at this point
Merge pull request #431 from abetlen/dependabot/pip/numpy-1.24.4
Show description for e18fe74
abetlen
authored
e18fe74
View commit details
Copy full SHA for e18fe74
Browse repository at this point
Bump numpy from 1.24.3 to 1.24.4
Show description for c9a8b7e
dependabot[bot]
authored
c9a8b7e
View commit details
Copy full SHA for c9a8b7e
Browse repository at this point
Updated docs link
abetlen
committed
4529294
View commit details
Copy full SHA for 4529294
Browse repository at this point
Update readthedocs setup
abetlen
committed
66b8b97
View commit details
Copy full SHA for 66b8b97
Browse repository at this point
Add readthedocsc config
abetlen
committed
155dedf
View commit details
Copy full SHA for 155dedf
Browse repository at this point
Bump version
abetlen
committed
5193af2
View commit details
Copy full SHA for 5193af2
Browse repository at this point
Previous
Next
You can’t perform that action at this time.