Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
ukaserge
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on May 23, 2023
Bump version
abetlen
committed
e5d596e
View commit details
Copy full SHA for e5d596e
Browse repository at this point
Update llama.cpp
abetlen
committed
c41b1eb
View commit details
Copy full SHA for c41b1eb
Browse repository at this point
Merge pull request #263 from abetlen/dependabot/pip/mkdocs-material-9.1.14
Show description for aa3d7a6
abetlen
authored
aa3d7a6
View commit details
Copy full SHA for aa3d7a6
Browse repository at this point
Commits on May 22, 2023
Bump mkdocs-material from 9.1.12 to 9.1.14
Show description for 2240b94
dependabot[bot]
authored
2240b94
View commit details
Copy full SHA for 2240b94
Browse repository at this point
Merge pull request #258 from Pipboyguy/main
Show description for 01c79e7
abetlen
authored
01c79e7
View commit details
Copy full SHA for 01c79e7
Browse repository at this point
Merge pull request #262 from abetlen/dependabot/pip/httpx-0.24.1
Show description for c3e80b1
abetlen
authored
c3e80b1
View commit details
Copy full SHA for c3e80b1
Browse repository at this point
Bump httpx from 0.24.0 to 0.24.1
Show description for 8e41d72
dependabot[bot]
authored
8e41d72
View commit details
Copy full SHA for 8e41d72
Browse repository at this point
Change docker build dynamic param to image instead of cuda version
Show description for e6639e6
Marcel Coetzee
committed
e6639e6
View commit details
Copy full SHA for e6639e6
Browse repository at this point
Merge pull request #248 from localagi/main
Show description for 4f7a6da
abetlen
authored
4f7a6da
View commit details
Copy full SHA for 4f7a6da
Browse repository at this point
Use model_name and index in response
abetlen
committed
0adb9ec
View commit details
Copy full SHA for 0adb9ec
Browse repository at this point
Merge branch 'main' into server-embedding
abetlen
committed
922b5b2
View commit details
Copy full SHA for 922b5b2
Browse repository at this point
Commits on May 21, 2023
Bump version
abetlen
committed
2c45255
View commit details
Copy full SHA for 2c45255
Browse repository at this point
Cache shared library function calls for static tokens
abetlen
committed
cd102e9
View commit details
Copy full SHA for cd102e9
Browse repository at this point
Fix penalize_nl
abetlen
committed
b895511
View commit details
Copy full SHA for b895511
Browse repository at this point
Fix unnecessary memory allocation while sampling
abetlen
committed
03e2947
View commit details
Copy full SHA for 03e2947
Browse repository at this point
Update llama.cpp
abetlen
committed
fafe471
View commit details
Copy full SHA for fafe471
Browse repository at this point
Commits on May 20, 2023
Bump version
abetlen
committed
8f49ca0
View commit details
Copy full SHA for 8f49ca0
Browse repository at this point
Change properties to functions to match token functions
abetlen
committed
76b1d2c
View commit details
Copy full SHA for 76b1d2c
Browse repository at this point
Add n_ctx, n_vocab, and n_embd properties
abetlen
committed
a7ba858
View commit details
Copy full SHA for a7ba858
Browse repository at this point
make git module accessible anonymously
Your Name
committed
0b079a6
View commit details
Copy full SHA for 0b079a6
Browse repository at this point
Commits on May 19, 2023
feat: make embedding support list of string as input
Show description for e783f1c
chabotsi
committed
e783f1c
View commit details
Copy full SHA for e783f1c
Browse repository at this point
Fix llama_cpp and Llama type signatures. Closes #221
abetlen
committed
01a010b
View commit details
Copy full SHA for 01a010b
Browse repository at this point
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
abetlen
committed
fb57b94
View commit details
Copy full SHA for fb57b94
Browse repository at this point
Bump version
abetlen
committed
f82d85f
View commit details
Copy full SHA for f82d85f
Browse repository at this point
Add Guidance example
abetlen
committed
c7788c8
View commit details
Copy full SHA for c7788c8
Browse repository at this point
Bugfix: Stop sequences can be strings
abetlen
committed
a8cd169
View commit details
Copy full SHA for a8cd169
Browse repository at this point
Add upgrade instructions to the README
abetlen
committed
f0812c4
View commit details
Copy full SHA for f0812c4
Browse repository at this point
Fix logprobs for completions and implement for streaming logprobs.
abetlen
committed
17d4271
View commit details
Copy full SHA for 17d4271
Browse repository at this point
Allow first logprob token to be null to match openai api
abetlen
committed
a634a24
View commit details
Copy full SHA for a634a24
Browse repository at this point
Use server sent events function for streaming completion
abetlen
committed
dc39cc0
View commit details
Copy full SHA for dc39cc0
Browse repository at this point
Commits on May 18, 2023
Merge pull request #235 from Pipboyguy/main
Show description for 69f9d50
abetlen
authored
69f9d50
View commit details
Copy full SHA for 69f9d50
Browse repository at this point
Stream tokens instead of text chunks
abetlen
committed
f0ec6e6
View commit details
Copy full SHA for f0ec6e6
Browse repository at this point
Remove unnused union
abetlen
committed
21d8f5f
View commit details
Copy full SHA for 21d8f5f
Browse repository at this point
Set CUDA_VERSION as build ARG
Show description for 6ece8a2
Marcel Coetzee
committed
6ece8a2
View commit details
Copy full SHA for 6ece8a2
Browse repository at this point
Decrement CUDA version and bump Ubuntu
Show description for 6c57d38
Marcel Coetzee
committed
6c57d38
View commit details
Copy full SHA for 6c57d38
Browse repository at this point
Previous
Next
You can’t perform that action at this time.