Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
commit4ever
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
llama-cpp-python
README.md
on
main
User selector
All users
All time
Commit history
Commits on May 10, 2024
docs: Fix typo in README.md (#1444)
yupbank
authored
1547202
View commit details
Copy full SHA for 1547202
View code at this point
Browse repository at this point
Commits on May 8, 2024
docs: update README.md (#1432)
Show description for 07966b9
eltociear
authored
07966b9
View commit details
Copy full SHA for 07966b9
View code at this point
Browse repository at this point
Commits on Apr 30, 2024
docs: Change all examples from interpreter style to script style.
abetlen
committed
945c62c
View commit details
Copy full SHA for 945c62c
View code at this point
Browse repository at this point
docs: Update README.md
abetlen
committed
26478ab
View commit details
Copy full SHA for 26478ab
View code at this point
Browse repository at this point
docs: Update README to include CUDA 12.4 wheels
abetlen
committed
c8cd8c1
View commit details
Copy full SHA for c8cd8c1
View code at this point
Browse repository at this point
feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)
Show description for fe2da09
abetlen
authored
fe2da09
View commit details
Copy full SHA for fe2da09
View code at this point
Browse repository at this point
Commits on Apr 28, 2024
fix: Functionary bug fixes (#1385)
Show description for f178636
jeffrey-fong
and
abetlen
authored
f178636
View commit details
Copy full SHA for f178636
View code at this point
Browse repository at this point
Commits on Apr 26, 2024
feat: Allow for possibly non-pooled embeddings (#1380)
Show description for f6ed21f
iamlemec
and
abetlen
authored
f6ed21f
View commit details
Copy full SHA for f6ed21f
View code at this point
Browse repository at this point
Commits on Apr 5, 2024
fix(docs): incorrect tool_choice example (#1330)
CISC
authored
7265a5d
View commit details
Copy full SHA for 7265a5d
View code at this point
Browse repository at this point
Commits on Apr 4, 2024
docs: Rename cuBLAS section to CUDA
abetlen
committed
909ef66
View commit details
Copy full SHA for 909ef66
View code at this point
Browse repository at this point
docs: Add docs explaining how to install pre-built wheels.
abetlen
committed
1db3b58
View commit details
Copy full SHA for 1db3b58
View code at this point
Browse repository at this point
docs: LLAMA_CUBLAS -> LLAMA_CUDA
abetlen
committed
c50309e
View commit details
Copy full SHA for c50309e
View code at this point
Browse repository at this point
Commits on Apr 3, 2024
feat: Binary wheels for CPU, CUDA (12.1 - 12.3), Metal (#1247)
Show description for 5a930ee
abetlen
authored
5a930ee
View commit details
Copy full SHA for 5a930ee
View code at this point
Browse repository at this point
Commits on Apr 1, 2024
fix: Changed local API doc references to hosted (#1317)
lawfordp2017
authored
a0f373e
View commit details
Copy full SHA for a0f373e
View code at this point
Browse repository at this point
Commits on Mar 3, 2024
docs: fix small typo in README: 'model know how' -> 'model knows how' (#1244)
Show description for 663659f
boegel
and
abetlen
authored
663659f
View commit details
Copy full SHA for 663659f
View code at this point
Browse repository at this point
Commits on Mar 1, 2024
docs: Add information re: auto chat formats. Closes #1236
abetlen
committed
97aa3a1
View commit details
Copy full SHA for 97aa3a1
View code at this point
Browse repository at this point
Commits on Feb 29, 2024
docs: fix typo in README.md embeddings example. (#1232)
iamlemec
authored
cf1fdd8
View commit details
Copy full SHA for cf1fdd8
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
feat(server): Add support for pulling models from Huggingface Hub (#1222)
Show description for 4d574bd
abetlen
authored
4d574bd
View commit details
Copy full SHA for 4d574bd
View code at this point
Browse repository at this point
docs: Add example of local image loading to README
abetlen
committed
b3e358d
View commit details
Copy full SHA for b3e358d
View code at this point
Browse repository at this point
Commits on Feb 23, 2024
docs: Fix functionary repo_id
abetlen
committed
b681674
View commit details
Copy full SHA for b681674
View code at this point
Browse repository at this point
docs: Restore functionary docs in README
abetlen
committed
702306b
View commit details
Copy full SHA for 702306b
View code at this point
Browse repository at this point
docs: Update README.md to fix pip install llama cpp server (#1187)
Show description for 52d9d70
audip
and
abetlen
authored
52d9d70
View commit details
Copy full SHA for 52d9d70
View code at this point
Browse repository at this point
docs: Fix typo
abetlen
committed
410e02d
View commit details
Copy full SHA for 410e02d
View code at this point
Browse repository at this point
Commits on Feb 22, 2024
docs: fix low-level api example
abetlen
committed
eb56ce2
View commit details
Copy full SHA for eb56ce2
View code at this point
Browse repository at this point
docs: Update README
abetlen
committed
0f8cad6
View commit details
Copy full SHA for 0f8cad6
View code at this point
Browse repository at this point
docs: Update README
abetlen
committed
045cc12
View commit details
Copy full SHA for 045cc12
View code at this point
Browse repository at this point
docs: Update README
abetlen
committed
32efed7
View commit details
Copy full SHA for 32efed7
View code at this point
Browse repository at this point
docs: fix indentation for mkdocs-material
abetlen
committed
d80c5cf
View commit details
Copy full SHA for d80c5cf
View code at this point
Browse repository at this point
Commits on Feb 21, 2024
feat: Pull models directly from huggingface (#1206)
Show description for 0f8aa4a
abetlen
authored
0f8aa4a
View commit details
Copy full SHA for 0f8aa4a
View code at this point
Browse repository at this point
Commits on Feb 16, 2024
docs: Add embeddings section
abetlen
committed
c2a234a
View commit details
Copy full SHA for c2a234a
View code at this point
Browse repository at this point
Commits on Feb 13, 2024
docs: Fix typo
abetlen
committed
4348a6c
View commit details
Copy full SHA for 4348a6c
View code at this point
Browse repository at this point
Commits on Feb 12, 2024
docs: Temporarily revert function calling docs
abetlen
committed
b82b0e1
View commit details
Copy full SHA for b82b0e1
View code at this point
Browse repository at this point
Commits on Feb 11, 2024
docs: Set the correct command for compiling with syscl support (#1172)
Akarshan Biswas
authored
918ff27
View commit details
Copy full SHA for 918ff27
View code at this point
Browse repository at this point
Commits on Feb 8, 2024
feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)
Show description for 9018270
jeffrey-fong
and
abetlen
authored
9018270
View commit details
Copy full SHA for 9018270
View code at this point
Browse repository at this point
Commits on Jan 31, 2024
Add speculative decoding (#1120)
Show description for fb762a6
abetlen
authored
fb762a6
View commit details
Copy full SHA for fb762a6
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.