Repository History
2 repositories tagged with llama.cpp
llama-cpp-python: Python Bindings for llama.cpp
llama-cpp-python provides robust Python bindings for the popular llama.cpp library, enabling efficient local inference with large language models. It offers a high-level API compatible with OpenAI's API, facilitating easy integration into existing applications. The project also includes a powerful web server for local deployment and supports various hardware acceleration backends.
SmolVLM Real-time Webcam: Real-time Object Detection with Llama.cpp
The `smolvlm-realtime-webcam` repository provides a simple, yet powerful, demo for real-time object detection using a webcam. It leverages the SmolVLM 500M model and the `llama.cpp` server, offering an accessible way to explore local multimodal AI capabilities. This project allows users to easily set up and interact with a live AI vision system.