Search:

sci-misc/llama-cpp

Port of Facebook's LLaMA model in C/C++

sci-ml/ollama

Get up and running with Llama 3, Mistral, Gemma, and other language models.

media-gfx/stable-diffusion-cpp

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

sci-libs/flexiblas

A BLAS and LAPACK wrapper library with runtime exchangable backends

sci-ml/caffe2

A deep learning framework

sci-ml/pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

sci-ml/llama-cpp

LLM inference in C/C++

app-accessibility/whisper-cpp

Port of OpenAI's Whisper model in C/C++

sci-ml/ggml

Tensor library for machine learning

sci-misc/ik_llama-cpp

llama.cpp fork with additional SOTA quants and improved performance

sci-misc/stable-diffusion-cpp

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

sci-ml/caffe2-cuda

A deep learning framework (CUDA backend)

sci-ml/caffe2-rocm

A deep learning framework (ROCm backend)

sci-ml/ik_llama-cpp

llama.cpp fork with additional SOTA quants and improved performance

sci-ml/stable-diffusion-cpp

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

localai-backend/acestep-cpp

LocalAI music-generation backend (acestep.cpp gRPC server)

localai-backend/bonsai

LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)

localai-backend/ced

LocalAI audio-event-detection backend (ced.cpp gRPC server)

localai-backend/crispasr

LocalAI speech backend (CrispASR gRPC server)

localai-backend/depth-anything

LocalAI depth-estimation backend (depth-anything.cpp gRPC server)

localai-backend/face-detect

LocalAI face-detection backend (face-detect.cpp gRPC server)

localai-backend/ik-llama-cpp

LocalAI text-generation backend (ik_llama.cpp gRPC server)

localai-backend/kimodocpp

LocalAI skeleton-animation backend (kimodo.cpp gRPC server)

localai-backend/llama-cpp

LocalAI text-generation backend (llama.cpp gRPC server)

localai-backend/locate-anything-cpp

LocalAI open-vocabulary detection backend (locate-anything.cpp gRPC server)

localai-backend/localvqe

LocalAI voice-quality-enhancement backend (LocalVQE gRPC server)

localai-backend/parakeet-cpp

LocalAI speech-to-text backend (parakeet.cpp gRPC server)

localai-backend/qwen3-tts-cpp

LocalAI text-to-speech backend (qwentts.cpp gRPC server)

localai-backend/rfdetr-cpp

LocalAI object-detection backend (rf-detr.cpp gRPC server)

localai-backend/sam3-cpp

LocalAI image-segmentation backend (sam3.cpp gRPC server)

localai-backend/stablediffusion-ggml

LocalAI image-generation backend (stable-diffusion.cpp gRPC server)

localai-backend/trellis2cpp

LocalAI 3D-generation backend (trellis2cpp gRPC server)

localai-backend/vibevoice-cpp

LocalAI text-to-speech backend (vibevoice.cpp gRPC server)

localai-backend/whisper

LocalAI speech-to-text backend (whisper.cpp gRPC server)

sci-misc/whisper-cpp

Port of OpenAI's Whisper speech recognition to plain C/C++