Search:

sci-misc/stable-diffusion-cpp

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

dev-python/comfy-aimdo

AI Model Dynamic Offloader for ComfyUI

dev-python/comfy-kitchen

Fast Kernel Library for ComfyUI with multiple compute backends

media-gfx/comfyui

The most powerful and modular diffusion model GUI and backend

dev-python/sasmodels

Small-angle scattering theory models for bumps and SasView

dev-python/vllm

High-throughput, memory-efficient inference and serving engine for LLMs

dev-python/xgrammar

Efficient, flexible structured generation engine for LLMs

dev-python/tilelang

Tile-level programming language for high-performance ML kernels

sci-ml/sherpa-onnx

Speech-to-text, TTS, speaker diarization etc. using onnxruntime

sci-ml/torchcodec

Decode/encode video and audio into PyTorch tensors via FFmpeg

dev-python/comfy-aimdo-bin

PyTorch VRAM allocator with on-demand weight offloading (binary wheel)

dev-python/comfy-kitchen-bin

Fast diffusion-inference kernel library (RoPE + FP8/FP4 quant, binary wheel)

sci-ml/ik_llama-cpp

llama.cpp fork with additional SOTA quants and improved performance

sci-ml/stable-diffusion-cpp

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

virtual/caffe2

Virtual for caffe2/PyTorch backend

virtual/pytorch

Virtual for PyTorch Python bindings

virtual/comfyui

Virtual for ComfyUI diffusion model GUI

sci-ml/bitsandbytes

k-bit quantization (QLoRA) and 8-bit optimizers for PyTorch

sci-ml/colibri

Run GLM-5.2 (744B MoE) on consumer hardware with expert streaming

sci-ml/whisper-cpp

Port of OpenAI's Whisper model in C/C++

media-gfx/luxcorerender

LuxCoreRender is a physically based and unbiased rendering engine

sci-ml/koboldcpp

All-in-one local AI server (LLM, image, speech, TTS) on ggml/llama.cpp

sci-ml/comfy-kitchen

Fast kernel library for Diffusion inference with multiple compute backends

dev-util/goose

Local, extensible AI agent that executes, edits and tests code, with MCP support

sci-ml/trellis-cpp

TRELLIS.2 image to 3D in C++ and GGML

dev-python/NewsSentiment

Easy-to-use, high-quality target-dependent sentiment classification for English news articles

dev-python/jax-cuda12-plugin

JAX Plugin for NVIDIA GPUs [wheel]

dev-python/onnxruntime-gpu

ONNX Runtime is a runtime accelerator for Machine Learning models [wheel]

sci-misc/prism-llama-cpp

PrismML llama.cpp fork with Bonsai low-bit model support

dev-python/psyneulink

A block modeling system for cognitive neuroscience

localai-backend/audio-cpp

LocalAI audio backend (audio.cpp gRPC server)

localai-backend/acestep-cpp

LocalAI music-generation backend (acestep.cpp gRPC server)

localai-backend/bonsai

LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)

localai-backend/ced

LocalAI audio-event-detection backend (ced.cpp gRPC server)

localai-backend/crispasr

LocalAI speech backend (CrispASR gRPC server)

localai-backend/depth-anything

LocalAI depth-estimation backend (depth-anything.cpp gRPC server)

localai-backend/face-detect

LocalAI face-detection backend (face-detect.cpp gRPC server)

localai-backend/ik-llama-cpp

LocalAI text-generation backend (ik_llama.cpp gRPC server)

localai-backend/llama-cpp

LocalAI text-generation backend (llama.cpp gRPC server)

localai-backend/locate-anything-cpp

LocalAI open-vocabulary detection backend (locate-anything.cpp gRPC server)

localai-backend/localvqe

LocalAI voice-quality-enhancement backend (LocalVQE gRPC server)

localai-backend/parakeet-cpp

LocalAI speech-to-text backend (parakeet.cpp gRPC server)

localai-backend/qwen3-tts-cpp

LocalAI text-to-speech backend (qwentts.cpp gRPC server)

localai-backend/rfdetr-cpp

LocalAI object-detection backend (rf-detr.cpp gRPC server)

localai-backend/sam3-cpp

LocalAI image-segmentation backend (sam3.cpp gRPC server)

localai-backend/stablediffusion-ggml

LocalAI image-generation backend (stable-diffusion.cpp gRPC server)

localai-backend/trellis2cpp

LocalAI 3D-generation backend (trellis2cpp gRPC server)

localai-backend/vibevoice-cpp

LocalAI text-to-speech backend (vibevoice.cpp gRPC server)

localai-backend/whisper

LocalAI speech-to-text backend (whisper.cpp gRPC server)