sci-ml/llama-cpp-python
Python bindings for the llama.cpp library
Screenshots
-
llama-cpp-python-0.3.36~amd64native openblas +openmp vulkan video_cards_amdgpu cpu_flags_x86_amx_bf16 cpu_flags_x86_amx_int8 cpu_flags_x86_amx_tile cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_avx512_bf16 cpu_flags_x86_avx512bw cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_bmi2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_sse4_2 python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View 
Download 
Browse License: MIT Overlay: local-ai
USE Flags
native
* This flag is undocumented *
openblas
* This flag is undocumented *
+openmp
* This flag is undocumented *
vulkan
* This flag is undocumented *
video_cards_amdgpu
* This flag is undocumented *
cpu_flags_x86_amx_bf16
* This flag is undocumented *
cpu_flags_x86_amx_int8
* This flag is undocumented *
cpu_flags_x86_amx_tile
* This flag is undocumented *
cpu_flags_x86_avx
* This flag is undocumented *
cpu_flags_x86_avx_vnni
* This flag is undocumented *
cpu_flags_x86_avx2
* This flag is undocumented *
cpu_flags_x86_avx512_bf16
* This flag is undocumented *
cpu_flags_x86_avx512bw
* This flag is undocumented *
cpu_flags_x86_avx512f
* This flag is undocumented *
cpu_flags_x86_avx512vbmi
* This flag is undocumented *
cpu_flags_x86_avx512_vnni
* This flag is undocumented *
cpu_flags_x86_bmi2
* This flag is undocumented *
cpu_flags_x86_fma3
* This flag is undocumented *
cpu_flags_x86_f16c
* This flag is undocumented *
cpu_flags_x86_sse4_2
* This flag is undocumented *
python_single_target_python3_12
* This flag is undocumented *
python_single_target_python3_13
* This flag is undocumented *
python_single_target_python3_14
* This flag is undocumented *