sci-ml/llama-cpp-python
Python bindings for the llama.cpp library
Screenshots
-
llama-cpp-python-0.3.36~amd64native openblas +openmp vulkan video_cards_amdgpu cpu_flags_x86_amx_bf16 cpu_flags_x86_amx_int8 cpu_flags_x86_amx_tile cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_avx512_bf16 cpu_flags_x86_avx512bw cpu_flags_x86_avx512f cpu_flags_x86_avx512vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_bmi2 cpu_flags_x86_fma3 cpu_flags_x86_f16c cpu_flags_x86_sse4_2 python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View 
Download 
Browse License: MIT Overlay: local-ai
Runtime Dependencies
llama-cpp-python-0.3.36
python_single_target_python3_12?
( >=dev-python/diskcache-5.6.1[python_targets_python3_12
(-)
] >=dev-python/jinja2-2.11.3[python_targets_python3_12
(-)
] >=dev-python/numpy-1.20.0[python_targets_python3_12
(-)
] >=dev-python/typing-extensions-4.5.0[python_targets_python3_12
(-)
] )
python_single_target_python3_13?
( >=dev-python/diskcache-5.6.1[python_targets_python3_13
(-)
] >=dev-python/jinja2-2.11.3[python_targets_python3_13
(-)
] >=dev-python/numpy-1.20.0[python_targets_python3_13
(-)
] >=dev-python/typing-extensions-4.5.0[python_targets_python3_13
(-)
] )
python_single_target_python3_14?
( >=dev-python/diskcache-5.6.1[python_targets_python3_14
(-)
] >=dev-python/jinja2-2.11.3[python_targets_python3_14
(-)
] >=dev-python/numpy-1.20.0[python_targets_python3_14
(-)
] >=dev-python/typing-extensions-4.5.0[python_targets_python3_14
(-)
] )
openblas?
( sci-libs/openblas )
vulkan?
( media-libs/vulkan-loader video_cards_amdgpu?
( media-libs/mesa[vulkan,video_cards_radeonsi] )
)
python_single_target_python3_12?
( dev-lang/python:3.12 )
python_single_target_python3_13?
( dev-lang/python:3.13 )
python_single_target_python3_14?
( dev-lang/python:3.14 )