dev-python/vllm
High-throughput, memory-efficient inference and serving engine for LLMs
Screenshots
-
vllm-0.21.0~amd64cpu cuda rocm python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151
View 
Download 
Browse License: Apache-2.0 Overlay: stuff -
vllm-0.20.2~amd64cpu cuda rocm python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx950 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 +amdgpu_targets_gfx1101 +amdgpu_targets_gfx1200 +amdgpu_targets_gfx1201 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx906 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1102 amdgpu_targets_gfx1103 amdgpu_targets_gfx1150 amdgpu_targets_gfx1151
View Download Browse License: Apache-2.0 Overlay: stuff
USE Flags
cpu
* This flag is undocumented *
cuda
Global: Build CUDA binaries.
rocm
* This flag is undocumented *
python_single_target_python3_12
* This flag is undocumented *
python_single_target_python3_13
* This flag is undocumented *
python_single_target_python3_14
* This flag is undocumented *
+amdgpu_targets_gfx908
* This flag is undocumented *
+amdgpu_targets_gfx90a
* This flag is undocumented *
+amdgpu_targets_gfx942
* This flag is undocumented *
+amdgpu_targets_gfx950
* This flag is undocumented *
+amdgpu_targets_gfx1030
* This flag is undocumented *
+amdgpu_targets_gfx1100
* This flag is undocumented *
+amdgpu_targets_gfx1101
* This flag is undocumented *
+amdgpu_targets_gfx1200
* This flag is undocumented *
+amdgpu_targets_gfx1201
* This flag is undocumented *
amdgpu_targets_gfx803
* This flag is undocumented *
amdgpu_targets_gfx900
* This flag is undocumented *
amdgpu_targets_gfx906
* This flag is undocumented *
amdgpu_targets_gfx940
* This flag is undocumented *
amdgpu_targets_gfx941
* This flag is undocumented *
amdgpu_targets_gfx1010
* This flag is undocumented *
amdgpu_targets_gfx1011
* This flag is undocumented *
amdgpu_targets_gfx1012
* This flag is undocumented *
amdgpu_targets_gfx1031
* This flag is undocumented *
amdgpu_targets_gfx1102
* This flag is undocumented *
amdgpu_targets_gfx1103
* This flag is undocumented *
amdgpu_targets_gfx1150
* This flag is undocumented *
amdgpu_targets_gfx1151
* This flag is undocumented *