FlashInfer: kernel library for LLM serving (Python frontend)
Screenshots
-
flashinfer-python-0.6.17-r1
~amd64
python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View
Download
Browse License: Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD Boost-1.0 MIT NVIDIA-CUDA NVIDIA-SDK
-
flashinfer-python-0.6.16_p3
~amd64
python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View
Download
Browse License: Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD Boost-1.0 MIT NVIDIA-CUDA NVIDIA-SDK
-
flashinfer-python-0.6.14
~amd64
python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14
View
Download
Browse License: Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD Boost-1.0 MIT NVIDIA-CUDA NVIDIA-SDK
USE Flags
python_single_target_python3_12
* This flag is undocumented *
python_single_target_python3_13
* This flag is undocumented *
python_single_target_python3_14
* This flag is undocumented *