Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.
Screenshots
-
flexgen-1.0
~amd64 ~x86
python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14
View
Download
Browse License:
-
flexgen-0.1.8
~amd64 ~x86
python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14
View
Download
Browse License:
Reverse Dependencies
Reverse dependancies are sometimes conditional based on your USE flags, Ebuild version and sometimes other packages. please keep this in mind.