gpo.zugaina.org

Search Portage & Overlays:

dev-python/flexgen

Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.

Screenshots

  • flexgen-1.0
    ~amd64 ~x86
    python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

    View      Download      Browse     License:   
    Overlay: pypi
  • flexgen-0.1.8
    ~amd64 ~x86
    python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

    View      Download      Browse     License:   
    Overlay: pypi

USE Flags

python_targets_python3_11
* This flag is undocumented *
python_targets_python3_12
* This flag is undocumented *
python_targets_python3_13
* This flag is undocumented *
python_targets_python3_14
* This flag is undocumented *