gpo.zugaina.org

Search Portage & Overlays:

dev-python/tensor-parallel

Automatically shard your large model between multiple GPUs, works without torch.distributed

Screenshots

  • tensor-parallel-2.0.0
    ~amd64 ~x86
    dev python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

    View      Download      Browse     License:   
    Overlay: pypi