gpo.zugaina.org

Search Portage & Overlays:

dev-python/instanttensor-bin

Ultra-fast distributed safetensors loader for CUDA (binary wheel)

Screenshots

  • instanttensor-bin-0.2.1
    -* ~amd64
    python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 debug

    View      Download      Browse     License: Apache-2.0 BSD LGPL-2.1 MIT   
    Overlay: stuff
  • instanttensor-bin-0.2.0
    -* ~amd64
    python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 debug

    View      Download      Browse     License: Apache-2.0 BSD LGPL-2.1 MIT   
    Overlay: stuff
  • instanttensor-bin-0.1.9
    -* ~amd64
    python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14 debug

    View      Download      Browse     License: Apache-2.0 BSD Boost-1.0 LGPL-2.1 MIT   
    Overlay: stuff

ChangeLog

commit e237b91912c9233a6f6fbc0be34a4da9b562c73b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Tue Oct 6 21:11:41 2026 +0200

dev-python/instanttensor-bin: add 0.2.1

Requires-Dist is unchanged at torch>=2.8.0, and the extension's NEEDED
set is identical to 0.2.0's, so RDEPEND carries over. The new CUDA
executor still binds CUDA through the already-loaded runtime.

commit f6423700ad7b9c3ad6d01173094979ed0e629cc5
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Sep 14 14:29:37 2026 +0200

dev-python/instanttensor-bin: add 0.2.0

Upstream replaced its vendored Boost with the MIT-licensed atomic_queue
headers, so Boost-1.0 leaves LICENSE. The x86_64 wheels now carry a
manylinux_2_27 tag.

Requires-Dist is unchanged at torch>=2.8.0. The extension still links
only libc and libstdc++ and resolves CUDA and NCCL entry points from
already-loaded libraries at runtime, so RDEPEND stays the same.

commit a30854e8c89f02c88bca34fe5fae6b37188aae60
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:52:48 2026 +0200

dev-python/instanttensor-bin: trim 0.1.9 comments

commit cdf1380170f8c434c3bc3378e5a3c23199b2608a
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Wed Sep 9 19:40:56 2026 +0200

dev-python/instanttensor-bin: new package, add 0.1.9

vllm 0.29.0's requirements/cuda.txt declares instanttensor >= 0.1.9
unconditionally. It backs the new "instanttensor" --load-format, which
streams safetensors straight into GPU memory over io_uring, libaio or
cuFile and pipelines the prefetch across the ranks of a torch process
group.

Packaged from the upstream wheels rather than the sdist: the sdist
vendors and statically links libaio, liburing, a Boost header subset,
pybind11 and dlpack, and drives their in-tree Makefiles from a custom
build_ext, so unbundling those to the system copies is a packaging job of
its own. The extension links no libtorch or libc10, so unlike a torch C++
extension it is not ABI-locked to a torch minor and upstream's
torch>=2.8.0 floor is the real bound.