gpo.zugaina.org

Search Portage & Overlays:

sci-ml/transformers

State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow

Screenshots

  • transformers-5.17.0-r2
    ~amd64 ~arm64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: stuff
  • transformers-5.17.0
    ~amd64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: gentoo
  • transformers-5.16.1-r666
    ~amd64
    torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: Miezhiko
  • transformers-5.16.1-r2
    ~amd64 ~arm64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: stuff
  • transformers-5.15.1-r2
    ~amd64 ~arm64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: stuff
  • transformers-5.15.1
    ~amd64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: gentoo
  • transformers-5.15.0-r2
    ~amd64 ~arm64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: stuff
  • transformers-5.3.0-r1
    ~amd64
    test torch test python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: gentoo
  • transformers-4.57.6
    ~amd64 ~arm64
    torch python_single_target_python3_12 python_single_target_python3_13 python_single_target_python3_14

    View      Download      Browse     License: Apache-2.0   
    Overlay: stuff

ChangeLog

commit f8fb543bdf70eaf36d71069f05ea9adb6d8ea93b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 20 15:25:41 2026 +0200

sci-ml/transformers: drop the 5.17.0 compile-test split

Splitting that one test out assumed the abort came from running it
beside other xdist workers. The reporter log refutes it: ten tests
abort at the same libtorch_python frame, eight of them pipeline tests
that never call torch.compile. The split never reached its serial
rerun either, because the parallel run dies first.

The cause is caffe2 built RelWithDebInfo, which strips -DNDEBUG and
leaves torch debug asserts live. Require the corrected build instead
and run the suite whole again.

Bug: https://github.com/istitov/stuff/issues/291

commit 718d13f93a88aad0df5db20402feb8b98688809f
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 20 15:25:41 2026 +0200

sci-ml/transformers: drop the 5.16.1 compile-test split

Splitting that one test out assumed the abort came from running it
beside other xdist workers. The reporter log refutes it: ten tests
abort at the same libtorch_python frame, eight of them pipeline tests
that never call torch.compile. The split never reached its serial
rerun either, because the parallel run dies first.

The cause is caffe2 built RelWithDebInfo, which strips -DNDEBUG and
leaves torch debug asserts live. Require the corrected build instead
and run the suite whole again.

Bug: https://github.com/istitov/stuff/issues/291

commit 08f589820632c818d1ae55cc18efc275c3686d11
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 20 15:25:41 2026 +0200

sci-ml/transformers: drop the 5.15.1 compile-test split

Splitting that one test out assumed the abort came from running it
beside other xdist workers. The reporter log refutes it: ten tests
abort at the same libtorch_python frame, eight of them pipeline tests
that never call torch.compile. The split never reached its serial
rerun either, because the parallel run dies first.

The cause is caffe2 built RelWithDebInfo, which strips -DNDEBUG and
leaves torch debug asserts live. Require the corrected build instead
and run the suite whole again.

Bug: https://github.com/istitov/stuff/issues/291

commit 822724bb350aa987f924e56fc02626ab90e32528
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 20 15:25:41 2026 +0200

sci-ml/transformers: drop the 5.15.0 compile-test split

Splitting that one test out assumed the abort came from running it
beside other xdist workers. The reporter log refutes it: ten tests
abort at the same libtorch_python frame, eight of them pipeline tests
that never call torch.compile. The split never reached its serial
rerun either, because the parallel run dies first.

The cause is caffe2 built RelWithDebInfo, which strips -DNDEBUG and
leaves torch debug asserts live. Require the corrected build instead
and run the suite whole again.

Bug: https://github.com/istitov/stuff/issues/291

commit b8919e8d536cf1dab1fc9272af2559859c2da843
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Sep 19 18:18:31 2026 +0200

sci-ml/transformers: run 5.17.0 compile test serially

The compile test aborts in libtorch under the eight-worker suite.
Running it afterward preserves coverage without xdist replacing the
worker.

Bug: https://github.com/istitov/stuff/issues/291

commit 7cdce84cc074668b8ee9423c7f77deb0111e2158
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Sep 19 18:18:06 2026 +0200

sci-ml/transformers: run 5.16.1 compile test serially

The compile test aborts in libtorch under the eight-worker suite.
Running it afterward preserves coverage without xdist replacing the
worker.

Bug: https://github.com/istitov/stuff/issues/291

commit 77424eb38dc5b2ffea35e882cf4f912e794741a9
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Sep 19 18:17:12 2026 +0200

sci-ml/transformers: run 5.15.1 compile test serially

The compile test aborts in libtorch under the eight-worker suite.
Running it afterward preserves coverage without xdist replacing the
worker.

Bug: https://github.com/istitov/stuff/issues/291

commit c768442d668098178b933a1e426458e85c7ca89d
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Sep 19 18:16:48 2026 +0200

sci-ml/transformers: run 5.15.0 compile test serially

The compile test aborts in libtorch under the eight-worker suite.
Running it afterward preserves coverage without xdist replacing the
worker.

Bug: https://github.com/istitov/stuff/issues/291

commit b18827e004da71fad45730a0e669d2c3aafa372f
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Wed Sep 16 00:30:12 2026 +0200

sci-ml/transformers: fix test runs without network access

Each bert, distilbert, gpt2 and roberta tokenization module downloads
its reference tokenizer from huggingface.co when the test class starts,
so none of their tests can run behind the network sandbox. Skip those
four modules while it is on; with it off they pass, so keep them.

The model tests load with device_map, which requires accelerate. It was
only pulled in by USE=torch, so a USE=test run without that flag failed
those tests; add accelerate to the test dependencies.

Bug: https://github.com/istitov/stuff/issues/291

commit ef66e77be64fe0a659331397fe5786a9200234b0
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Sep 12 15:54:18 2026 +0200

sci-ml/transformers: enable Python 3.14 for 4.57.6

This release requires Python 3.9 or newer, ships pure Python code, and
its exact Tokenizers dependency already supports Python 3.14.

commit acd7887cd68629b8522049bccd03127ea0f263e1
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Thu Sep 10 08:57:01 2026 +0200

sci-ml/transformers: tighten test restriction rationale

commit 9750930072d7e8521bf7db2e213a7f35689627db
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:08:25 2026 +0200

sci-ml/transformers: backport test fixes to 5.15.0

The upstream suite needs its declared plugins and deterministic
exclusions to run without optional hardware or services.

commit 4f9d486a1df01e3110e588f098f523079c732fc4
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:08:25 2026 +0200

sci-ml/transformers: backport dependency fixes to 5.15.0

Retained releases need the published compatibility floors instead of
resolving against arbitrary older dependencies.

commit ff7f447e5a0d898fadef6fbd8e576142b99c2b7e
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:08:01 2026 +0200

sci-ml/transformers: backport test fixes to 5.15.1

The upstream suite needs its declared plugins and deterministic
exclusions to run without optional hardware or services.

commit f0180393f819fdac458925cf73a690547fa2ef8a
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:08:01 2026 +0200

sci-ml/transformers: backport dependency fixes to 5.15.1

Retained releases need the published compatibility floors instead of
resolving against arbitrary older dependencies.

commit 85ddaf242140d6a4b1a2c43300106881e3c0b92d
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:07:37 2026 +0200

sci-ml/transformers: backport test fixes to 5.16.1

The upstream suite needs its declared plugins and deterministic
exclusions to run without optional hardware or services.

commit 44008d6b13c0cf67343a7c90444aee9be4fb6bf7
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Sep 11 00:07:37 2026 +0200

sci-ml/transformers: backport dependency fixes to 5.16.1

Retained releases need the published compatibility floors instead of
resolving against arbitrary older dependencies.

commit 2fbfe724007e59369d25ce4d184cabe623a78bf6
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Thu Sep 10 19:16:43 2026 +0200

sci-ml/transformers: add 5.17.0

commit b1e3615ce1c1817abd639d093784375ae1cf29e1
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 6 01:54:34 2026 +0200

sci-ml/transformers: Keyword 5.16.1 for ~arm64

The Python package and its tokenizer dependency stack support aarch64.

commit 24f122d9ddb653087e3f5ced7221763e416cbd60
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 6 01:54:34 2026 +0200

sci-ml/transformers: Keyword 5.15.1 for ~arm64

The Python package and its tokenizer dependency stack support aarch64.

commit 5b1ade1543e37dc1ed72afe33178bb148c4d899a
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 6 01:54:34 2026 +0200

sci-ml/transformers: Keyword 5.15.0 for ~arm64

The Python package and its tokenizer dependency stack support aarch64.

commit ba554206076c38133ef6e3e7abe41345d9cb4cec
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Sep 6 01:54:34 2026 +0200

sci-ml/transformers: Keyword 4.57.6 for ~arm64

The Python package and its tokenizer dependency stack support aarch64.

commit c169c17de505d8aaec2ca3529c4643d919d7486a
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Thu Aug 27 09:17:26 2026 +0200

sci-ml/transformers: add 5.16.1

commit c38b2a54a5ca5762cb3cc1eb04d2e8177a4abc2d
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Wed Aug 19 16:04:02 2026 +0200

sci-ml/transformers: drop 5.14.1

commit 753d764e6280b12e95c7724e7804593807aef662
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Wed Aug 19 16:03:57 2026 +0200

sci-ml/transformers: add 5.15.1

commit 880cf93095d5778b4084028cb96ab149986acd66
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Aug 14 09:42:28 2026 +0200

sci-ml/transformers: normalize copyright header

Use the overlay-wide required copyright range consistently across consumer-retained
versions.

commit baf6a2eaddc6831aedce1ec31cc92666aa9c0856
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Aug 14 00:27:08 2026 +0200

sci-ml/transformers: retain 4.57.6 for 4.x consumers

XGrammar 0.2.5 intentionally rejects Transformers 5 because tokenizer loading
regressed for supported models. Retaining the final 4.x release preserves that
upstream-required dependency path.

commit 49c2750375b314661aa8080b2784cd4460b901f2
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 10 17:18:08 2026 +0200

sci-ml/transformers: drop 5.14.0

commit 9568255f6e0ac6fe79cfd03c45a4f5eb766802b9
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Mon Aug 10 17:17:22 2026 +0200

sci-ml/transformers: add 5.15.0

commit 9c977949571ef1277b6f522d9ff536577a363801
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 17 15:08:55 2026 +0200

sci-ml/transformers: drop 5.13.1

commit db1874afbe91bada27c89abcf9cb43a94bbde8b1
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Fri Jul 17 15:08:55 2026 +0200

sci-ml/transformers: add 5.14.1

commit db275077a6b366fa8b27d7279114744a70c32ebc
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Thu Jul 16 10:28:01 2026 +0200

sci-ml/transformers: drop 5.12.1

commit 32fc2a30b3933444cdeb244512283113ff36ae46
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Thu Jul 16 10:28:00 2026 +0200

sci-ml/transformers: add 5.14.0

commit 90404d6cbdca2974c108a0bb7e079186276a9f9b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Jul 12 09:09:21 2026 +0200

sci-ml/transformers: drop 5.13.0

commit cb3048df76859f19ab62df5e45747da4e581bc61
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun Jul 12 09:08:41 2026 +0200

sci-ml/transformers: add 5.13.1

commit 399c89df7b78959487cdbb54976b729aa31f4272
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat Jul 4 10:43:33 2026 +0200

sci-ml/transformers: add 5.13.0

5.13.0 raises the safetensors floor to >=0.8.0 (enforced at import via a
require_version assert), now satisfied by the freshly-added
sci-ml/safetensors-0.8.0. tokenizers stays pinned =0.22* (upstream widened
to <=0.23.0, but ::gentoo's only in-range option is 0.22.x — 0.23.1 is
excluded by the cap); typer remains a direct dependency (unlike
huggingface_hub, transformers still uses it).

commit 80015d1bf6abf74eb269661b33f277154aa7ea0f
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Tue Jun 30 14:33:33 2026 +0200

sci-ml/transformers: new package

Fork of ::gentoo's sci-ml/transformers bumped to 5.12.1 (::gentoo has
5.3.0). Final library link of the chain to unblock vllm 0.24.0, which
requires transformers >=5.5.3.

RDEPEND delta vs 5.3.0: floor sci-ml/huggingface_hub to >=1.5.0 (5.12.1
requirement, satisfied by our huggingface_hub-1.21.0 fork). tokenizers
=0.22* still resolves to 0.22.2, inside upstream's >=0.22.0,<=0.23.0;
regex/safetensors/numpy floors are satisfied by ::gentoo. Overlay
transformers consumers all cap <6, so the 5.3->5.12 bump doesn't break
them.