sci-ml/bigcode-eval
Framework for evaluating autoregressive code generation language models
Screenshots
View
Download
BrowseChangeLog
commit 4594472bb37cb75509a517b7e30ea3255763c3c8
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 14:51:11 2026 +0200
sci-ml/bigcode-eval: switch to DISTUTILS_SINGLE_IMPL
The full sci-ml stack here (accelerate, datasets, evaluate,
huggingface_hub, transformers, pytorch) is SINGLE_IMPL; depending on
them from a multi-impl ebuild yields python_targets_python3_*(-)? that
the children can't expose. Make bigcode-eval single-impl, put the entire
sci-ml block on bare $, and wrap the two
multi-impl helpers (mosestokenizer, fsspec) in python_gen_cond_dep.
commit 80345549e8aac49998ff392ab7767fa2f5d449a3
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 22:15:27 2026 +0200
sci-ml/bigcode-eval: new package, BigCode evaluation-harness HEAD snapshot
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 14:51:11 2026 +0200
sci-ml/bigcode-eval: switch to DISTUTILS_SINGLE_IMPL
The full sci-ml stack here (accelerate, datasets, evaluate,
huggingface_hub, transformers, pytorch) is SINGLE_IMPL; depending on
them from a multi-impl ebuild yields python_targets_python3_*(-)? that
the children can't expose. Make bigcode-eval single-impl, put the entire
sci-ml block on bare $, and wrap the two
multi-impl helpers (mosestokenizer, fsspec) in python_gen_cond_dep.
commit 80345549e8aac49998ff392ab7767fa2f5d449a3
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 22:15:27 2026 +0200
sci-ml/bigcode-eval: new package, BigCode evaluation-harness HEAD snapshot