sci-ml/evalplus
Rigorous evaluation of LLM-synthesised code (HumanEval+, MBPP+)
ChangeLog
commit eb47e5e13ff1caea17d729856300eee9d1d4e41b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 21:07:02 2026 +0200
sci-ml/evalplus: move stop-sequencer dep to $
dev-python/stop-sequencer is now SINGLE_IMPL; keeping it inside the
multi-impl python_gen_cond_dep wrap with $ silently
auto-satisfies via [X(-)?] without enforcing the Python-target match.
Move it out of the wrapper and pin to $.
commit 31c83ba62b2b611e939b0a86cb8a8749684de49b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 14:44:49 2026 +0200
sci-ml/evalplus: switch to DISTUTILS_SINGLE_IMPL
sci-ml/{datasets,transformers} are SINGLE_IMPL, so a multi-impl evalplus
emitting [$] against them produces the conditional
python_targets_python3_*(-)? dep that the single-impl child can't satisfy.
Make evalplus single-impl too (matching the convention used by the rest of
the pytorch+HF stack: sci-ml/accelerate, sci-ml/fastai, etc.) and split
deps into bare $ for the SINGLE_IMPL pair plus a
python_gen_cond_dep wrapper around the multi-impl dev-python remainder.
commit 325814687e2540a5a88e785fe455a1f4620e1bb9
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 23:27:47 2026 +0200
sci-ml/evalplus: new package, EvalPlus 0.3.1 (HumanEval+ / MBPP+ harness)
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 21:07:02 2026 +0200
sci-ml/evalplus: move stop-sequencer dep to $
dev-python/stop-sequencer is now SINGLE_IMPL; keeping it inside the
multi-impl python_gen_cond_dep wrap with $ silently
auto-satisfies via [X(-)?] without enforcing the Python-target match.
Move it out of the wrapper and pin to $.
commit 31c83ba62b2b611e939b0a86cb8a8749684de49b
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sun May 10 14:44:49 2026 +0200
sci-ml/evalplus: switch to DISTUTILS_SINGLE_IMPL
sci-ml/{datasets,transformers} are SINGLE_IMPL, so a multi-impl evalplus
emitting [$] against them produces the conditional
python_targets_python3_*(-)? dep that the single-impl child can't satisfy.
Make evalplus single-impl too (matching the convention used by the rest of
the pytorch+HF stack: sci-ml/accelerate, sci-ml/fastai, etc.) and split
deps into bare $ for the SINGLE_IMPL pair plus a
python_gen_cond_dep wrapper around the multi-impl dev-python remainder.
commit 325814687e2540a5a88e785fe455a1f4620e1bb9
Author: Ivan S. Titov <iohann.s.titov@gmail.com>
Date: Sat May 9 23:27:47 2026 +0200
sci-ml/evalplus: new package, EvalPlus 0.3.1 (HumanEval+ / MBPP+ harness)


View
Download
Browse