Gentoo Portage Overlays - dev-python/smashed

dev-python/smashed

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

Screenshots

https://github.com/allenai/smashed

smashed-0.21.5

~amd64 ~x86

all datasets dev prompting remote torch torchdata python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14

View

Download

Browse License: Apache-2.0

Overlay: pypi

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

USE Flags

all

* This flag is undocumented *

datasets

* This flag is undocumented *

dev

* This flag is undocumented *

prompting

* This flag is undocumented *

remote

Global: Enables support for secure remote connections

torch

* This flag is undocumented *

torchdata

* This flag is undocumented *

python_targets_python3_11

* This flag is undocumented *

python_targets_python3_12

* This flag is undocumented *

python_targets_python3_13

* This flag is undocumented *

python_targets_python3_14

* This flag is undocumented *