dev-python/Protego
Pure-Python robots.txt parser with support for modern conventions
Screenshots
-
protego-0.6.0~amd64 ~arm64 ~x86test python_targets_python3_11 python_targets_python3_12 python_targets_python3_13 python_targets_python3_14
View 
Download 
Browse License: BSD Overlay: inode64-overlay