sci-CRAN/spiderbar
Parse and Test Robots Exclusion ... (see metadata)
USE Flags
r_suggests_covr
* This flag is undocumented *
r_suggests_robotstxt
* This flag is undocumented *
r_suggests_tinytest
* This flag is undocumented *
byte-compile
* This flag is undocumented *