robotstxt - A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker
Provides functions to download and parse 'robots.txt' files. Ultimately the package makes it easy to check if bots (spiders, crawler, scrapers, ...) are allowed to access specific resources on a domain.
Last updated 5 months ago
crawlerpeer-reviewedrobotstxtscraperspiderwebscraping
10.43 score 68 stars 7 dependents 414 scripts 2.3k downloads
readMDTable - Read Markdown Tables into Tibbles
Efficient reading of raw markdown tables into tibbles. Designed to accept content from strings, files, and URLs with the ability to extract and read multiple tables from markdown for analysis.
Last updated 2 months ago
datadata-analysisdata-analyticsdata-extractiondata-miningdata-sciencemarkdownmarkdown-parsermarkdown-tabler-programming
6.10 score 7 stars 1 dependents 3 scripts 624 downloads