scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

Language: Python

1,629GitHub stars

1,041public forks

Observed star growth

+0 stars24h growth
Observed OpenPulse samples

+0 stars7d growth
GitHub history through 2026-10-18

+1 stars30d growth
GitHub history through 2026-10-18

Latest OpenPulse observation: 2026-10-18 22:46 UTC