Scraper and crawler built with Playwright and Cheerio
bfs-scrape.js | ||
LICENSE | ||
README.md | ||
scrape-everything.js |
Playwright_Scraper
Playwright scraper and crawler
Versions and Differences
BFS version The BFS version uses the Breadth-First Search Approach To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.