Scraper and crawler built with Playwright and Cheerio
Go to file
2024-08-14 20:53:42 +03:00
bfs-scrape.js Added the BFS version 2024-08-14 20:49:07 +03:00
LICENSE Initial commit 2024-08-14 20:47:49 +03:00
README.md added BFS to readme 2024-08-14 20:51:08 +03:00
scrape-everything.js added the clusterfuck 2024-08-14 20:53:42 +03:00

Playwright_Scraper

Playwright scraper and crawler

Versions and Differences

BFS version The BFS version uses the Breadth-First Search Approach To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.