TUIS/Playwright_Scraper
4
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
0fa9f7003b
Playwright_Scraper/README.md
Kиро.Kрика 0fa9f7003b
Added everything to readme
2024-08-14 21:05:04 +03:00

552 B
Raw Blame History

Playwright_Scraper

Playwright scraper and crawler

Versions and Differences

BFS version The BFS version uses the Breadth-First Search Approach To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.

Scrape Everything This pretty much lets the crawler to go wild (can't recommend)

Scrape Domain Scope only Scrapes within the domain scope (worse BFS version as this goes in a straight line and doesn't scan everything)