Playwright_Scraper/README.md

15 lines
552 B
Markdown
Raw Normal View History

2024-08-14 17:47:49 +00:00
# Playwright_Scraper
Playwright scraper and crawler
2024-08-14 17:51:08 +00:00
# Versions and Differences
2024-08-14 18:05:04 +00:00
**BFS version**
2024-08-14 17:51:08 +00:00
The BFS version uses the Breadth-First Search Approach
To ensure the crawler explores all pages more thoroughly the crawler processes all immediate links (siblings) at the current depth level before moving on to deeper levels.
2024-08-14 18:05:04 +00:00
**Scrape Everything**
This pretty much lets the crawler to go wild (can't recommend)
**Scrape Domain Scope only**
Scrapes within the domain scope (worse BFS version as this goes in a straight line and doesn't scan everything)