- The redfin crawler can't advance the search result pages. It's currently only scraping listings on Page 1.
- Scraping can get stuck and we need to solve two corner cases:
- After scraping 40 properties, a captch page will show up. We need to solve work with captcha.
- The page will pop up a login, we should either login, or refresh the page, or maybe this doens't matter to playwrite.
-
Notifications
You must be signed in to change notification settings - Fork 0
z26zheng/web-crawler
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published