Real Estate Technology
Market News & Data
General Info
Real Estate Strategies
Short-Term & Vacation Rental Discussions
presented by

Landlording & Rental Properties
Real Estate Professionals
Financial, Tax, & Legal
Tax, SDIRAs & Cost Segregation
presented by

1031 Exchanges
presented by

Real Estate Classifieds
Reviews & Feedback
Updated about 6 years ago on . Most recent reply

Scrapers 101: What are they, how do you use them?
Been at real estate for seven months and just stumbled upon the subject of "scrapers". What are they? Are they useful?
Most Popular Reply

I was bored the other morning and wrote a shell script using curl/wget to pull all the contact information from all of the rental properties on craigslist.
Unfortunately they didn't like that I pulled down several hundred pages of content in a couple seconds and banned the IP of the server I was using. Will have to make it more discreet next time ;)