Skip to content
Get started
Resources & Media
Resource Hub Bookstore Blog Guides Pro-Exclusives PRO Podcasts Pro Partnerships
Events & training
BPCON2025 Webinars Bootcamps Events & Meetups
Strategies
How to Manage Your Rental Property How to Operate a Short-Term Rental How to Passively Invest in Real Estate How to House Hack How Does the BRRRR Method Work How to Flip a House How to Invest in Commercial Real Estate How to Invest in Real Estate How to Invest in Multifamily Real Estate How to Build Wealth
BPCON2025
This is your chance to learn from the best, network with the best, and become one of the best in the game.
New Year, New Goals
From resolutions to results: Join top investors for 8 weeks of action and accountability
Pick markets
Pick markets
Market Finder - NEW PRO Picking a Market Workshop PRO Picking a Market Worksheet Top 100 Cash Flow Markets Market Insights - Sunbelt Region
Market finder
Pinpoint the best real estate market for your specific goals with expert recommendations and real-time data on appreciation, affordability, rent to price ratio, and more.
Find deals
Find deals
On-Market Deal Finder - New PRO Off-Market Deal finding PRO Real Estate Syndications Investor-Friendly Agents Find Foreclosures Community Listings (FSBO) Business Directory
Deal finder
Quickly find your perfect investment property based on your cash flow and ROI goals.
Invelo - Off market deals
Scale your portfolio with off-market deals
Analyze deals
Calculators
Rental Property Calculator PRO Rehab Estimator PRO Rent Estimator PRO BRRRR PRO Fix & Flip PRO Short-Term Rental PRO Sell vs. Keep PRO All Calculators
Rental property calculator
Is it a good deal? Run your numbers like a pro with this simple yet powerful calculator.
Rent estimator
Understand how much rental income you can expect based on recent reports and data for your specific property.
Manage properties
Manage properties
Managing Properties 101 Find a Property Manager RentRedi Property Management Software PRO Property Management Tools Ask a Management Question Finding Tenants PRO Screening Tenants PRO Leases + Landlord Forms PRO Accounting/Bookkeeping PRO Property Insurance Property Maintenance / Rehab PRO
Property management software
Manage tenants, tasks, and your entire portfolio with one simple tool.
Property manager finder
Find reliable property management partnerships that last.
Forums
For You
Newest Trending Unanswered My Discussions Followed Discussions Followed Categories Followed Locations Followed People
General Real Estate
General Real Estate Investing Starting Out Deal Analysis Buying & Selling Business & Marketing Landlording Property Management Reviews & Feedback
Real Estate Strategies
House Hacking BRRRR Short-Term Rentals Mid-Term Rentals Multi-Family Fix & Flip Other Strategies
Finance & Financing
Lending Creative Finance Personal Finance Taxes & Legal Issues
News & Announcements
Official Site Announcements Market Trends & Data Real Estate News & Current Events Pro Exclusive Area PRO
Events & Networking
Events & Meetups Classifieds
Store
All Books
BLACK FRIDAY SALE Best Sellers Browse All New Books & Pre-Orders Bundle & Save Books for Beginners
Simplify your goals and find clarity for your investing
Dave Meyer's newest book gives a practical framework to craft and execute YOUR personalized real estate plan.
Claim your piece of a $30B industry.
Build wealth with this insider's guide to glamping, campgrounds, and RV parks in the outdoor hospitality industry.
Pricing
Plans and Pricing
Pro Membership Business Membership
TRY PRO FOR 7 DAYS COMPLETELY FREE
Avoid mistakes and make informed decisions with Pro.
GROW YOUR BUSINESS
Promote your business on BiggerPockets and make quality connections with the right investors
×
PRO
Pro Members Get Full Access!
Get off the sidelines and take action in real estate investing with BiggerPockets Pro. Our comprehensive suite of tools and resources minimize mistakes, support informed decisions, and propel you to success.
Advanced networking features
Market and Deal Finder tools
Property analysis calculators
Landlord Command Center
$0
TODAY
$69.00/month when billed monthly.
$32.50/month when billed annually.
7 day free trial. Cancel anytime
Already a Pro Member? Sign in here

Join Over 3 Million Real Estate Investors

Create a free BiggerPockets account to comment, participate, and connect with over 3 million real estate investors.
Use your real name
By signing up, you indicate that you agree to the BiggerPockets Terms & Conditions.
The community here is like my own little personal real estate army that I can depend upon to help me through ANY problems I come across.
Followed Discussions Followed Categories Followed People Followed Locations
Innovative Strategies
All Forum Categories
Followed Discussions
Followed Categories
Followed People
Followed Locations
Market News & Data
Market Trends & Data
Buying & Selling Real Estate
Out of State Investing
Real Estate News & Current Events
Real Estate Technology
Investor Mindset
General Info
BiggerPockets Exclusive PRO Area
PRO
General Real Estate Investing
BPCON
New Member Introductions
Questions About BiggerPockets & Official Site Announcements
Off Topic
Starting Out
Real Estate Success Stories
Real Estate Horror Stories
Real Estate Strategies
House Hacking
BRRRR - Buy, Rehab, Rent, Refinance, Repeat
Commercial Real Estate Investing
Innovative Strategies
Mobile Home Park Investing
Land & New Construction
Multi-Family and Apartment Investing
Wholesaling
Rehabbing & House Flipping
Short-Term & Vacation Rental Discussions presented by
Tax Liens & Mortgage Notes
Medium-Term Rentals
Buying & Selling Small Businesses
Outdoor Hospitality
Landlording & Rental Properties
General Landlording & Rental Properties
Managing Your Property
Marketing Your Property
Tenant Screening
First-Time Home Buyer
Real Estate Professionals
Mortgage Brokers & Lenders
Contractors
Real Estate Agent
Financial, Tax, & Legal
Creative Real Estate Financing
Personal Finance
Insurance
Private Lending & Conventional Mortgage Advice
Tax, SDIRAs & Cost Segregation presented by
Foreclosures
1031 Exchanges presented by
Goals, Business Plans & Entities
Legal & Legislation
Real Estate Classifieds
Classifieds
Real Estate Events & Meetups
Reviews & Feedback
Ask About A Real Estate Company
Real Estate Deal Analysis & Advice
Guru, Book, & Course Reviews
Syndications & Passive Real Estate Investing

Updated almost 4 years ago,

Scott Wilkonson's profile image
Scott Wilkonson's profile image
Scott Wilkonson
Pro Member
  • Member since May 15, 2020
Connect

User Stats

6
Posts
0
Votes
Scott Wilkonson's profile image
Scott Wilkonson's profile image
Scott Wilkonson
Pro Member
  • Member since May 15, 2020
Connect
Scott Wilkonson
Pro Member
0
Votes |
6
Posts
Innovative Strategies

Using Software Engineer to Aggregate Data?

Scott Wilkonson
Pro Member
Posted

I'm looking to use large-scale data scraping to find deals.  Has anyone done this before or would be interested in doing it?  I'd love to hear ideas on what parameters would provide value.  I'd also love to discuss what automation features would add value to searches.   

  • Scott Wilkonson
    • 0 Votes
    Follow
    7 Replies
    Jump to Last Reply
    Log In or Sign Up to Reply
    Sort By:

    Loading replies...