Real Estate Technology
Market News & Data
General Info
Real Estate Strategies
Short-Term & Vacation Rental Discussions
presented by
Landlording & Rental Properties
Real Estate Professionals
Financial, Tax, & Legal
Tax, SDIRAs & Cost Segregation
presented by
1031 Exchanges
presented by
Real Estate Classifieds
Reviews & Feedback
Updated almost 18 years ago,
Google Crawling
Why doesn't Google crawl all of my clients webpages? The SE's have crawled the top page and just a few other web pages, last time in december. I can't find no reason why. The website uses ASP.net with aspx-links but a few of these aspx-links is crawled by these SE's. I checked in cached pages and with lynx that outgoing links exists in the top page. Is it possible that for example cookies can stop SE's to crawled further? Lynx asks me to agree to some cookies.
Before, the navigation left menu was in javascript-links but though we changed that a couple a months ago there is no change in crawling.