Yeah that does seem really high. I have five similar sized properties (1500-2200sqft) in Tulsa area and they cost $500-600 each per year, with 80% coverage and 1mil liability. State Farm. As mentioned above, I also don't cover for replacement cost; if the place burns down are you really going to rebuild? Likely not but instead sell the lot and move on to another house. In that case you just need to cover the value of the property. Some landlords will cover for only the loan amount but if there was a catastrophic loss, I would at least want to get the payment for the full value of the home....and not loose my investment earnings. Note that if you go below 80% coverage you will get a coinsurnace penalty and any claims, even small, will only be partially covered.
Just shop around like crazy to find the best deal. I like to get 10+ quotes. If the properties are deeded in an LLC then you'll have much fewer choices, unfortunately. But State Farm does cover LLCs with no trouble. Farmers does too.
Good luck!