In NY, there are numerous small towns, each with their own unique vibe. However, if you're within a reasonable commuting distance to employment opportunities, I believe it will likely work out fine. The return on investment (ROI) is strong here, providing a great buffer for getting your property rented out in the worst-case scenario. Additionally, it's highly probable that your tenants will want to continue living there.
I'm curious about where you obtained the vacancy number from? In my area, the reported vacancy rate is typically higher than the rental demand.
Another thought would be to go above the norm when turning the units over. By doing so, you'll likely have the most desirable rental units in the area, reducing vacancy rates. I'm not sure where you are but I'm willing to bet that there aren't any Class A buildings being constructed in that area, so the bar is probably quite low when it comes to creating a wonderful living space for your tenants