MFDUs in high-demand areas like Asheville might be limited, but it’s worth keeping an eye out for smaller duplexes or triplexes that align with your budget.If neither works, continuing to rent while buying a pure investment property in a more affordable nearby market could make sense.

That would allow you to put down less knowing you have that income coming in.Otherwise, is it possible to consider moving somewhere more affordable so you can reach that financial freedom you want? 

Can I afford to wait?"

BUY ALL YOU CAN AFFORD!

You think people that can afford those prices want some stranger living in their back yard?

You should talk with lenders to get an idea of what you can actually afford though it doesn't really matter if you talk with an agent first since most agents will have lender recommendations.

So even though the total housing numbers may go up, they are not meeting demand for the working class renters who need affordable housing.

I see a few abandoned nursing home type places in rural areas, and always think as I drive by, would a good repurpose of them being senior living, or veteran living, or just plain affordable housing living? 

I'm not sure why you 'cannot really afford to lose' this job.

In Land Investing Online there is a free support group as well as an affordable monthly subscription (I think $100) where you can share your deals for input from the other members.