Financing Land w/ a structure but no dwelling

[Michael Brockway]

Hi All - I recently saw a lot in my neighborhood hit the market BUT my mortgage guy said he can't finance it because there is no dwelling on it. I then reached out to someone who does loans for land and they can NOT finance it because it has a vacant garage/shop on it. 

Has anyone run into this issue before? What's the best play if I do not want to knock the garage down?