Pitfalls of Multi-Family zoned Single Family??

[Peter Welch]

I'm considering purchasing a home that has a full unit upstairs and a full unit downstairs in a walkout basement. They both have their own entrance, kitchen, and laundry. The numbers look good for, me for the purchase as a multifamily. However the property is zoned for Single-Family. I could foresee this potentially causing problems with pulling permits for repairs and tax issues.  Has anyone else been in this situation? Advice would be helpful.