Obtaining a conventional loan for first property

[Billy Holt]

I'm looking to finance my first property. I've called 9 different lenders (mostly banks and credit unions) around their financing options and terms. When I tell them I'm looking to purchase a 2-4 unit multi-family that I plan to rent out, they all say I need a commercial loan. In the real estate books/blogs/pod casts I've scoured, it seems common to purchase a 4 unit and under rental using a conventional loan. 

What am I missing here? Do I really need a commercial loan? Am I speaking to the wrong lenders?  Is it possibly they don't know what they are talking about? 

Thanks for helping a beginner! If you have any suggestions of lenders in the Metro Detroit area, let me know!