Can my first house hack be a single family home and my second be a multifamily?

[Jorge Adarraga]

I recently met with a lender and this topic came up. The lender recommended I do not start with a single family home because it will raise questions from lenders when it comes to house hacking my second home. Lenders will be suspicious that I am trying to occupy properties as an investor while paying home owner interest rates (~3.5%), instead of putting 20% minimum down payment as required by investors. Does anyone have any advice or experience house hacking in NYS? 

I really appreciate the input. 

Jorge