Primary 4plex, any lender do 20% on a conventional?

[Sarp Ka]

I spoke to few lenders they strictly only allow 25% down for the 4plex and not allowing 20% for 4plex using it as a primary residence. But as per rules, in theory I should be able to get a conventional loan with 20% down payment.

I'm wondering if there's any specific lender that would allow me to just put down 20% on a conventional loan.

Thanks