Two duplex’s on the same mortgage?

[Aaron Hale]

I’m considering picking up two duplexes being sold by the same seller and was wondering if I could put them both on the same mortgage as a 4-unit dwelling for the purposes of minimizing my number of residential mortgages. 

I’ve seen this happen when the buildings were on the same parcel but what if, though directly adjacent to each other, on two different addresses? 

Is this possible with a traditional agency residential loan? Would a small bank or portfolio lender consider this?

Thanks for your input.