Do all lenders charge origination points?

[Nate Bartlett]

My wife and I are looking to invest in a single family short term rental property. We've had our fair share of hurdles since making the decision. The newest one is that our lender just told us that we will have to pay 2 to 2.5 points for the investment loan. This of course is taking away a good amount of cash that we had considered using for our down payment. And since we are using an investment loan, we are required to put down 20%. This has lowered our purchase amount so much that we are now not finding any turnkey properties that we would feel comfortable listing on AirBnB.

My question is, do all lenders charge points? The person we are working with is an investor-friendly mortgage broker. Would we be better off going directly to a bank or credit union? Do they also charge points?