Credit score issue for financing

[Asher Anthes]

Okay, so I'm trying to do a cash out refi. I've talked to several lenders, and apparently a middle score of 700 is a big cut off point. One mortgage broker told me the difference between having a 701 score and a 699 score on a 30 year fixed is a FULL .5%, which is think is a little crazy.

The problem is a few months ago, I had a middle score of around 705 i believe, and i just did two soft pulls today and am getting 685 and 696. I want to refinance NOW, but with my scores so slightly below that magic cut off point which would save me thousands in the long run... I'm not sure what to do.

I don't know why my score is so low, I've had a mortgage for 2 years, three student loans for almost 4 years, a credit card for 8 years never late on anything, I had one collection 5 years ago, but it's been long settled.

Is there any quick fix that will raise my score only 10 or 20 points? that's all i need.