I am not sure if I should ask the credit union if they will allow me to rent it out and wave the primary residency, or would my only option being to refinance. 

But I don't know the terms or what state they were in.A local credit union or bank may be able to help you with something like that.

Ok so I realized I posted incorrectly as my middle score is 638 but my high is 652 and low is 614 and depends on the score system I've been told by my bank of Idaho central credit union is 614. 

I use a local credit union that only requires someone to have your account number in order to deposit money into your account.

Ck with your local federal credit unions there the easiest work with. 

You have achieved something that many people never achieve.I would call credit unions and ask how to become a member.

Visions federal credit union. 100% LTV

Is this something banks or credit unions or lenders would assist with?

We used a credit union for the line of credit on the house.  

Try a local one like a credit union.