Buy with Spouse & then refinance to take me off- Down Payment Q

[Rian Ash]

Hi BP Members,

Both my wife and I own 4 properties each- separately. I am looking to buy another one (rental). We want to buy together, then refinance and take myself off the mortgage and the title. The thing is that with the original purchase, the down payment money will be coming from my account only (a heloc) - Will that be an issue with refinance if we do the refinance in let's say a month? 

I looked at the Fannie Mae guidelines but there is nothing which covers this scenario. It is clear that you cannot accept gift for buying investment properties. In a way, I am going around this guideline but before I go and execute this strategy, I want to make sure I will be able to do the refinance.

Thanks for your help!