In theory, yes. If everything lines up and everyone is happy with the structure.
Some issues.
Most lenders are not going to be happy with the equity coming into the deal as a loan from people who are not on the title of the property. The lender sees extra risk that the borrower will walk away when things go bad. They have no skin in the game. The LTV for the 1st loan has a cap for a reason. Borrowing the rest of the funds defeats many of the benefits of the LTV cap.
The pooling of funds from multiple investors so the deposit is funded as a loan could be consider a regulated activity. The Canadian regulators may see this as a collective investment scheme. If so, you would need to be approved before you can even speak to people. You might need extra approvals to accept the funds. Financial promotion is different from running a pooled investment so likely to be two sets of regulations.
The timing of the refinance is an issue. Assuming you got past the other issues I have highlighted, you would likely be better off with a 1st loan that was longer than a 5 year term. So you do not hit the wall at 5 years. No telling what the mortgage market will look like in 5 years. You might need 6 years before you could refinance.
In addition to the risk that the lenders will have pulled back on new loans, the value of the property might not have gone up enough to fund refinance where the original deposit is paid back to the investors. Maybe the lenders are happy to lend yet you just do not have the equity in the property after 5 years to make it work for your passive investors.
The above info will largely apply north or south of the USA/Canadian boarder. Similar for the UK as it happens.