When to buy first house (not a rental)

[Cj Underwood]

Looking to buy our first property ( Duplex ) and live in half. We have always rented and moved almost every year.

Needless to say we are sick of moving. We are okay doing it one more time for the duplex as an owner occupant for a year or so. After that we would really like somewhere to call home for a few years at least.

The plan with our home would be a smaller single family (3br / 2ba possibly) that needs some work, nothing major but hopefully with good returns after the work. We would like somewhere to call home that we can stay in one spot because we will be starting a family soon.

I guess my question is for people buying their first property as an investment, when do you decide to invest in a house for yourself in the process of getting rentals and trying to grow your portfolio? Or do you stay renting?

Thanks in advance everyone!