There is no one right answer. It depends a lot on your personal situation and your goals. A couple of questions that are extremely relevant: (1) how old are you? (2) how much do you make in earned income - that is from a job? (3) how long do you see yourself continuing to work at your job? (4) how risk averse are you?
If your profile is that you are young, with a good income from a profession that you could see yourself doing for a long period of time, then scaling up is probably your best move. Even if the market goes down, in the long term, it is likely to recover and you are playing the long game. In the long game, you benefit from scale. Scale includes the fact that a lot of tenants are paying down a great big mortgage building up equity for you over a number of years. That is additive with inflation, even if a small percentage, it is on a bigger propertie(s).
If you are getting close to retirement age, I would not be inclined to leverage overly much.
Personally, I went too conservative of a strategy years ago. I focused on paying off our home mortgage and then the mortgage of our first multi-family before we branched out. In hindsight, I wish that I had been more aggressive back then. Anyway, we do own a lot more now as I eventually learned the value of leverage and scale!
Good luck!