Each unit is a two bedroom 1 bath and they rent for $600 dollars a month.

A good one will pay for him/herself by getting you top dollar for your property. 

That is different than a restaurant raising prices 10% to pay cooks a couple dollars more an hour.

I’ve been looking for duplex/multi family house as my first purchase to house hack, but everything is over a million dollars!

I think it also boils down to personal risk tolerance, I personally want to be able to access those funds ASAP when opportunities arise and know that it's going to be ~the same dollar amount.

These types of jobs can cost 10s of thousands of dollars.

That’s like 20%  of the money you would net in a year if financed (after principal, interest, taxes, and insurance (PITI) Compare that to paying the under $5 dollars per day that Zillow charges to list on their platform through an affiliate service like Rentec Direct.  

will cost me thousands of dollars. 

There is nothing stopping you here besides around 80 hours of time and a few hundred dollars.

-The Days on Market (DOM) figure for single-family homes fell from 51 to 26;-Total property sales rose 9.2 percent with 12,036 units sold;-Total dollar volume increased 26.7 percent to $4.3 billion;-The single-family average price increased 14.0 percent to $380,233; -The single-family median price rose 15.2 percent to $310,000; -Single-family homes months of inventory registered a 1.9-months supply, down from 2.6 months year-over-year and below the national inventory of 2.6 months;-On a year-to-date basis, single-family homes sales are running 17.4 percent ahead of 2020’s record pace.