You do not need to look for a self-directed IRA specialist - who are few and far between. 

If you are self-managing you don't want to multiply your portfolio until you have a descent grasp on running 1. 

I have looked into using a self directed IRA and I don't have enough money in the account to make the juice worth the squeeze.

@Neil McCartyIf you are self-employed (i.e. active self-employment earned income separate from your w-2 income) with no full-time w-2 employees, you can set up a Solo 401k and then rollover your 401k funds from your former employer 401k and/or non-Roth IRA.You could then take a loan of up to 50% of the balance not to exceed $50,000.

@Tracy Dear if I was self managing I could now, but I like my job.

You know, self-love is the truest love?

Say I make  $150k in a year as a self employed RE professional.

However it definitely takes the right mindset to become successful, you need to be driven and have a lot of self discipline.

As Nathan mentioned it takes a lot of time to self management.

Those rules around self employment are the problem you are running into.