-Why don't you ask your current PMC if they can do the same thing?

I was thinking about buying the land (maybe it is 20-30k for the .25 acre lot), finding a builder in the area, and seeing if I could build a ~1,250 sq ft 3/2 single family house and see if I could make the math work. 

You also could find a partner to do the operations so you can avoid the parts that stress you out.

Make sure you do your research as well. 

Stats and all. ;-)Took me all of 5sec do google search to get the below info. 

@Jay Jones asmentioned i don't get financing through them but do business with them through other channels. we do what they do (private lending) 

You might be doing something right by not buying.  

Do you think I should give up all my profit to just get the first deal done? 

If not, what will you suggest me to do?

I will say the abatement if you do it right with a good contractor will be pricy since they have to abide by some different regulations on disposing of it.