Neighbor not cooperative on allowing access for property that isn't his

[Bob Plano]

So weird situation here. There is a county access way that backs right up to my property. It's a future roadway that is owned by the county. It runs adjacent to a neighbor so I thought I would run it by him that I will be needing it to add fill to my property. 

His response was surprising and he said "not interested. I don't want a lot of traffic here". Meanwhile, he has been using this access for his own lot improvements.

I decided to call the county and ask for their permission since it's not really my neighbors land. To my surprise, the county said I could use this access way to bring fill to my property. I already have a permit open for a pool being built, so that was enough for the county to grant me permission.

My question is this: what if my neighbor is difficult again about not allowing me to use that access or block access? He currently has 5 yards of mulch blocking the county pathway. I hope this doesn't escalate if he doesn't work with me here, but if it does, do I get the county involved if he doesn't back down? 

Curious your thoughts and thank you in advance