To put brick pavers on yard need permission or not?

[Huiping S.]

We brought this home few month ago and recently tried to pave bricks on some parts where have wild weeds and dirt and very ugly. This morning one side of our neighbor messaged me to stop put pavers on his side with this reason: our pavers will flood his property. How can our pavers will flood his property? Said we need to put grass then said even grass will flood his property too. So his assumption is we can’t do anything but sue us. We didn’t put any pavers on that side but only get rid of the weeds and junks for many years there. He even said we need to get the permit. He will sue us and the handymen did some work not on his side. Do we need permission to put pavers compared just weeds and dirt on our yard(has fence)? This is a FL SFR without HOA. Our property is a little taller than his property and he said that happened >20 yrs ago by former former owner to put some dirt around house. He said he complained the former owner to county and county didn’t support him because the former owner didn’t do anything but former former owner for at least 25 years ago. Will this be a fault of us? So manipulate neighbor is bad: my grass need to be take care, why I left my trash bin on out overnight, why my car park on outside.... i even be told I scared his wife because I am a doctor! We are on the process to buy another property and mostly will live and rent this out because this neighbor. We planned to live here for some years to improve the condition and it is very close to my office. Appreciate experienced investors to share your valuable knowledge! If you know good lawyer of Tampa area, could you please share the contact information? Thanks. Huiping