NC law concerning a neighbors structure found on my property

[Cody Plemmons]

I purchased a single family buy and hold property about a year and a half ago. The property somewhat wraps around a neighboring home behind me. I suspected the neighbors metal 2 car garage to be across the line onto my property, but wasn't really that concerned since it was to be a rental house. I recently had the property surveyed and about 10 foot or so is on my property. The land behind his house that I own could be made into a flag lot in the future and this would be in the right away. My concern is now that we both know it is on my property is there a time limit or a law that states that after a certain amount of time if I don't make him move it becomes his property? I have spoken to him about it, but I don't really see the need to ruffle any feathers and make him tear it down until I actually do something with the land unless I could lose that part of the property.