I have owned my house for 8 years now. When I bought my house the backyard was fully enclosed with one of the fences installed on the property line between my house and my neighbors. About 4 years ago my neighbor removed the existing fence and built a privacy fence 2" within his property line, hence giving me occupancy of the land. This year I build a raised flower bed (4-5" above grade) next to the fence. He is claiming my garden is on his property and I have to remove it. Is he correct or can I keep my garden as is since he willing gave me occupancy?