Legal Question in Family Law in Georgia

The worst thing a person can do in such a situation is to create a legal problem when there isn't one. Frankly your idea often is a disaster. You never go to court when you already have what you seek.

You already have, in reality, what you seek. And almost no judge will erase visitation in such a case, but such a case can boomerang against you by giving him a forum - to reduce support, or to claim the lack of visitation is your fault, etc. Many judges will also place all of you in family counseling in such disputes.

There is generally no upside to what you ask, but there is enormous downside.

See a lawyer if you think your circumstances are unusual (such as abuse), but otherwise you have come up with the worst reaction you could come up with, absent unusual facts.

You already mentioned your solution: file for sole, if that's really what you want to do. However, you should consult with a lawyer first to discuss the pros and cons.