My Ex and I have a custody agreement. Where I have sole legal and physical custody. We orally agreed on visitation for Saturdays. Now he is saying he doesn't want to give her back. Can he do that? and what should I do about it? A lot of times I am working during the time of pick up so my Mother drives the hour and picks my duaghter up for me...Can my Ex refuse to release my duaghter to my mother's care?