If I loaned the kids to my ex husband can he give the kids to his mom without my consent
Yes.
Is his mother dangerous? Has she ever abused a child? Is she impaired somehow - drugs, liquor, seizures?