My grandkids are good kids, he just says he is old and they bother him?

Regarding last question, spouse wants me back, but says under one condition that my grandkids, 8 yr and 2 yr. do not spend the night. I will not tolerate this. He is very grumpy and moody.