I understand that wen your son asks her to go that you don't want to disappoint him but right now you need space from her. She is slowly putting you in the friend zone and that is a place you don't want to be.
When she is responsible for the kids you want to be out doing something. The key is to be mysterious. Take the focus off your w and she will notice.