I wrote a whole long post and decided to delete that one. May, I know this is tough.
Basically, you are both back in marriage 1.0. Which is pretty much going to end up with the same result.
I echo wayfarer. He’s trying. But you keep punishing . Marriage 1.0. You let him back with no clear expectations. So he is doing what he thinks he can do. Speak your love language ( acts of service) try to share and connect on his interest and he is getting stonewalled .does he deserve it? Sure, but if you truly want a marriage 2.0, you can’t do that.
And I get the feeling that you want him be fed up and leave so it’s him doing the leaving and you not doing the kicking out. I could be off base, but I get this impression