Scout - it sounds to me like you made plenty of good faith efforts to remedy the problem while your H made little or no effort. Its not surprising that his lack of support and affection worsened your postpartum depression and dampened your desire for him.

This situation revealed your Hs basic narcissism - a trait that was always there but may not have been visible to you so long as he was getting his narcissistic supply from you.