Actually I think his feelings for Mary had been reignited after coming close to losing her, and perhaps understanding a bit more. In that last scene, they seemed so close, he was ready to confess, both of them allowing the other to go on an adventure instead of complaining about being the one left with the baby, and so on. I think that if Mary had lived, they would have sorted it out. But I agree with you, that even if they were still having difficulties, losing Mary like that would be traumatic and heartbreaking.