Why does Ben decide to stay away from Anne and her family in the story, A Kindness?

Ben, Anne's babay's father, was a one night stand. His decision to remain disconnected allows Anne's family to be just that... a real family.