Why does Brian leave Heather and return to California in the memoir, Happiness?

As a partner for Heather, Brian initially holds firm to his desire not to have children, leaving her to return to California alone while pregnant.