Who is the antagonist in The Memory Keeper's Daughter by Kim Edwards?

David's secret serves as the main antagonist in the novel, The Memory Keeper's Daughter. David rejects his daughter, lies to his wife, and struggles with the guilt of his actions throughout his life.