Who is the antagonist in The Boleyn Inheritance by Philippa Gregory?

Howard, Duke of Norfolk, is likely the best candidate for antagonist, as it is Norfolks spying, manipulation, which lie at the heart of the conflict and cause so many unneccesary deaths.