Who is the antagonist in Pomegranate Seed by Edith Wharton?

Elsie Ashby, or perhaps more accurately, the ghost of Elsie Ashby, serves as the story's antagonist.