Who is the antagonist in Notes of a Dirty Old Man by Charles Bukowski?

I think that Bukowski is his own antagonist. He sexual obsessions and personal demons seem consume him. Relations with women are often single night events, or doomed to failure due to his wandering nature. He has few friends outside other authors who do not live near him. Bukowski take on human nature and popular culture is still provocative and, in the eyes of many, enlightened.