Captain Anthony was rumored to be Frederick's father.
My father was a white man. He was admitted to be such by all I ever heard speak of my parentage. The opinion was also whispered that my master was my father; but of the correctness of this opinion, I know nothing; the means of knowing was withheld from me.
Narrative of the Life of Frederick Douglass, an American Slave, Written by Himself