I am unsure who exactly made this comment, and I am also unsure of the tone with which it was delivered. However, with consideration of the context of this story, I would suggest that this commentator is most sensitive to the experience of the child.
It seems that the commentator is focusing on the effects of Douglass and the woman's relations- the child. Due to the nature of its parents, the child will have a difficult life ahead of it. Although the child is born in Ohio, which faced less racial tensions than states in the South, the child was not only born out of adultery, but out of interracial adultery.
In addition to this, the child was born to a poor negro father and a well to do white mother. This history would only cause the child to be further ostracized in society because of its sheer existence enrages racist white people and reinforces the cautious sentiment of black people that would make them want to stay away from white people.