This Fourth [of] July is yours, not mine. You may rejoice, I must mourn.
This is one of Douglass's main points. Meaning that even many people are jubilant, and are celebratory of their freedom, for slaves and many black people, the Fourth is a time that they are reminded of their circumstances that they are under, certainly not freedom.