This sentence made something click in my brain:
We cannot solve this debate until we differentiate between Rights vs Responsibilities.
RIGHTS are also called "negative rights" which means you have autonomy to make your own decisions without infringing on the autonomy of others. Technically, if your 'right' requires someone else to do something, it is not called a right, because if they do not consent, you can only extract their labor through force. Freedom of Speech, assembly, religion do not require input from other people. They require others to leave you alone to make your own decisions.
This debate should be framed as a "Moral Responsibility." It is the moral thing to do to lift up those who are disenfranchised, but it seems like some are pushing for insitutional codification, which is putting a "moral responsibility" into the category of "rights" and it is just too complex to properly administer.