Though parents grudge, and you, w'are met, <br /> And cloistered in these living walls of jet.

The speaker tells the listener to forget societal norms and barriers, telling them that they have already met in a sacred place, a reference to the temple or flea. The flea creates a close, private area for the two of them to be free from the view of others.