Burlington House originally began as a private residence on Picadilly Street, London, in 1664. In 1704, it became the home of Richard Boyle, Third Earl of Burlington, who became a famous architect in the Palladian style. Burlington died in 1753 and passed his home on to his son, Lord George Cavendish. Either he or the Third Duke of Portland occupied the home when John Almon worked across the street.

This is the facade of Burlington House as it still stands today. The courtyard is open to the public, and many of the wings contain exhibition galleries from the Royal Academy.