How much of the grand architecture in London was built with monies made from the slave trade?

Walking from the Natural History Museum to Charing Cross got me pondering on that question. Were Belgrave Square and Eaton Square built with slave monies is the two i pondered most on though ...