It was the Norman baron Ralph de Mortimer, who as part of his reward for helping William the Conqueror defeat the English in 1066, was given Downton.

After a mention in the Doomsday Book of 1086 the estate was quietly left to its own devices for the next six centuries until, in 1727, Richard Knight, a successful iron smelter, acquired it. He in turn left it to his grandson Richard Payne Knight, a ‘libertine and freethinker’, who was a founding member of the Picturesque Movement that wished to `improve’ the landscape.

Knight conceived the idea of building Downton Castle in the gothic revival style and he designed it to complement the wild and irregular scenery of the area, as opposed to reflecting the then fashionable `artificial and tame’ landscapes advocated by the great garden architects Capability Brown and Humphrey Repton. He cut new paths, built a Roman Bath, an Alpine Bridge and a Switchback Tunnel. He also commissioned the English landscape water-colourist Thomas Hearne to paint twelve views of the dramatic Downton Gorge.

In 1986 the estate was sold to the present owners, who continue to conserve the historical and aesthetic characteristics so beloved by Richard Payne Knight.