Esk Hall is a Grade II Listed Building, contructed in the 18th Century, although records of there being a building on the property stem back to the 16th Century. The parish website states that it is "mentioned as Abbey property in 1540, built by Cockerill." It is now a care home for the elderley and therefore NOT open to the public.
According to Coxe, there was once a time when the avenue and drive were never used because it meant death to a member of the owner's family, or even to a visitor staying there. However, he does not mention how this curious legend arose.
For further information, please read Haunted Britain by Antony D. Hippisley Coxe.