The Old Vicarage is allegedly haunted by the apparition of Rupert Brooke (3 August 1887 - 23 April 1915), the English poet known for his idealistic war sonnets written during the First World War, especially ‘The Soldier’. There are also reports of kinetic phenomena including the movement of books, and footsteps across the top floor.

An underground passage is said to run from the Old Manor House to King’s College Chapel two miles away. It was said that a fiddler who offered to follow the passage set off playing his fiddle; the music became fainter and fainter, until it was heard no more and the fiddler was never seen or heard of again. On a seventeenth century map of Grantchester, one of the fields is called Fiddler’s Close.