Its not certain but the wooden tower was probably built around 1400, possibly as late as 1480.
Its said Henry VIII used to escape London for the Priory when he wanted some special time with a non-wife ;)