This is marked as a Historic Building of Kent. The frontage is actually Victorian, it was altered in 1888 when the present facade was brought in from elsewhere. The house may have originally been built in around 1250 for the Rector of St.Alphege.
It is now a rental property and one with a lot of character. I took yesterday's and tomorrow's image from the open window at the top of the building in this image.