It was very soon realised that nothing short of rebuilding the tower from the foundation would meet the case. The first stone was taken down on April 5th, and the tower and two eastern piers were removed by August. The western piers were soon afterwards condemned, and taken down the following year. The chief corner stone of the new tower at the north-eastern pier, was laid with full masonic ceremonial on May 7th 1884, by the Earl of Carnarvon, acting for the Prince of Wales. All the stones, as taken down, were numbered, and every one that could be used again was replaced in its original position. During this year there commenced a controversy as to the correct way of finishing the building of the tower. When the Decorated lantern was first built, the great arches, east and west, to the choir and nave, were altered from the round to the pointed shape. A few of the stones of the original Norman arches having been brought to light during the work, some persons wished round arches to be built as at first. Some stones of the Norman tower were also found; and it was proposed to heighten the central tower by one stage of work in the Norman style, using original stones where possible, and placing the Decorated stage above it. Others again, wanted a lofty central spire to be added. The matter was referred to Archbishop Benson for his decision. In the result the whole was rebuilt exactly as before, with the exception that the four corner turrets, erected by Dean Kipling, were not replaced.
In 1886 the tower was finished. The transept ceilings were repaired in this and the next year. All unsound wood was removed and replaced by good oak. The diamond shapes are still to be seen, but the black, white, and brown patterns have been improved away. The discovery of the site of the Saxon church, which will be described hereafter, was made in 1883. Steady progress continued to be made in securing the safety of various parts of the church; and on July 11th, 1889, a temporary choir having been fitted up, divine service was again held in the ancient ritual choir, which extended two bays into the nave.