In the manoeuvre Merritt had been attacked in front of Berryville and Wilson at Summit Point, the former by cavalry and the latter by Anderson’s infantry. The exposed positions of Merritt and Wilson necessitated their withdrawal if I was to continue to act on the defensive; so, after the army had moved back to Halltown the preceding night, without loss or inconvenience, I called them in and posted them on the right of the infantry.
My retrograde move from Strasburg to Halltown caused considerable alarm in the North, as the public was ignorant of the reasons for it; and in the excited state of mind then prevailing, it was generally expected that the reinforced Confederate army would again cross the Potomac, ravage Maryland and Pennsylvania, and possibly capture Washington. Mutterings of dissatisfaction reached me from many sources, and loud calls were made for my removal, but I felt confident that my course would be justified when the true situation was understood, for I knew that I was complying with my instructions. Therefore I paid small heed to the adverse criticisms pouring down from the North almost every day, being fully convinced that the best course was to bide my time, and wait till I could get the enemy into a position from which he could not escape without such serious misfortune as to have some bearing on the general result of the war. Indeed, at this time I was hoping that my adversary would renew the boldness he had exhibited the early part of the month, and strike for the north side of the Potomac, and wrote to General Grant on the 20th of August that I had purposely left everything in that direction open to the enemy.
On the 22d the Confederates moved to Charlestown and pushed well up to my position at Halltown. Here for the next three days they skirmished with my videttes and infantry pickets, Emory and Cook receiving the main attention; but finding that they could make no impression, and judging it to be an auspicious time to intensify the scare in the North, on the 25th of August Early despatched Fitzhugh Lee’s cavalry to Williamsport, and moved all the rest of his army but Anderson’s infantry and McCausland’s cavalry to Kerneysville. This same day there was sharp picket firing along the whole front of my infantry line, arising, as afterward ascertained, from a heavy demonstration by Anderson. During this firing I sent Torbert, with Merritt’s and Wilson’s divisions, to Kerrteysville, whence he was to proceed toward Leetown and learn what had become of Fitz. Lee.
About a mile from Leetown Torbert met a small force of Confederate cavalry, and soon after encountering it, stumbled on Breckenridge’s corps of infantry on the march, apparently heading for Shepherdstown. The surprise was mutual, for Torbert expected to meet only the enemy’s cavalry, while the Confederate infantry column was anticipating an unobstructed march to the Potomac. Torbert attacked with such vigor as at first to double up the head of Breckenridge’s corps and throw it into confusion, but when the Confederates realized that they were confronted only by cavalry, Early brought up the whole of the four infantry divisions engaged in his manoeuvre, and in a sharp attack pushed Torbert rapidly back.