And to truly feel what it was like to be on the hill back in its heyday ... early winter to avoid the most crowds. The Citadel National Historic Site is about a 15-minute walk west of the waterfront.