Photo: sparhawk4242/iStock

New Jersey: Cape May

Cape May became a popular vacation destination in the 18th and 19th centuries. Today, the city — which many consider America's oldest seaside resort — boasts one of the country's highest concentrations of Victorian homes, including the famous Emlen Physick Estate. The eye-catching, yellow-hued Congress Hall, which was built in 1816, makes a great home base for your trip.