The South Carolina State Museum, the main attraction of the capital of Columbia, is located on the banks of the Saluda River in the heart of the city. One of the top attractions in Columbia's state capital, South Carolina, Congaree National Park is a must on any trip to the state capital. These are some of the best things to do in Columbia SC.