Dannyboy, well, it was the states' right to sanction slavery.
SA, as well as the heavily German Hill Country that opposed secession. I would also recommend the book "Look Away!" that deals with slavery as the driving force behind the CSA and discusses pockets of Southern hostility to slavery (e.g. Hill Country, Knoxville, Western Virginia, inter alia).