Wasn't the civil war fought between those years (1861-1865)
Could that have something to do with relocation?
I'm not saying it's not exactly what it sounds like but I am also from the south and there was a lot of homesteads and farms, plantations and cities burnt to the ground. Those were so lean years.