Although the fanbases are smaller compared to the three NFC East teams on the east coast, they are solid and longstanding.
Since entering the league in back-to-back years, Atlanta and New Orleans have played each other every season but one since 1967.
The Falcons and Saints have been in the same division since 1970 - first in the NFC West (!), then the NFC South since 2002.
The two teams have played each other twice every season except for 1987 (shortened due to the players' strike).
Buccaneers franchise started a decade later in 1976 - but were in the NFC Central until 2002, when they moved into the NFC South.
I would think with the geographical closeness of the four cities overall - New Orleans, Tampa, Atlanta, Charlotte - it's better to leave that division as is.