I first heard of the song from this thread. I listened to it and really got the "us vs them" as a rural/urban divide. I didn't see any racism in it personally.
Perhaps there's a certain worldview which sees racism in everything they find objectionable.