In season 3, halfway through the season, there's 5 folks that enter the prison through a burned down section of it.
One of them gets bit on the arm. Relatively non-life-threatening wound.
Or, take Hershel's bite on the leg earlier in the season.
If everyone alive is infected already, and everyone turns in death regardless of being bitten or not, how does a bite cause relatively instant death and turning?