Yep. The Treasury page is the standard. State laws, such as the one in Texas, can clarify types of payment that will be accepted.
Lacking that, governmental entities can refuse to accept cash.
Some guy on an old Calguns thread says his Dad cited some claim to the IRS and got them to accept cash, but he and his Dad are wrong.