Replace the seal? It can't be all that expensive in this day of Internet car part shopping.
If that's too much a PITA for you, or too much expense, because you actually do have some high-end car or some oddball car, you could try threading some foam backer rod into the main cavity inside the foam rubber gasket to hold it wider, give it some loft again.