Probably not all that much to worry about, IMO.
Extremely pathogenic coronaviruses were behind SARS (severe acute respiratory syndrome) and MERS (Middle East respiratory syndrome) and were easily transmitted from human to human. SARS, which showed up in the early 2000s, infected more than 8,000 people and resulted in nearly 800 deaths.
While the impact of flu varies, it places a substantial burden on the health of people in the United States each year. CDC estimates that influenza has resulted in between 9 million – 45 million illnesses, between 140,000 – 810,000 hospitalizations and between 12,000 – 61,000 deaths annually since 2010./
Plain old flu seems to continually far outperform in annual deaths. I think 17 people have died so far from the coronavirus. That flu death count is just the US. A gazoogle showed about 300,000-600,000 annual deaths worldwide.