Funny thing is that it was Taiwan's president that called him. What was he supposed to do, not take the call?
It's easy for someone like a billionaire, president elect totally insulated by gatekeepers to politely decline to speak to someone.
That said, I don't have a problem with him tweaking the Chinese government a little bit.