That is the best time to get a Krispy Kreme,
Absolutely. I generally don't get Krispy Creme, but they got them at work quite a bit when there was a Krispy Creme in town. Definitely a difference fresh out of the oven*. I would also, if they had been sitting in the coffee mess for a while, just zap them in the micro for like 5 seconds to get them closer to "oven fresh".
*Of course, most everything baked tastes best fresh out of the oven (or the oil). I bake bread once a week and always overindulge after I pop it out of the oven. My excuse being, "Well, I can't used the end pieces (I make it in a dutch oven, artisan shaped) for sandwiches or toast, so I might as well slather butter on them and eat them now."