Isn't a 'tax credit' just a fancy way of saying 'we will take less tax money from you'?
Yes. It differs from a deduction in that a deduction just removes the amount of income from being taxed.
There is no moral quandary, here. If one thinks so, don't deduct mortgage interest from one's taxes or any of all that. Just take the standard deduction and call it a day.
"Towards the government I feel no scruples and would dodge paying the
[income] tax if I could. Yet I would give my life for England readily
enough, if I thought it necessary. No one is patriotic about taxes."
----George Orwell's Wartime Diary, 8/9/40
Example:
$100K income, 35% income tax = $35K taxes.
$10k in deductions would leave $90k left to be taxed at the 35% rate for $31.5k in taxes.
A $1.5k tax credit would directly lower that tax bill by $1.5k, leaving $30K taxes to be paid to Uncle Sugar.