Natural gas is the cheapest type of fuel if available.
Last time I figured it oil was more efficient/cheaper than nat gas. I haven't done the numbers lately but when comparing high efficiency gas boilers to high efficiency oil boilers the last time it became necessary the oil won out.
You need to compare the price in your area between a "therm" of gas which is 100 Cu Ft x 1000 BTU per cu ft or 100,000 BTU and a gallon of oil which is 140,000 BTU. The best (conventional) gas efficiency available right now is 93% the best oil efficiency is 86% so if you take 100,000 BTU and multiply it by .93 you get 93,000 BTU of usable heat to your house from gas, if you take 140,000 and multiply it by .86 you get 120,400 BTU of usable heat to your house. And that's what it's all about. Propane is even less efficient than nat gas as it has less BTU per cubic ft than nat gas.