In most places I know of electricity is cheaper than natural gas/heating oil so yeah I guess you would be saving $ on heating costs.
Where in the world are you?
There is absolutely no comparison between gas and electric heat where I am. I paid about $60 a month to keep a 4000 sq. ft house toasty warm with gas last winter.
I'd be better off burning dollar bills to keep warm than paying for electric heat.