No matter what you choose, you're going to pay for it, either with electricity, propane, or natural gas. I suppose there's the solar panel option and while that's "free heat" you still have to pay for the initial equipment and setup.
I have a heat pump and it works well for my particular...