In the north east we normally see Gas, Oil, or Electric. All heating sources depend greatly on how much you use them, price fluctuations, and how "dated" your system is.
Maintenance: Electric is your hands down easiest with Gas in runner-up and Oil last. Electric requires nothing to my knowledge so it keeps things simple. Also, one bill. Gas is cleaner than oil so your utilities won't need to be serviced as frequently, saving you money.
Cost: New electric baseboards I have heard are now more efficient. Some new ones have a gel substance that gets heated up and allows electrical to shut off until it needs to be reheated again, unlike old electric baseboard that would radiate for hours wasting electricity. Gas and Oil fluctuate sorta closely so it doesn't matter too much.
Long term: Electric is probably the way to go as it seems much of the US is leaning towards enforcing renewable energy as a means to power anything at all, ie, solar, wind, hydro, etc.
Other things to note: Dryer, Water Tank, Furnace, Stove/Oven all can run on gas or electric. These things can also change how your bills run.