The cost of mining bitcoin is insignificant compared to the cost of producing, managing, processing, transacting, and destroying fiat currency.
Think about how much energy the federal mint uses to print fiat. How much do banks use, who's only purpose is to transact in fiat? Think lights, heating, cooling, construction of buildings, computers, networking... it's staggering.
Think how much energy is used by the credit card industry. 100's of thousands of employees, most requiring electricity for various purposes (computers, lights, heat, construction, etc..)
I'd bet, on market cap basis, fiat uses orders of magnitude more energy overall than bitcoin.