The issue with using a heat pump for your winter heating is that the cold outside air has very little heat that can be pulled out of it. The colder it get's outside, the less efficient the device becomes.
Indeed. But even in the worst case such a device is still more efficient than resistive heating. This of course only applies to air-source heat pumps. Water-source are dependent only on the temperature of the water supply which stays relatively consistent year round.