This "prejuidice" originates from that GPUs were originally build for rendering 3D graphics, which is mainly floating-point heavy.

Some modern shader algorithms heavily use integer math as well, but the main meat of rendering is still fp.