It really doesn't make sense, sometimes the way the image was originally compressed can cause this type of problem.
Does that mean you're changing the encoding of images
by default? I'd say you shouldn't do anything to the image, unless the user requests for a compression change.