The 80bit kernels are only used once (1/16) of the time of a hash. To improve the speed you need to optimize all the kernels.