I cannot set my difficulty. I am mining on my S9.

I use username.worker_diff4500

The difficulty is still switching from 32k to 64k what is to high for me.

How can I set it lower. Currently I have about 8-10% rejected shares.