I just tried the Kivy showcase. I have a similar issue for the drop down and spinner widgets there, but it's not as bad. It only takes 1-3 presses to register a click. So, yes, it seems to be a Kivy issue.
Thanks.
I just checked the Kivy github page and the issue has already been reported (#4031). I added my experience as well.