Now I can solve puzzle 65 without the public key in just a few seconds if you have the right factors in place
Hi, nice code

The prime numbers approach is a good idea, I also try it some time ago, but it only works as you said
if you have the right factors if no then the brute force approach of the prime numbers is also some exhaustive, we can try some small and common factors but those don't provide much speed, but if the prime factors aren't common then the probabilities of some prime number is factor of our key are very low probabilities.
IMHO this prime number approach is a nice as proof of concept but very with some low success