So. if private key is prime, so address would be prime too?
Nope, there is no causality between primality between the private key and the public address (expressed as hash160).
Both elliptic curve cryptography and hashing (SHA256 and RIPEMD160) in between, so it's a trial and error process.