Well try several ones:
- Koblitz: Number Theory and Cryptography - get the crucial understanding of elliptic curves math from complete zero,
- then try a great "Introduction to Modern Cryptography" by Jonathan Katz and Yehuda Lindell
and you good to go.