I've started reading this. Good, accessible read so far.
A good intro to cryptography (1) by D. Boneh and V. Shoup, from Stanford. It starts with Stream/Block Ciphers and goes through Elliptic Curve cryptography, signatures and basic number, probability and complexity theory.
Relatively simple