That’s correct. Although you can view the pic from your e-mail, the pic probably exists on a mail server outside your computer. Typically, if you right click on the pic and select save, you can pick the location to save your photo. The default on many computers is “My Pictures”.
-J.