I'm going on the assumption you're using an Eris or Droid. The only way to delete Amazon MP3 store is to root the phone, and load a custom rom without it installed. This is def not a Verizon approved process.
Thanks!{edited for privacy}
You can't remove apps that come installed from the factory. You can download a task killer app if you want.