When viewing a photo, hit your menu button and a delete option will be available.
When browsing media in your "Gallery" app, you can long-press on a photo's thumbnail and a delete option will be available in the pop-up menu.
You can browse files on your SD card using the "Files" app. Long-press on a file to bring up a menu, and you should have a delete option.
