Okay, I found where the photos can be deleted. You click and open the photo and down below by the photo name, there is a pencil.
Also, some of the sideways photos now appear to be "upright"-don't how they changed by itself. The rest of my photos still appear sideways-maybe over time they will...