You can delete photos with Photozig Albums using the Rotated/Hide/Delete/Info bar in the thumbnails view of each album.
Deleted photos are actually only marked by the program as deleted, but remain in their locations. To definitely get rid of deleted photos you must use the Remove Deleted Photos button, available on the album thumbnails view.