I've never been able to delete that way either. Look just above that checkbox for the line:
Add to Favorites · Post a Comment · Report Photo · Send as e-Card · Receive Email Updates · Edit Photo
Click on Edit Photo and near the bottom of the next window, you will see a delete checkbox...