If no contact is sent, the confirmation when sending a public reply is far too similar to the standard confirmation. I find I am not sending emails quite often due to this!
If no contact set it looks like this
And if a contact is set:
Yes, they are slightly different, but my suggestion would be to make the button red if there is no contact set.
Further to this, the ticket history shows the envelope icon, even if no email was sent!