The form is stored in a document library in Sharepoint. The users launch the form from there, fill it in and click the Submit button.
The forms are being sent by a number of individuals and two different users have experienced the duplicate form problem so far.
The emails are going internally to another address within our organisation and our server only sees a single email going through.
The recipient doesn't have any rules set up in Outlook.
I like your suggestion of hiding the ribbon and creating my own submit button with rules and a thank you view but, as mentioned, am new to Infopath (and trying to teach myself as I go along) so this is a bit beyond me at the moment.