Yes, I think this is possible - I'm guessing your email addresses are currently set as default values?
I think what I'd do is add an attribute to each email field called "Changed" and set it to "true" when the email field is changed. Then for my email "To" field in my submit connection, I'd use a formula to concatenate all the changed = true email addresses. I'm attaching a simple sample form - right click the link in the header and save the form locally. Right click the saved file and select Design to open in design mode.
In this sample, my email fields are not repeating - if yours are, you'll need to use a double eval formula, of which you can find many examples on this forum.