The people creating infopath forms in our sharepoint site don't really care how they get their data.. they just want it. They create an infopath form, publish it to sharepoint and at some point in the future they want an excel sheet with all the participants' data.
Now it's kind of difficult to make reports in excel when you have repeating tables or sections inside your infopath form.. that just doesn't mix well with the flat structure of excel sheets. However I simply cannot really expect our end users to map columns or anything - visually, wizard driven or not - .. that's just outside their domain.. they don't want to do that.. and I doubt they are actually capable of doing that.
Also we are not talking about 1-10 infopath forms that are used for years and might be subject to minor changes throughout their lifetime. We are talking about 25-75 forms a month with an average lifetime of 1 month I guess. In our case Infopath is typically used for surveys and related tasks. And our IT department doesn't want to be involved in each and every form analysis.
Since I can only import one XML file into excel at a time I thought about merging all my xml files (could be 50000) into one big file.
Unfortunately Excel doesn't seem to be capable of handling such big files. At some point it just stops importing and miserably reports and error.
Any suggestions?