My first guess would be that the data type in your InfoPath form or SharePoint library are text or string fields which Excel doesn't like to filter on very easily.
Have you tried changing the data type in SharePoint and or InfoPath to see if that helps?