Do any of the fields used to filter contain the user alias? By specifying Document level read permissions, you can use the 'Show only my documents', which will use the logon user to limit the result set returned to the webpart. The webpart filter does the filtering client-side, but the 'Show only my documents' is a server-side filter and will speed up the lookup.