Yes, this is a security risk. Even if you use views or conditional formatting in the form, the xml is still out there for download.
We've used the Encrypt command in qRules to encrypt the data. Whether you use qRules or not, I think the solution is encryption, such that the xml data is not readable if downloaded.