If you want to get rid of the field/data source completely, you'll have to open Data Source in the Design Tasks pane, find the field, and then remove it. Keep in mind, however, that doing so will remove any connections that data source has with a field in your form.
I'm not sure if that's what you were asking for, but I hope it helps.