Yes, the colors are stored in the .xsl files that represent your views. Making a backup is critical before making manual changes to your form template. Or, as Adam said, use a completely separate form to make your changes and then copy them over to your template (but still make the backup first!).