Speaking of getting a little tricky, its managed to get me confused in the process. So now there are 3 fields:
1) The dropdown with options (n/a, 0, 1 & 2)
2) The numberField
3) hiddenField
Rules:
1) Dropdown not equal to "n/a" (set field value: numberField = number(.) + numberField)
2) hiddenField is blank (set field value: hiddenField = Dropdown)
3) hiddenField is not blank (set field value: hiddenField - numberField, set field value: numberField = Dropdown, set field value: hiddenField = Dropdown)
I hope I've set the rules correctly to how you've explained it but it didn't work, its also pulling across the 'n/a' selection that we didn't want in the calculation.