And just like that I found a solution to my problem!
Under the Rich Text Box properties for the control: click on the "Display" tab, then check "Enable enhanced rich text content such as tables, images, and hyperlinks." This frustratingly fixes the problem, albeit makes the control a little less responsive in the web form. ...