Magnolia's page-editor.css, line 35:
conflicts with website designs that use font-awesome, such as the popular
Unify bootstrap template.
In preview mode, the website icons are swapped with others incorrectly, while the published site shows the icons correctly.
Recommended solution: change the Magnolia CSS
so that it's explictly just affecting the magnolia bar, not all icons on the page.