Is it a good idea to use font icons in place of SVGs?

While learning web development and design, one of my key learnings was to keep the visual information (styles, for instance) decoupled form from the content information (markup).

Font-icons seem to go against this idea. We’re putting these "visual" elements in the markup for the ease of use they provide. What are your thoughts on this?