IMHO, this is not the right abstraction level to handle it.
SLF4J is an API. The "prettiness" is an implementation detail and should be handled by the underlying logging engine. You could move to the Appender level - and yes, it would require one such appender for each implementation (Logback, Log4J, etc.).