Teaching Machines the Soul of Your Language

A few days ago, I published a blog about completing a Google DeepMind challenge lab on Arabic character-level language models. It was all about tokenization, n-grams, and getting sequences aligned correctly for transformer training. The thing is, I g...