JEPA (Joint-Embedding Predictive Architecture) - Overview

What is JEPA JEPA (Joint-Embedding Predictive Architecture) is best understood as a shift in what a model is trained to predict: instead of reconstructing raw inputs (tokens, pixels, waveforms), JEPA predicts abstract representations (embeddings) of ...