JEPA (Joint-Embedding Predictive Architecture) - Overview

Jan 4 · 8 min read · What is JEPA JEPA (Joint-Embedding Predictive Architecture) is best understood as a shift in what a model is trained to predict: instead of reconstructing raw inputs (tokens, pixels, waveforms), JEPA predicts abstract representations (embeddings) of ...