The NLP Pipeline Behind Insight Engine: Extracting 10.7M Entities from 229K Research Papers (Part 2)
How I used spaCy, SciSpacy, and a rule-based relation extractor to extract
10,779,699 entities and 2,294,895 relationships from 229,498 arXiv papers —
fully tracked with DVC and MLflow on a single RTX 4060 GPU.