Duplicate posts are in your list of the real problems, and the ingest path is the one place they are not handled. Every toast becomes a parse, a match and an alert, so a driver sitting in five groups where the same dispatcher posted the same trip gets five pushes for one job, at exactly the moment attention is scarce.
A hash of the normalised text plus a short window, checked before insert, collapses those to one without touching the parser. Normalised is the important half: you already fold spelling and language differences for matching, and that same normalisation is what makes two copies of one trip hash alike.
Duplicate posts are in your list of the real problems, and the ingest path is the one place they are not handled. Every toast becomes a parse, a match and an alert, so a driver sitting in five groups where the same dispatcher posted the same trip gets five pushes for one job, at exactly the moment attention is scarce.
A hash of the normalised text plus a short window, checked before insert, collapses those to one without touching the parser. Normalised is the important half: you already fold spelling and language differences for matching, and that same normalisation is what makes two copies of one trip hash alike.