Building LLMSlim: Architecture Deep-Dive into Deterministic Prompt Compression

Most prompt compression discussions focus on the happy path: you have a long RAG context, you trim it to 50% of tokens, and your API bill halves. What rarely gets discussed are the failure modes: drop