Apple's On-Device Model Has a 4,096-Token Window, and Your App Spends It Faster Than You Think

Apple's on-device model is free, private and fast. It also has a context window of 4,096 tokens, and that window is shared by more things than most developers count. A chat feature that works in a dem