A model swap did not fix our slow AI search, even though the model takes ~4 seconds to respond. It only worked when i changed the architecture. Here is what I measured, what I learned from Google, and

Markdown supported · ⌘↵ to post
No responses yet.