Search posts, tags, users, and pages
A matched Pi experiment shows why quantisation is an agent memory decision: 4-bit and 6-bit finished, while 8-bit hit Metal OOM.
Billie M
@billiem
Markdown supported · ⌘↵ to post
No responses yet.