Discussion

Running A Billion Parameter Model (LFM3 1.7B) on a Raspberry Pi

A Raspberry Pi 4 can run comfortably (3t/s) LFM3 1.7B. Not usable for heavy coding, but good enough for an orchestrator.

Written by

Dragos Roua

@dragosroua · Lisbon, Portugal

I code since before it was vibey

Markdown supported · ⌘↵ to post

Robert Degallan

Hi Dragos, great article and video showcasing the capabilities of the Raspberry Pi for local inference 👏

Dragos Roua

Glad it's useful, thanks!