Teaching and learning resources • Re: Super-cheap Computing Cluster for Learning

Is it possible to distribute the processing of a single LLM across multiple Pi 5 computers?

Recently came across Distributed llama.
https://github.com/b4rtaz/distributed-llama
So it is possible.

That looks like an interesting project, and they've even got version for a Raspberry Pi clusters.

The super-cheap cluster, unfortunately, is 32 bit and distributed Llama requires 64 bit.

Maybe it's time to upgrade.

Statistics: Posted by ejolson — Sat Mar 08, 2025 4:13 am

---