Getting a Modern LLM Running on a 2005 PowerBook G4

Andrew Rossignol:

I have been diving into the world of large language models (LLMs), and a question began to gnaw at me: could I bring the cutting-edge of AI to the nostalgic glow of my trusty 2005 PowerBook G4? Armed with a 1.5GHz processor, a full gigabyte of RAM, and a limiting 32-bit address space, I embarked on an experiment that actually yielded results. I have successfully managed to achieve LLM inference on this classic piece of Apple history, proving that even yesteryear’s hardware can have a taste of tomorrow’s AI.

A fun project, well-explained. Even a great choice of computer to run it on — the 12-inch PowerBook G4 is one of the best-looking computers ever made. (Via Joe Rossignol.)

★ Monday, 24 March 2025