Brussels / 3 & 4 February 2024


Why not run OpenCL-accelerated LLM on your phone?

Many of us were drawn to Linux by the amazing possibilities and combinations we could create while running the operating system. Such things were often not possible back then with operating systems like Windows.

Now, history is repeating itself with Android and iOS. Most of the devices we buy are highly locked and restricted, limiting our ability to do what we want on these devices. Even after spending many hours recompiling the entire system or patching it, there's no guarantee of achieving satisfactory results.

Linux allows us to do incredible things, encouraging experimentation, play, and learning.

As a Mesa3D developer, I have chosen to share my journey of running an LLM model using OpenCL as an example.


Photo of David Heidelberg David Heidelberg