ubergarm
John W. Leimgruber III also known as "ubergarm" enjoys quantizing big LLMs for enthusiasts and professionals alike to run hybrid CPU+GPU inferencing on gaming rigs, home-labs, and private on-prem deployments.
Get in touch with ubergarm at: * https://github.com/ubergarm/ * https://huggingface.co/ubergarm * https://www.linkedin.com/in/john-leimgruber/ * https://www.reddit.com/user/VoidAlchemy/ * https://huggingface.co/BeaverAI (ubergarm on discord)
Events
| Title | Day | Room | Track | Start | End |
|---|---|---|---|---|---|
| Adventures in Model Quantization |
Saturday | UD2.120 (Chavanne) | AI Plumbers | 14:30 | 14:50 |