Building AI Applications from your desktop with Podman AI Lab
- Track: Low-level AI Engineering and Hacking
- Room: UB2.252A (Lameere)
- Day: Sunday
- Start: 13:20
- End: 13:40
- Video only: ub2252a
- Chat: Join the conversation!
Generative AI is revolutionizing how we build modern applications, but for developers, it can be daunting, particularly with evaluating models, building with Gen AI, and the path to production. But, it doesn’t have to be worrisome! Join us in this session to be ahead of the curve when it comes to AI-enabled cloud-native application development.
Using container technology and open source models from Hugging Face, we’ll show how to practically integrate Gen AI in an existing application from your local development environment and ultimately deploy it onto Kubernetes. Why work with local and open-source models? From reducing cloud computing costs, keeping control of your sensitive data, and alleviating vendor-locking, it’s an increasingly popular way for developers to prototype AI applications quickly. We’ll demonstrate a sample of the whole AI journey, starting from assessing models, building applications with LLMs, and deploying/serving AI applications.
Speakers
Cedric Clyburn | |
Stevan Le Meur |