Generative AI adoption is growing exponentially in the industry, which makes on device computing of GenAI is an important technology to cater the needs. In this session I plan to cover the following,
why GenAI on edge is important?
GenAI use-cases on edge – Auto, Mobile, IoT
Unique technical challenges in running large models on edge devices.
Key Techniques used to resolve the problems. (will cover briefly on power, performance, quantization, distillation etc..)
Hybrid AI
Qualcomm’s AI Stack for GenAI for edge devices.