With tools like OpenVINO, people can run high-performance AI models on modest hardware, making advanced capabilities available without significant financial investment. “Today, people came to my booth to say, ‘Hey, Ray, what are you running?’” he tells us. “I’m running a large language model, Llama 3, eight billion parameters, that never runs properly on their machines. I use OpenVINO to compress it, and now it fits into the RAM, and I can fit it into the GPU of this little machine.” That is how the 10-year route-tomarket cycle that Raymond talked about earlier gets shorter. “Your everyday machine becomes your AI engine,” he confirms. Intel is developing user-friendly APIs and extensive tutorials to help computer vision professionals benefit from these advancements. Its OpenVINO Notebooks repository has literally hundreds of tutorials! It has Edge AI Reference Kits designed for specific use cases across industries like manufacturing and retail. It creates content users can follow step by step to optimize, quantize, and apply these new AI trends in their infrastructure. “We don’t just give you cookies,” Raymond adds. “You get the recipes for making your own cookies!” Feedback from the field has been overwhelmingly positive. “It really warms my heart when people come back to tell me I tried it, I used it, I made an impact,” he recounts. “One person told me, ‘I can make a business from it. I can make an impact on millions of people using this product.’ He became a top scientist from Stanford and told me, ‘I could accelerate some of this model as well.’ That’s heartwarming because we don’t just show people something, and then they forget, and it never gets used anywhere else; they take it to the next level!” Intel’s commitment to the community extends beyond CVPR, with regular virtual events called 13 Computer Vision News Computer Vision News “It really warms my heart when people come back to tell me I tried it, I used it, I made an impact...” Intel AI
RkJQdWJsaXNoZXIy NTc3NzU=