Qualcomm and Meta have announced that the companies are working together to bring applications powered by the social networking company’s new large language model, Llama 2, on smartphones that run on Qualcomm chips on phones and PCs starting in 2024.
Both the companies are working to optimise the execution of Meta’s LLMs directly on-device without the need of cloud services. According to the chipmaker, the technology will enable applications, powered by Snapdragon, to work in areas with no connectivity or even in airplane mode.
“The ability to run generative AI models like Llama 2 on devices such as smartphones, PCs, VR/AR headsets and vehicles allows developers to save on cloud costs, and to provide users with private, more reliable, and personalised experiences,” Qualcomm said.
This will essentially bring generative AI capabilities from large companies using powerful processors to users’ hands.
Intelligent virtual assistants on phones
The US-based chip making giant also announced that it already has plans to make available on-device Llama 2-based AI implementations that will enable customers, partners and developers to build use cases, such as intelligent virtual assistants, productivity applications, content creation tools, entertainment and more.
Durga Malladi, senior vice president and general manager of technology, planning and edge solutions businesses, Qualcomm Technologies, lauded Meta’s approach to bring generative AI on-device.
“To effectively scale generative AI into the mainstream, AI will need to run on both the cloud and devices at the edge, such as smartphones, laptops, vehicles, and IoT devices,” she added.
While Qualcomm is scheduled to make available Llama 2-based AI implementation on devices powered by Snapdragon starting from 2024, developers can already start optimising applications for on-device AI using the Qualcomm AI Stack.
It is a “dedicated set of tools that allow to process AI more efficiently on Snapdragon, making on-device AI possible even in small, thin, and light devices.”
Both the companies are working to optimise the execution of Meta’s LLMs directly on-device without the need of cloud services. According to the chipmaker, the technology will enable applications, powered by Snapdragon, to work in areas with no connectivity or even in airplane mode.
“The ability to run generative AI models like Llama 2 on devices such as smartphones, PCs, VR/AR headsets and vehicles allows developers to save on cloud costs, and to provide users with private, more reliable, and personalised experiences,” Qualcomm said.
This will essentially bring generative AI capabilities from large companies using powerful processors to users’ hands.
Intelligent virtual assistants on phones
The US-based chip making giant also announced that it already has plans to make available on-device Llama 2-based AI implementations that will enable customers, partners and developers to build use cases, such as intelligent virtual assistants, productivity applications, content creation tools, entertainment and more.
Durga Malladi, senior vice president and general manager of technology, planning and edge solutions businesses, Qualcomm Technologies, lauded Meta’s approach to bring generative AI on-device.
“To effectively scale generative AI into the mainstream, AI will need to run on both the cloud and devices at the edge, such as smartphones, laptops, vehicles, and IoT devices,” she added.
While Qualcomm is scheduled to make available Llama 2-based AI implementation on devices powered by Snapdragon starting from 2024, developers can already start optimising applications for on-device AI using the Qualcomm AI Stack.
It is a “dedicated set of tools that allow to process AI more efficiently on Snapdragon, making on-device AI possible even in small, thin, and light devices.”
window.TimesApps = window.TimesApps || {}; var TimesApps = window.TimesApps; TimesApps.toiPlusEvents = function(config) { var isConfigAvailable = "toiplus_site_settings" in f && "isFBCampaignActive" in f.toiplus_site_settings && "isGoogleCampaignActive" in f.toiplus_site_settings; var isPrimeUser = window.isPrime; if (isConfigAvailable && !isPrimeUser) { loadGtagEvents(f.toiplus_site_settings.isGoogleCampaignActive); loadFBEvents(f.toiplus_site_settings.isFBCampaignActive); } else { var JarvisUrl="https://jarvis.indiatimes.com/v1/feeds/toi_plus/site_settings/643526e21443833f0c454615?db_env=published"; window.getFromClient(JarvisUrl, function(config){ if (config) { loadGtagEvents(config?.isGoogleCampaignActive); loadFBEvents(config?.isFBCampaignActive); } }) } }; })( window, document, 'script', );
For all the latest Technology News Click Here
For the latest news and updates, follow us on Google News.
Denial of responsibility! NewsBit.us is an automatic aggregator around the global media. All the content are available free on Internet. We have just arranged it in one platform for educational purpose only. In each content, the hyperlink to the primary source is specified. All trademarks belong to their rightful owners, all materials to their authors. If you are the owner of the content and do not want us to publish your materials on our website, please contact us by email – [email protected]. The content will be deleted within 24 hours.
