BrainChip's Akida Pico Brings LLMs to the Edge At embedded world Exhibition&Conference in Texas, BrainChip ’s Todd Vierra unveiled the revolutionary Akida Pico—a neural processor bringing large language models (LLMs) to the edge! This breakthrough eliminates the need for cloud processing...
www.linkedin.com
Ohh Tom you’ve done it again….
View attachment 71764
Tying into my earlier post above about LG planning on-device AI chips.
I thought I'd post this LG article dated Feb 2024.
It's interesting in light of Todd Viera's presentation involving appliances (which
@supersonic001 posted above).
So, LG have been working with Upstage to develop small language model (SLM)-based on-device AI technology to fit into LG’s laptops and home appliances.
The aim of the collaboration is to develop AI technology to recognize users' voice commands and translate, summarize, search and recommend documents, etc.
This seems to be exactly what Todd was describing above, especially when he suggested Akida Pico will be able to perform text to speech and speech to speech functions.
Oh, and I also posted a link to an Upstage video published 2 months ago in which they discuss RAG, which Todd also talked about in his presentation.
So, maybe worth keeping an eye on LG in this regard...
LG Elec, Upstage to form partnership for on-device AI
Upstage's small language model-based AI technology will apply to LG laptops and home appliances
By Chae-Yeon Kim Feb 06, 2024 (Gmt+09:00)
2 Min read
Choi Hong-joon, Upstage vice president (left) and Gong Hyuk-joon, LG Electronics' head of IT customer experience (Courtesy of LG Electronics)
South Korea’s artificial intelligence startup Upstage said on Tuesday it has signed a memorandum of understanding with LG Electronics Inc. to develop small language model (SLM)-based on-device AI technology to fit into LG’s laptops and home appliances.
On-device AI processes data in smartphones, laptops and tablets without internet connectivity at a faster speed than cloud-based AI and consumes less power. It also has enhanced data security without personal information leakage.
In December last year, the AI startup unveiled Solar, a new 10.7-billion-parameter English language model, the first of its kind in the world. It is an advanced pretrained generative text model.
Upon its debut, Solar secured the top position on Huggingface Open LLM Leaderboard, a global AI platform, beating Meta, Alibaba, 01.AI and Mistral AI.
In the first two weeks of its launch, all LLMs based on Solar took the top 20 spots on the leaderboard.
Solar is an acronym for Specialized and Optimized LLM and Applications with Reliability.
It is less than one-tenth of a GPT-3, a very large language model, in parameter and features a much faster inference speed, allowing it to provide various language-related AI services without affecting the performance and power consumption of the device. It is regarded as an optimal on-device AI.
Upstage and LG will collaborate to develop AI technology to recognize users' voice commands and translate, summarize, search and recommend documents or web pages.
“We will first apply the highest-performance AI to LG gram laptops with cumulative sales of 2 million units and do our best to ensure LG customers can experience AI features in LG Electronics home appliances,” Choi Hong-joon, vice president of Upstage, said in a statement.
Upstage Chief Executive Sung Kim is a professor at the Hong Kong University of Science and Technology (HKUST) and led Naver Clova AI Research.
He co-founded Upstage in 2020 with other AI experts from Nvidia, eBay,
Naver Corp. and
Kakao Corp., as well as professors from New York University and HKUST.
Naver is South Korea’s largest online portal and Kakao is the mobile giant in the country.
At CEO 2024 last month, LG Electronics CEO Cho Joo-wan defined AI as affectionate intelligence and emphasized that responsible intelligence was one of its characteristics to protect user data and enhance access safety.
South Korea’s artificial intelligence startup Upstage said on Tuesday it has signed a memorandum of understanding with LG Electronics Inc. to develop sma
www.kedglobal.com
478 views 16 Aug 2024
Creating a Retrieval-Augmented Generation (RAG) Workflow with Upstage AI