Hey Diogenese,Akida GenAI & Akida 3 have been adapted to handle 16-bit integer and 32-bit FP. This, in addition to the malleable architecture, enables these two chips to be flexibly configured to handle all types of models and to be adapted for future applications.
The provision of a LUT in place of an activation function seems like a patentable idea if original. We are also told by JT that a patent application is in the pipeline for a new technique for retrieving data from memory. This is the most energy intensive action so the invention will further increase the power efficiency and probably latency.
Akida 2 is 8 times more efficient than Akida 1, and presumably that also applies to GenAI & Akida 3 for equivalent Akida 1 tasks. However, 16-bit integer and 32-bit FP seem to provide excessive capabilities for an edge device. Does Nvidia need to look over its shoulder "like one that on a lonesome road doth walk in fear and dread, and having once turned round, walks on, and turns no more his head, because he knows that close behind a frightful fiend doth tread"?
Have you had a chance to look at what Nanovue is offering and whether or not it represents any serious competition to Akida? This is an interview the NVU CEO did with Stocks Down Under very recently in which he says "Having a very computational efficient processor that takes up very little space is very key in things like wearable glasses, medical devices, drones, putting it into cell phones ... anything that requires good battery management, also high computational power. EMASS right now benchmarks against the best of the best in those regards.":
It's the closest sounding tech to Akida I've come across however am not tech savvy enough to know how close it really is.
Cheers,
mcm