BRN Discussion Ongoing
- Thread starter TechGirl
- Start date
Taproot
Regular
Must watch !
Judd Heape - Vice President of product management at Qualcomm." We're working with Prophesee to bring this technology to smart phones. "
Here, he is specifically talking about solving motion blur !
The whole vid is worth watching, but Prophesee segment from 32 min mark.
Camera Tech on Snapdragon 8 Gen 2: Snapdragon Summit Tech Talk
18 Jan 2023Snapdragon Summit 2022 connected the global Snapdragon community, launched new technologies, and dove deep into specific technologies in a series of Tech Talks. In this Tech Talk, Judd Heape — vice president of product management at Qualcomm — explores all things Snapdragon Sight and what sets this leading smartphone camera technology apart from the pack. Qualcomm and Snapdragon have innovated on smartphone camera technologies across the years, as illustrated in Heape’s overview of previous Snapdragon camera tech. And now Snapdragon Sight on the Snapdragon 8 Gen 2 Mobile Platform is transforming mobile photography once again. What sets Snapdragon Sight apart from the competition? To start, an 18-bit triple ISP capable of capturing over a billion colors from three cameras simultaneously, 8K HDR video capture, and 4096 times more camera data. But the real star of the show is the world’s first cognitive ISP. Using AI technology, this cognitive ISP offers real-time segmentation filters and applies custom treatment to each layer of the image (up to eight layers) for photos, videos, and the viewfinder. It’s no wonder that Snapdragon is the leader in every professional camera quality feature for smartphones.
Taproot
Regular
Brainchip / Prophesee podcast
From 16.40 minute mark.
For past 3 years working on combining regular frame based with event based sensors in smart phones to solve motion blur.
Rob Telson confirming soon after that is where the Brainchip / Prophesee collaboration is headed.
Good Morning Taproot,
GREAT FIND & EXTREMELY EXCITING.
Time 37:50.
Quote, REALLY SOON...
. Regards,
Esq.
Good morning, All
Nice to see my choice of the word "launch" last week, resurfacing again, this despite some Smart Alec poster trying to belittle
my choice of said word.
The "launch" can only happen when the foundry and our founders' processes have been signed off, not a day before.
So, with that being said, I'm quite happy with around June this year, but remember it's just my opinion.
With the Quarterly due out in approximately 6 business days, I'm still not expecting to see much revenue, my gut feeling is Q3 onwards.
Looking forward to hearing of some IP signings, that's the catalyst to truly identifying potential future royalty streams.
Very nice observation by the original poster.
Love Brainchip......Tech
Great find! Thanks
Damo4
Regular
This is huge. I'll try not to count my chickens before they hatch, but we know this technology is Akida+Prophesee so buckle in.
Transcript below from around that 32 min mark, sorry the formatting is ass:
| Snapdragon 8 Gen 2 will deliver professional quality photos and videos expect these professional quality |
| cameras and smartphones in 2023 all right |
| so yeah expect this sensor out in 2023 thanks very much |
| okay let's talk about even another image sensor technology |
| prophecy is is a company that has developed a really unique image sensor |
| called an event-based Vision sensor and it's really unique because |
| our world does not actually operate in 30 frames per second or 60 frames per |
| second with a scanning raster it doesn't do that um our eyes our visual system perceives |
| things much more uh detailed with a lot better temporal resolution and so these |
| image sensors are quite unique in that they don't they're not fixed to a certain frame rate for example so and there's |
| some benefits to that so the prophecy image sensor has a lot of really unique characteristics the first is that it can |
| run at an equivalency of 10 000 frames per second because this image sensor like I said is not locked to like 30 or |
| 60 frames it outputs data only when there's an event or a change in the |
| scene so the essence of the scene is captured only the changes are captured this can |
| lead to much less bandwidth coming out of the sensor because if you have the camera pointed at a static scene why |
| output any data you know why why waste battery life doing that if the scene hasn't changed so this sensor actually |
| does that it also can work in extreme lighting conditions this sensor can be programmed |
| to work at you know 120 DB of dynamic range huge amount of HDR dynamic range and |
| finally it works at really really low power so it's a quite unique technology we're working with prophecy to bring |
| this technology to smartphones and so I'd like to play a video for you from Luca who is their CEO the video was in |
| French but it has subtitles so please take a look |
| there is a |
| at the risk like this is |
| foreign |
| really interesting and unique technology um and it works a lot like the human eye |
| which I think Luca mentioned here but you might ask yourself why wait what's |
| what's the purpose of this why would this be important for a mobile application so let me show you |
| you see here that we're using an RGB camera a standard camera on the left to capture someone playing tennis and on |
| the right is the image that comes out of the prophecy event-based Vision sensor and so like I said the one on the left |
| the RGB camera operates at a fixed frame rate 30 or 60 frames per second |
| the prophecy image sensor operates 1000 times faster than that so the prophecy |
| image sensor can actually output only pixels that change and they can output them really really quickly so |
| as far as when the person swings the racket it's sampling 10 000 times more data than the RGB sensor is so the the |
| movement the fine the the really tiny movements are are captured so much better and again why is this important |
| for smartphones the reason why this is important is because if you take an action sports |
| shot and you use a standard image sensor that's locked to a certain frame rate you get an image like that where the uh |
| the actual uh static image has motion blur so the one on the left where the racket is in motion it's completely |
| blurred and there's no easy way to get around that unless you up the frame rate |
| but then that lowers your light and it's you know becomes a real problem but if you can intelligently combine the data |
| from the RGB sensor with the event based sensor from prophecy fuse those together what we can do is we can apply that that |
| tons of motion data from the proxy sensor to the RGB side and then get rid of the motion so this will get rid of |
| all the motion blur in in your shots and so the good news is that we're working |
| really closely with prophecy to bring this motion reduction technology for static images into smartphones so you'll |
| see this really soon really cool technology so let me shift gears a bit and talk |
| about bokeh portrait video and portrait photography last year on 8gen one we |
| talked about how we have a hardware-based bokeh engine and that engine uh was capable of creating these |
| blur shapes completely in Hardware at low power and it worked for video |
| now on Snapdragon 8 Gen 2 we've taken this engine and we've taken it a step |
| further so we said to ourselves why not modify the bokeh engine so that it could |
| simulate different F numbers of lenses so something from F14 all the way down to F 1.4 and when you do that when you |
| when you simulate a larger aperture what you end up with is bouquet shapes that are a lot bigger a lot more intense |
| so that's one of the cool things we can do live with this technology that's now in |
| Hardware in Snapdragon 8 gen 2. and so we actually oh this is first a video |
| here intensity of out of focus sources of light in the background or change the effect entirely with radical new bouquet |
| shapes that are Hardware accelerated to save power now did you see that not only can we |
| change the bokeh size based upon the F number a simulated enough number we can change the shape so this is really going |
| to be cool for people who want to do fun you know videos or selfie photography where they want to change the the |
| standard kind of blur circle into a diamond into a heart Etc so to show you |
| that this is real I have my esteemed colleague Jeff here and we're going to show this actually |
| live so take a look at the screens here so you see behind him we have simulated |
| Christmas lights behind him and you can see here that he can change the shape of those blurred lights |
| from circles to Diamonds to hearts or he can change the intensity of the of |
| the bouquet so back to the standard with no bouquet at all he can sweep and go right back between you know kind of a |
| very subtle effect to a very extreme effect with a really fast lens |
| and again you see this in the viewfinder this is happening in Hardware in real time 60 frames per second and can be |
| shot with video or photo so pretty cool stuff and you can only do |
| this in Hardware thanks Jeff |
| okay let's also talk about ultra low light in the past I've talked about our |
| low light engine and how we've been able to really reduce noise efficiently to get really really good performance in |
| low light |
Last edited:
JK200SX
Regular
Stable Genius
Regular
Thanks so much @Taproot !
This is a great example of why this forum/platform can work.
No individual can possibly monitor everything going on with Brainchip as a company and all the possible opportunities.
As a TEAM (Together Everyone Achieves More) we can share information of value to increase our knowledge base collectively.
Fact Finder for many years generously shared his time, wisdom and expertise with us to improve the quality of this forum and our knowledge but it takes a team effort for it to work. My thoughts after re-reading his words are he eventually got frustrated with so many posts of whinging and little value that instead of it contributing to his day the balance of it’s value decreased to the point it was no longer effective use of his time as to the purpose of this forum.
It’s a shame the conversations deteriorated off track as they had. But every day is a new day, a new opportunity to improve!
My due diligence in my investment is not based on FF or anyone else on this platform but it is a great starting point to then do your own research and corroborate information; assess that information with other known facts; make a decision and then continuously re-assess. Every day you have the option to buy, sell or hold!
This new information generously shared by Taproot indicates to me there is a likelihood we could be included in mobile phones soon!
And Qualcomm would be another fantastic company to become involved with.
Regardless of the current SP movements; How exciting and explosive is that!
Enjoy your day people!
I love the enthusiasm but am not yet convinced of Qualcomm because prophesee sensors can be paired with other processors. Think it does bode well for future adoption of akida in mobile devices using prophesee though. Happy to be corrected if wrongThanks so much @Taproot !
This is a great example of why this forum/platform can work.
No individual can possibly monitor everything going on with Brainchip as a company and all the possible opportunities.
As a TEAM (Together Everyone Achieves More) we can share information of value to increase our knowledge base collectively.
Fact Finder for many years generously shared his time, wisdom and expertise with us to improve the quality of this forum and our knowledge but it takes a team effort for it to work. My thoughts after re-reading his words are he eventually got frustrated with so many posts of whinging and little value that instead of it contributing to his day the balance of it’s value decreased to the point it was no longer effective use of his time as to the purpose of this forum.
It’s a shame the conversations deteriorated off track as they had. But every day is a new day, a new opportunity to improve!
My due diligence in my investment is not based on FF or anyone else on this platform but it is a great starting point to then do your own research and corroborate information; assess that information with other known facts; make a decision and then continuously re-assess. Every day you have the option to buy, sell or hold!
This new information generously shared by Taproot indicates to me there is a likelihood we could be included in mobile phones soon!
And Qualcomm would be another fantastic company to become involved with.
Regardless of the current SP movements; How exciting and explosive is that!
Enjoy your day people!
Ahboy
Regular
"Rob Telson confirming soon after that is where the Brainchip / Prophesee collaboration is headed."
Thanks Taproot, this is evolving quickly given the latest revelation from Qualcomm.
Rob said this at 19:42 mark after Luca (Prophesee) explained the motion blur correction:
"lastly I think this is the one where our listeners really need to take um take a a moment to truly understand, uh Prophecies Technologies/Brainchips technology this is where we want to go. Into mobile devices where we can enhance our everyday lives and imaging is one of the key aspects of that so thank you Luca for for bringing those up".
Lex555
Regular
From my memory of the Prophesee interview is that their camera didn’t work properly without Akida, it was a match made in heaven. So I struggle to comprehend them using another processor to get these efficiencies
SERA2g
Founding Member
Hi JB
It's great that Mercedes fills you with confidence!
For what it's worth, I used Markus Schafer's comments regarding there being 'a long way to go' for context as it creates the context for Heinrich Gotzig's response "Thanks a lot for this very interesting article. I can confirm that it is a long way to go but very promising."
These comments don't diminish Valeo's progress in commercialising a product containing akida. They simply confirm that current neuromorphic technologies still have a long way to being a 'brain on a chip' that is comparable to the human brain which contains 100 billion neurons operating at 20 watts of power.
Cheers!
Stable Genius
Regular
Hi @Moonshot,
I agree it is not a done deal which is why I used the word ”likelihood.”
Prophesee speaking so highly of Brainchip being a natural choice as they are both neuromorphic and the obvious power saving feature leans me towards the logical conclusion we “could” be included. However all companies will use their own products first if they can achieve an acceptable result and improve profit margins. Qualcomm would be no exception.
My excitement is because the likelihood of Brainchip being included with Qualcomm technology by being paired with Prophesee has increased since before I read Taproot‘s post and viewed the video.
The post earlier by @VictorG about Dragonfly drones is also exciting although not as exciting as Qualcomm. Again only a loose dot join but sooner or later some of these dots will come to fruition. Another example of the 1000 eyes team working together!
Cheers!
Bigfella195
Member
Microsoft are laying off 10,000 employees but will continue to hire with their sights on a new AI computer platform.
"While we are eliminating roles in some areas, we will continue to hire in key strategic areas," Mr Nadella said.
He emphasised the importance of building a "new computer platform" using advances in artificial intelligence.
"While we are eliminating roles in some areas, we will continue to hire in key strategic areas," Mr Nadella said.
He emphasised the importance of building a "new computer platform" using advances in artificial intelligence.
Boab
I wish I could paint like Vincent
Perhaps Mr Gotzig has had a peak at Akida#2?
We are in Intel FS. Doesn't it seem almost a given that Intel is licensing Akida IP? An announcement with a $1m payment would forever light the torch under Brainchip's share price and validate its neuromorphic competencyGood morning, All
Nice to see my choice of the word "launch" last week, resurfacing again, this despite some Smart Alec poster trying to belittle
my choice of said word.
The "launch" can only happen when the foundry and our founders' processes have been signed off, not a day before.
So, with that being said, I'm quite happy with around June this year, but remember it's just my opinion.
With the Quarterly due out in approximately 6 business days, I'm still not expecting to see much revenue, my gut feeling is Q3 onwards.
Looking forward to hearing of some IP signings, that's the catalyst to truly identifying potential future royalty streams.
Very nice observation by the original poster.
Love Brainchip......Tech
So, what happened? Is Intel on the deferred payment plan (tough year) or what?
Dhm
Regular
Within the job application it asks for a talented software architect to help drive development of Lava, the new open source framework that re-thinks entire software stack for the unique needs of neuromorphic computing.
Mike Davies• 1.Director, Neuromorphic Computing Lab at Intel Corporation
1 Std. • vor 1 Stunde
We’re hiring! Help us elevate Lava to the next level
Senior Neuromorphic Software Architect
Job Description:
Join Intel-and build a better tomorrow. Intel is in the midst of an exciting transformation, with a vision to create and extend computing technology to connect and enrich the lives of every person on Earth. Join us and help us create the next generation of technologies that will shape the future for decades to come.
Intel's Neuromorphic Computing Lab is pioneering a new domain of brain-inspired computer architecture defined by large parallel collections of neural processing units operating as sparsely active event-driven nonlinear dynamical systems. This technology promises orders of magnitude gains in efficiency and speed compared to conventional architectures for a large class of emerging AI workloads. While neuromorphic hardware architecture and algorithms have progressed rapidly, the development of professional neuromorphic software tools, methods, and frameworks is still at a nascent stage.
Senior Neuromorphic Software Architect
Job Details: Job Description: Join Intel-and build a better tomorrow. Intel is in the midst of an exciting transformation, with a vision to create and extend computing technology to connect and enrich the lives of every person on Earth. Join us and help us create the next generation of...intel.wd1.myworkdayjobs.com
Showing my complete ignorance here... @Diogenese is this terminology what one would expect Intel to say if they are looking to further the growth of Akida within Intel?
If this is so, then this would be very hot news.
Edit: I am told by someone who knows that BRN does not support or need Lava.
Last edited:
buena suerte :-)
BOB Bank of Brainchip
Mccabe84
Regular
Also is pretty obvious edge impulse is using BRN tech but no IP deal
, I guess all will be revealed in timeSimilar threads
