BRN Discussion Ongoing

wilzy123

Founding Member
Just bought another 5k worth of shares because I like seeing zero dollars in my bank account 😂
Let’s go brain!!! I think the bus has morphed into a locomotive and once it starts it won’t stop, so get on whilst you can #2023 year of the Brainchip.
yeahhhp.gif
 
  • Haha
  • Like
Reactions: 9 users

Damo4

Regular
  • Like
  • Thinking
Reactions: 3 users

Sam

Nothing changes if nothing changes
  • Like
Reactions: 2 users
  • Like
  • Fire
Reactions: 26 users

Diogenese

Top 20
I'm guessing I'm not the only one wondering.

How Transformers Work
https://towardsdatascience.com/transformers-141e32e69591

___
"In this way, LSTMs can selectively remember or forget things that are important and not so important."
harrr again ❤️‍🔥
Hi cosors,

Thanks for posting this.

The Attention function requires a lot of multiplication:

"The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a Query vector, a Key vector, and a Value vector. These vectors are created by multiplying the embedding by three matrices that we trained during the training process."
...
"The score is calculated by taking the dot product of the query vector with the key vector of the respective word we’re scoring."
...
"pass the result through a softmax operation. Softmax normalizes the scores so they’re all positive and add up to 1.
...
This softmax score determines how much how much each word will be expressed at this position. Clearly the word at this position will have the highest softmax score, but sometimes it’s useful to attend to another word that is relevant to the current word.
The fifth step is to multiply each value vector by the softmax score (in preparation to sum them up). The intuition here is to keep intact the values of the word(s) we want to focus on, and drown-out irrelevant words (by multiplying them by tiny numbers like 0.001, for example).
The sixth step is to sum up the weighted value vectors. This produces the output of the self-attention layer at this position (for the first word)
."

Given that Akida avoids MAC operations in its 4-bit mode, I wonder if Akida can be configured to avoid one or more of these multiplication steps.

As far as I can make out, self-attention involves selecting important words (subject (noun), verb, and object (noun/adverb/adjective)) ... and sentences can be much more complex.

This describes the treatment of a short sentence. To obtain the context, it may be necessary to process a larger chunk of text, such as a whole paragraph. The mind boggles!
 
  • Like
  • Fire
  • Love
Reactions: 28 users

Earlyrelease

Regular
Hi cosors,

Thanks for posting this.

The Attention function requires a lot of multiplication:

"The first step in calculating self-attention is to create three vectors from each of the encoder’s input vectors (in this case, the embedding of each word). So for each word, we create a Query vector, a Key vector, and a Value vector. These vectors are created by multiplying the embedding by three matrices that we trained during the training process."
...
"The score is calculated by taking the dot product of the query vector with the key vector of the respective word we’re scoring."
...
"pass the result through a softmax operation. Softmax normalizes the scores so they’re all positive and add up to 1.
...
This softmax score determines how much how much each word will be expressed at this position. Clearly the word at this position will have the highest softmax score, but sometimes it’s useful to attend to another word that is relevant to the current word.
The fifth step is to multiply each value vector by the softmax score (in preparation to sum them up). The intuition here is to keep intact the values of the word(s) we want to focus on, and drown-out irrelevant words (by multiplying them by tiny numbers like 0.001, for example).
The sixth step is to sum up the weighted value vectors. This produces the output of the self-attention layer at this position (for the first word)
."

Given that Akida avoids MAC operations in its 4-bit mode, I wonder if Akida can be configured to avoid one or more of these multiplication steps.

As far as I can make out, self-attention involves selecting important words (subject (noun), verb, and object (noun/adverb/adjective)) ... and sentences can be much more complex.

This describes the treatment of a short sentence. To obtain the context, it may be necessary to process a larger chunk of text, such as a whole paragraph. The mind boggles!
If Dodgy Knee's mind boggles I am stuffed.
 
  • Haha
  • Like
  • Love
Reactions: 25 users

toasty

Regular
As long termers here will know. my posts are usually pretty upbeat. I have been heavily into this stock since 2016 so am obviously a patient person. However, I admit to the continued manipulation of this stock slowly wearing me down. I understand that our relationships are protected by NDA's and all that but to see the share price where it is with so much good news flowing over the last few months is VERY frustrating.

I am a big believer in the technology and the team bringing it to the market but damn it if the manipulators aren't having a field day at our (ordinary retail holders) expense. I guess some of it boils down to the fact that the ASX is a technology backwater. If BRN was listed in the US I am confident that the SP would be some multiples of what it currently is.

And I'll tell you something I don't understand. If the new version of AKIDA is currently in pre-production why hasn't there been an announcement about successful initial testing? It is inconceivable that we would be proceeding to tape-out if Peter and Anil were not convinced that it is going to work!!!!

Rant over.....hoping for some commercial progress to be revealed in the upcoming 4C..........
 
  • Like
  • Love
  • Fire
Reactions: 42 users
The sound of the pitchforks sharpening in the distance.......
 
  • Haha
  • Like
Reactions: 18 users

alwaysgreen

Top 20
  • Like
  • Haha
  • Love
Reactions: 9 users

stuart888

Regular
Interesting how many results return for "transformer neural network 4-bits".

Likely, the Brainchip geniuses have a best-in-class low-power solution for this, since it is apparently not far out from being official revealed.


1673576347348.png
 
  • Like
  • Love
  • Fire
Reactions: 20 users
As long termers here will know. my posts are usually pretty upbeat. I have been heavily into this stock since 2016 so am obviously a patient person. However, I admit to the continued manipulation of this stock slowly wearing me down. I understand that our relationships are protected by NDA's and all that but to see the share price where it is with so much good news flowing over the last few months is VERY frustrating.

I am a big believer in the technology and the team bringing it to the market but damn it if the manipulators aren't having a field day at our (ordinary retail holders) expense. I guess some of it boils down to the fact that the ASX is a technology backwater. If BRN was listed in the US I am confident that the SP would be some multiples of what it currently is.

And I'll tell you something I don't understand. If the new version of AKIDA is currently in pre-production why hasn't there been an announcement about successful initial testing? It is inconceivable that we would be proceeding to tape-out if Peter and Anil were not convinced that it is going to work!!!!

Rant over.....hoping for some commercial progress to be revealed in the upcoming 4C..........
Hard work hey @toasty but at some stage there will be a tipping point. When? How long is a piece of string. I have been in since 2015 and although like everyone else would like SP higher, the fundamentals are better than they have ever been, and a damn sight better than when we first came on board. Slow burner this one but damn, when it runs, it will really run. Just hope the shorters are the ones that are trampled in the stampede.

SC
 
  • Like
  • Love
  • Fire
Reactions: 43 users

stuart888

Regular
Interesting how many results return for "transformer neural network 4-bits".

Likely, the Brainchip geniuses have a best-in-class low-power solution for this, since it is apparently not far out from being official revealed.


View attachment 26953
Yeah, yeah: 4 Bits Are Enough was the 6th item listed, when searching google for: "transformer neural network 4-bits".

1673576949609.png
 
  • Like
  • Fire
  • Love
Reactions: 14 users

Cyw

Regular
As long termers here will know. my posts are usually pretty upbeat. I have been heavily into this stock since 2016 so am obviously a patient person. However, I admit to the continued manipulation of this stock slowly wearing me down. I understand that our relationships are protected by NDA's and all that but to see the share price where it is with so much good news flowing over the last few months is VERY frustrating.

I am a big believer in the technology and the team bringing it to the market but damn it if the manipulators aren't having a field day at our (ordinary retail holders) expense. I guess some of it boils down to the fact that the ASX is a technology backwater. If BRN was listed in the US I am confident that the SP would be some multiples of what it currently is.

And I'll tell you something I don't understand. If the new version of AKIDA is currently in pre-production why hasn't there been an announcement about successful initial testing? It is inconceivable that we would be proceeding to tape-out if Peter and Anil were not convinced that it is going to work!!!!

Rant over.....hoping for some commercial progress to be revealed in the upcoming 4C..........
I don't think the next 4C will be a block buster as they are raising cash now. Why would you raise cash now if you know you are overflow with cash and the explosive 4C will take the SP to over $1? Perhaps the third quarter 4C.

Wake me up when we get there.
 
  • Like
Reactions: 13 users

stuart888

Regular
  • Haha
  • Thinking
  • Like
Reactions: 11 users

Diogenese

Top 20
Socionext have posted an article on their website about what they got up to at CES 2023 (Brainchip has been included as well):


Hi SFB,

Great find:

Top right "NNA" = neural network accelerator - Akida baked into their processor!

... and immediately under NNA, "User defined Logic" allows customers to customize the processor.

1673577038327.png


Advanced AI Solutions for Automotive​

Socionext has partnered with artificial intelligence provider BrainChip to develop optimized, intelligent sensor data solutions based on Brainchip’s Akida® processor IP.

BrainChip’s flexible AI processing fabric IP delivers neuromorphic, event-based computation, enabling ultimate performance while minimizing silicon footprint and power consumption. Sensor data can be analyzed in real-time with distributed, high-performance and low-power edge inferencing, resulting in improved response time and reduced energy consumption
.

How good is that?!
 
  • Like
  • Love
  • Fire
Reactions: 67 users
As long termers here will know. my posts are usually pretty upbeat. I have been heavily into this stock since 2016 so am obviously a patient person. However, I admit to the continued manipulation of this stock slowly wearing me down. I understand that our relationships are protected by NDA's and all that but to see the share price where it is with so much good news flowing over the last few months is VERY frustrating.

I am a big believer in the technology and the team bringing it to the market but damn it if the manipulators aren't having a field day at our (ordinary retail holders) expense. I guess some of it boils down to the fact that the ASX is a technology backwater. If BRN was listed in the US I am confident that the SP would be some multiples of what it currently is.

And I'll tell you something I don't understand. If the new version of AKIDA is currently in pre-production why hasn't there been an announcement about successful initial testing? It is inconceivable that we would be proceeding to tape-out if Peter and Anil were not convinced that it is going to work!!!!

Rant over.....hoping for some commercial progress to be revealed in the upcoming 4C..........
Hey mate,

Appreciate the honesty. I’m in a similar time loop to you and can relate to the sentiment about the share price. I’m not sure about the NASDAQ listing value being materially different. An example is IONQ, they have the worlds most advanced known quantum computer for commercial use and have consistently grown their revenue with a valuation of 900k USD. The revenue might be on a scale that we might achieve but it is something to be mindful off.

On the shorters/day traders note, one thing I’m 100% convinced about is that eventually there will be no escape via NDA or other means from disclosing the cash receipts in the 4c and when that happens the shorters are going to get smoked.
 
  • Like
Reactions: 1 users

Diogenese

Top 20
  • Haha
  • Like
Reactions: 15 users
Any chance one of you can take a screenshot of market depth expanded to show individual orders please.?
 

Sam

Nothing changes if nothing changes

Attachments

  • 17C6C449-1E1D-4EAF-B385-AF2DE75B134E.png
    17C6C449-1E1D-4EAF-B385-AF2DE75B134E.png
    366.1 KB · Views: 155
  • A6205235-1817-4E43-9B86-BAE94B45CA4D.png
    A6205235-1817-4E43-9B86-BAE94B45CA4D.png
    393.5 KB · Views: 147
  • 40C3178E-4291-4270-A0E7-0EE8E91BCD95.png
    40C3178E-4291-4270-A0E7-0EE8E91BCD95.png
    389 KB · Views: 131
  • B7D9B200-462F-4DCC-9D9D-11FB5294DCFA.png
    B7D9B200-462F-4DCC-9D9D-11FB5294DCFA.png
    369.3 KB · Views: 155
  • Like
  • Love
Reactions: 7 users
Top Bottom