| M | T | W | T | F | S | S |
|---|---|---|---|---|---|---|
| « May | Jul » | |||||
| 1 | 2 | 3 | 4 | 5 | 6 | 7 |
| 8 | 9 | 10 | 11 | 12 | 13 | 14 |
| 15 | 16 | 17 | 18 | 19 | 20 | 21 |
| 22 | 23 | 24 | 25 | 26 | 27 | 28 |
| 29 | 30 | |||||
- 05/02/2012: Failure of conscious thought suppression
- 02/02/2012: What is the preconscious?
- 30/01/2012: Are there two types of cognition?
- 27/01/2012: The new way to view cognition
- 24/01/2012: About the claustrum
- 21/01/2012: Two sides of synchrony
- 18/01/2012: Skull shape changes are not independent
- 15/01/2012: the other way around
- 12/01/2012: A look at the dogma
- 09/01/2012: the Freud hangup
- February 2012
- January 2012
- December 2011
- November 2011
- October 2011
- September 2011
- August 2011
- July 2011
- June 2011
- May 2011
- April 2011
- March 2011
- February 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- August 2010
- July 2010
- June 2010
- May 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
Error signals
Again, more of the Firth podcast (here) that was the subject of the last few posts.
It’s interesting that engineers have a very different way of looking at the world than psychologists. Psychologists tend to have a loop which says there’s perception, signals come in about the world, you interpret them, and then you act. The perception is the input and the act is the output. Engineers look at it completely the other way around. They say you act upon the world, you put something into the world—that’s the input, is acting upon the world. And then something happens—which is the output—that enables you to decide what to do next.
And I think this captures this much more active way of thinking about the world which engineers have. Whereas the more passive view of psychologists where somehow you have a perception which you can somehow work out what’s going on, it’s very much the other way around. We have to act in order to create—to make the world send us back information which helps us to interpret what it is.
….
The dopamine signal is a prediction error. So, basically if something unexpectedly nice happens, then you get a shot of dopamine; and so, the dopamine neurons become more active. And if you expect something nice to happen and it does happen, there’s no response; because there’s not an error. If we expect it to happen and it doesn’t happen, then the activity goes down. So, that’s a negative error.
There may be a another way to look at this – a feedback loop does not have a beginning and a end. It is circular. Three components are interacting: the sensory data, the predictive model, and the action commands. Start with the sensory data - the data arrives, it is compared with the model, where it does not match it forces a change to the action commands. OR- Start with the action commands - the commands are given, they are used to create a predictive model of what will happen, the model is compared with the resulting sensory data, where it doesn’t match it results in changes the action commands. OR - Start with the model - keep it accurate by fine-tuning the action/prediction side and the sensing/perception side so that they match. The problem of how to understand a feedback loop is classic and there are good engineering formulas covering the subject (think op-amps, servo mechanisms and the like).