Clues to how the brain works
This blog is mostly about neural networks, but the topic of this post is on the way people think in practice, which may or may not be a target for NNs to emulate. How do we deal with evidence that contradicts (or strengthens) a hypothesis? There’s a mathematical law for that – it’s called Bayes […]
Deep distilling is a method to get rules out of neural nets. The nets should be interpretable, and the inventors of Deep Distilling invented one type of interpretable neural net that they call “Essence Neural Nets”. I wrote about this in a prior post. Why get rules? A neural net might tell a doctor that […]
Essence Neural Nets were invented by Paul Blazek and Milo Lin a few years ago. They have several big advantages over standard supervised Neural Nets trained by backpropagation of error along gradients. Three problems with standard neural nets are: 1) When you train an ordinary supervised neural net with backpropagation, you usually can’t understand what […]
Stephen Grossberg, an early pioneer in the field of neural nets and the brain, recently published a book called “Conscious Mind Resonant Brain” that describes the theories he’s developed since the 1970s. In chapter five he discusses one theory he named ‘Adaptive Resonance Theory” (ART) that led to a product that has been used in […]
The neocortex is responsible for sensory perception, cognition, generation of motor commands, spatial reasoning and language. There are new theories being developed on how it works. One theory comes from a company named Numenta. Numenta was founded by an entrepreneur named Jeff Hawkins who invented the Palm Pilot (the first commercially successful example of a […]
In my prior post, I wrote about Professor Michael Hasselmo’s book on grid cells in the brain, which create a type of GPS grid as we walk through a space. But the main point of the book is that grid cells plus ‘place cells’ can be part of a circuit for storing episodic memory. […]
An interesting way to represent information in neurons is explained in the book “How We Remember” by Michael Hasselmo. We have a type of GPS system – a grid that appears in our head whenever we go into a room, for instance. In fact, we have multiple spatial grids that vary in their spacing and […]
Eric Kandel wrote the standard textbook of Neural Science (in which he was a pioneer) and just published a book titled The Disordered Mind – What Unusual Brains Tell Us About Ourselves.. I will just select a few interesting points from the book about the pre-frontal cortex, since that is a part of the brain […]
Much of human cognition can be though of as ‘constraint satisfaction’ according to philosopher Paul Thagard. For example, think of applying to a university. One college is in a beautiful setting, but another college has a professor who is an expert in your desired major. The first college is in a quaint town with a […]
In “The Eureka Factor – Aha Moments, Creative Insight, and the Brain”, authors John Kounios and Mark Beeman discuss insight – the kind of insight that might occur to you when taking a walk or taking a shower as opposed to trying to force a solution to a problem in your office under a deadline. […]