Notes on Judea Pearl

I’ve known about Judea Pearl and his work for many years, but I just started studying it in detail. Many recent papers I have read directly cite his work. In thinking about my model building engine theory, cause and effect is one of the central ideas that came about from that thought experiment. If humans… Continue reading Notes on Judea Pearl

The Language of Thought hypothesis and Compositionality was worked on hundreds of years before computers existed!

I just learned Gottfried Wilhelm Leibniz (1646-1716), famous for inventing calculus, was also interested in the philosophy of mind. He proposed a concept called the Alphabet of human thought, which is an idea that says there is a universal way to represent all human thought with small primitive components. With these primitive components, we should… Continue reading The Language of Thought hypothesis and Compositionality was worked on hundreds of years before computers existed!

What is grounded language learning

“An unknown, but potentially large, fraction of animal and human intelligence is a direct consequence of the perceptual and physical richness of our environment, and is unlikely to arise without it”. – John Locke (1632-1704) Powerful state of the art machine learning systems such as word2vec and GPT-3 are powerful machine learning models that seem to… Continue reading What is grounded language learning

Examining concepts through different filters

I think the human mind an autonomous interlinked model building database of the world. I define models and concepts to be the same thing. One important aspect of this system that has been nagging me is the idea that the human mind can examine ideas/models/concepts from different filters. In my article about the mind as… Continue reading Examining concepts through different filters