I meant to read this paper for a long time and finally got around to it. Paper link: https://arxiv.org/abs/2003.05161v2 Laura Ruis is the main author, I hope she goes on to do more work in this “general direction” 🙂 Jacob Andreas of NTM fame is a co-author, awesome! Brenden Lake who does tons of interesting… Continue reading My notes on ”A Benchmark for Systemic Generalization in Grounded Language Understanding”
Tag: research
What is grounded language learning
“An unknown, but potentially large, fraction of animal and human intelligence is a direct consequence of the perceptual and physical richness of our environment, and is unlikely to arise without it”. – John Locke (1632-1704) Powerful state of the art machine learning systems such as word2vec and GPT-3 are powerful machine learning models that seem to… Continue reading What is grounded language learning
AGI research reflection questions
Here are the main questions ask myself often to reflect on and measure how I am doing with my AGI research. Am I following my AGI research MO? What papers were most interesting? Any new learnings? Any new thoughts ? Do I need to update any of my mind maps? Do I need to update… Continue reading AGI research reflection questions
AGI Research MO
Sometimes I will start reading a paper and go down a rabbit hole following lots of different papers. There is so many papers to read and so many directions to go towards and sometimes I end up getting overwhelmed and frustrated because there is too much information and it all seems too hard. So sometimes… Continue reading AGI Research MO
Notes on “A language of thought for the mental representation of geometric shapes”
I’m going to try to write notes on the papers I read in this blog as well. Here is my first one. Link to paper: https://psyarxiv.com/28mg4 Authors: Mathias Sablé-Meyer, Kevin Ellis, Joshua Tenenbaum, Stanislas Dehaene Both Joshua Tenenbaum and Stanislas Dehaene are 2 of my favorite researchers, so I had to read this joint paper… Continue reading Notes on “A language of thought for the mental representation of geometric shapes”
Examining concepts through different filters
I think the human mind an autonomous interlinked model building database of the world. I define models and concepts to be the same thing. One important aspect of this system that has been nagging me is the idea that the human mind can examine ideas/models/concepts from different filters. In my article about the mind as… Continue reading Examining concepts through different filters
Ideas for meeting interesting researchers
offer office hours have paper reading sessions have a ML mastermind group reach out to researchers join a journal club join other researchers’ office hours mentor researchers find a research mentor teach an online course study online courses and send questions to the professors
Do grid like cells appear in the neocortex?
Grid cells exist in the entorhinal cortex (EC) and are known to fire for spatial navigation on a hexagrid structure. Grid cells along with the other cells in the EC are implicated as a key component that allows for generalization and conceptual maps in the human brain. Recently I was reading “A Framework for Intelligence… Continue reading Do grid like cells appear in the neocortex?
The human mind is an autonomous interlinked model building database of the world
My definition of intelligence has become refined over time. In my article about the the human mind being a simulation engine, I already wrote out some of the points I am going to make, but my thinking has on the topic has become more clear. The human mind is composed of tens of thousands of… Continue reading The human mind is an autonomous interlinked model building database of the world
ideas to implement a model database
Let’s use a dog as an example each model can potentially cause an agent to move or change in an imagined environment language definition is stored each model has the ability to compose with other models each model the ability to be used in other environment there are core or base models in which the… Continue reading ideas to implement a model database